-- Logs begin at Fri 2022-07-01 18:44:54 UTC, end at Fri 2022-07-01 19:51:13 UTC. -- Jul 01 19:20:29.145126 dv-cinder-844601-7-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 01 19:20:29.155475 dv-cinder-844601-7-smb devstack@keystone.service[80237]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 01 19:20:29.158088 dv-cinder-844601-7-smb devstack@keystone.service[80237]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jul 1 19:20:29 2022] *** Jul 01 19:20:29.158088 dv-cinder-844601-7-smb devstack@keystone.service[80237]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 01 19:20:29.158088 dv-cinder-844601-7-smb devstack@keystone.service[80237]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 01 19:20:29.158088 dv-cinder-844601-7-smb devstack@keystone.service[80237]: nodename: dv-cinder-844601-7-smb Jul 01 19:20:29.158088 dv-cinder-844601-7-smb devstack@keystone.service[80237]: machine: x86_64 Jul 01 19:20:29.158088 dv-cinder-844601-7-smb devstack@keystone.service[80237]: clock source: unix Jul 01 19:20:29.158088 dv-cinder-844601-7-smb devstack@keystone.service[80237]: pcre jit disabled Jul 01 19:20:29.158088 dv-cinder-844601-7-smb devstack@keystone.service[80237]: detected number of CPU cores: 4 Jul 01 19:20:29.158088 dv-cinder-844601-7-smb devstack@keystone.service[80237]: current working directory: / Jul 01 19:20:29.158088 dv-cinder-844601-7-smb devstack@keystone.service[80237]: detected binary path: /usr/bin/uwsgi-core Jul 01 19:20:29.158088 dv-cinder-844601-7-smb devstack@keystone.service[80237]: your processes number limit is 47680 Jul 01 19:20:29.161452 dv-cinder-844601-7-smb devstack@keystone.service[80237]: your memory page size is 4096 bytes Jul 01 19:20:29.161452 dv-cinder-844601-7-smb devstack@keystone.service[80237]: detected max file descriptor number: 2048 Jul 01 19:20:29.161452 dv-cinder-844601-7-smb devstack@keystone.service[80237]: lock engine: pthread robust mutexes Jul 01 19:20:29.161452 dv-cinder-844601-7-smb devstack@keystone.service[80237]: thunder lock: enabled Jul 01 19:20:29.161452 dv-cinder-844601-7-smb devstack@keystone.service[80237]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 01 19:20:29.161452 dv-cinder-844601-7-smb devstack@keystone.service[80237]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 01 19:20:29.202229 dv-cinder-844601-7-smb devstack@keystone.service[80237]: Python main interpreter initialized at 0x564250c7a9c0 Jul 01 19:20:29.202229 dv-cinder-844601-7-smb devstack@keystone.service[80237]: python threads support enabled Jul 01 19:20:29.202229 dv-cinder-844601-7-smb devstack@keystone.service[80237]: your server socket listen backlog is limited to 100 connections Jul 01 19:20:29.202229 dv-cinder-844601-7-smb devstack@keystone.service[80237]: your mercy for graceful operations on workers is 90 seconds Jul 01 19:20:29.202643 dv-cinder-844601-7-smb devstack@keystone.service[80237]: mapped 403077 bytes (393 KB) for 2 cores Jul 01 19:20:29.202721 dv-cinder-844601-7-smb devstack@keystone.service[80237]: *** Operational MODE: preforking *** Jul 01 19:20:29.202983 dv-cinder-844601-7-smb devstack@keystone.service[80237]: *** uWSGI is running in multiple interpreter mode *** Jul 01 19:20:29.202983 dv-cinder-844601-7-smb devstack@keystone.service[80237]: spawned uWSGI master process (pid: 80237) Jul 01 19:20:29.203220 dv-cinder-844601-7-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 01 19:20:29.204627 dv-cinder-844601-7-smb devstack@keystone.service[80237]: spawned uWSGI worker 1 (pid: 80246, cores: 1) Jul 01 19:20:29.204627 dv-cinder-844601-7-smb devstack@keystone.service[80237]: spawned uWSGI worker 2 (pid: 80247, cores: 1) Jul 01 19:20:29.204627 dv-cinder-844601-7-smb devstack@keystone.service[80237]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 01 19:20:34.621682 dv-cinder-844601-7-smb devstack@keystone.service[80246]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 01 19:20:34.621682 dv-cinder-844601-7-smb devstack@keystone.service[80246]: from cryptography.utils import int_from_bytes Jul 01 19:20:34.622488 dv-cinder-844601-7-smb devstack@keystone.service[80246]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 01 19:20:34.622488 dv-cinder-844601-7-smb devstack@keystone.service[80246]: from cryptography.utils import int_from_bytes Jul 01 19:20:34.622599 dv-cinder-844601-7-smb devstack@keystone.service[80247]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 01 19:20:34.622599 dv-cinder-844601-7-smb devstack@keystone.service[80247]: from cryptography.utils import int_from_bytes Jul 01 19:20:34.623009 dv-cinder-844601-7-smb devstack@keystone.service[80247]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 01 19:20:34.623009 dv-cinder-844601-7-smb devstack@keystone.service[80247]: from cryptography.utils import int_from_bytes Jul 01 19:20:34.670763 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 01 19:20:34.670909 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 01 19:20:34.671002 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 01 19:20:34.671119 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 01 19:20:34.671235 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] command line args: [] {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 01 19:20:34.671316 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] command line args: [] {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 01 19:20:34.671379 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 01 19:20:34.671548 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ================================================================================ {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 01 19:20:34.671645 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 01 19:20:34.671726 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ================================================================================ {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 01 19:20:34.672329 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] admin_token = **** {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.672489 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] admin_token = **** {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.672575 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] config_dir = [] {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.672735 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] config_dir = [] {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.672814 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.672912 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] config_source = [] {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.672995 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.673077 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] config_source = [] {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.673148 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] debug = True {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.673357 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] debug = True {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.673515 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.673741 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.673835 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.673901 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.673959 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.674015 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.674082 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.674146 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.674292 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.674365 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.674475 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] list_limit = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.674547 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] list_limit = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.674651 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] log_config_append = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.674721 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] log_config_append = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.674822 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.674898 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.674963 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] log_dir = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.675026 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] log_dir = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.675143 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] log_file = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.675219 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] log_file = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.675369 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.675485 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.675615 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.675716 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.675859 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.675968 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.676085 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.676168 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.676286 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.676373 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.676452 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.676577 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.676659 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.676772 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.676879 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.676975 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.677109 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.677217 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.677367 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.677452 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.677578 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.677663 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.677807 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.677924 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.678052 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.678134 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.678289 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.678416 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.678541 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.678667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.679325 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.26/identity {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.679546 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.26/identity {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.679672 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] publish_errors = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.679786 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] publish_errors = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.679898 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.680020 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.680133 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.680245 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.680364 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.680476 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.680587 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.680705 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.680825 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.680937 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.681055 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] standard_threads = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.681167 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] standard_threads = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.681354 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.681473 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.681592 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.681705 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.681817 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.681937 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.682050 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] use_journal = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.682167 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] use_journal = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.682281 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] use_json = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.682399 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] use_json = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.682519 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] use_stderr = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.682645 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] use_stderr = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.682765 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] use_syslog = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.682884 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] use_syslog = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.682997 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.683114 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:20:34.683305 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.683435 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.683556 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.683669 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.683781 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.683892 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.684003 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.684122 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.684235 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.684346 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.684459 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.684570 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.684688 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.684809 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.684922 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.685036 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.685148 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.685274 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.685399 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.685525 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.685639 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.685756 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.685869 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.685980 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.686091 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.686210 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.686313 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.686428 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.686555 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.686669 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.686785 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.686975 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.687096 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.687209 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.687321 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.687463 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.688220 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.688354 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.688469 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.688587 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.688708 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.688821 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.688933 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.689053 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.689166 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.689292 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.689417 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.689532 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.689644 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.689766 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.689880 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.689992 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.690104 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.690215 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.690338 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.690452 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.690563 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.690680 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.690800 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.690919 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.691041 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.691153 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.691264 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.691376 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.691493 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.691606 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.691725 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.691839 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.691950 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.692061 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.692172 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.692283 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.692402 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.692514 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.692626 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.692737 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.692856 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.692969 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.693158 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.693294 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.693410 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.693521 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.693633 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.693754 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.693876 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.693991 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.694102 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.694214 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.694325 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.694442 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.694564 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.694683 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.694803 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.694917 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.695030 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.695151 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.695276 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.695389 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.695501 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.695618 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.695731 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.695842 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.695962 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.696075 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.696187 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.696298 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.696410 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.696554 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.696687 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.696791 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.696897 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.696993 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.697086 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.697179 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.697304 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.697405 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.697499 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.697624 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.697728 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.697836 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.697916 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.698041 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.698156 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.698277 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.698390 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.698514 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.698514 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.698737 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.698857 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.698978 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.699087 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.699199 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.699311 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.699423 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.699543 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.699656 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.699774 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.699899 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.700020 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.700143 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.700258 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.700369 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.700481 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.700592 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.700704 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.700824 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.700938 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.701049 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.701161 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.701326 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.701442 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.701567 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.701681 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.701793 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.701905 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.702017 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.702129 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.702249 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.702364 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.702476 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.702588 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.702701 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.702813 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.702933 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.703047 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.703159 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.703271 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.703390 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.703504 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.703624 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.703738 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.703856 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.703976 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.704098 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.704218 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.704435 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.704555 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.704668 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.704780 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.704893 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.704995 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.705114 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.705256 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.705389 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.705504 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.705617 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.705729 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.705842 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.705960 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.706082 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.706197 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.706309 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.706422 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.706535 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.706655 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.706777 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.706891 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.707004 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.707117 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.707236 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.707349 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.707471 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.707591 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.707749 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.707871 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.707985 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.708106 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.708220 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.708333 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] auth.external = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.708445 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] auth.external = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.708557 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.708676 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.708797 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.708938 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.709066 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.709181 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.709321 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] auth.password = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.709436 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] auth.password = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.709549 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] auth.token = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.709663 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] auth.token = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.709788 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.710030 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.710159 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.710275 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.710389 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.710503 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.710625 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.710741 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.710855 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.710968 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.711082 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.711196 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.711318 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.711433 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.711554 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] credential.caching = True {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.711669 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] credential.caching = True {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.711784 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.711784 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.712006 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.712121 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.712234 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.712354 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.712469 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.712583 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.712709 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.712815 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.712932 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.713047 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.713160 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.713286 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.713414 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.713530 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.713644 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.713757 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.713878 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.713993 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.714114 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.714229 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.714342 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.714455 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.714608 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.714732 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.714845 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.714959 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.715072 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.715185 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] federation.caching = True {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.715302 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.715415 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.715536 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] federation.caching = True {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.715650 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.715763 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.715884 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.715983 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.716081 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.716205 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.716321 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.716442 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.716556 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.716675 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.716790 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.716912 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.717027 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.717141 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.717322 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.717441 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.717555 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.717684 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.717801 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.717922 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.718038 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] identity.caching = True {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.718151 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.718264 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.718456 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] identity.caching = True {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.718572 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.718686 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.718799 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.718913 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.719034 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.719157 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.719272 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.719386 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.719499 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.719612 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.719737 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.719852 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.719965 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.720078 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.720192 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.720306 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.720427 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.720541 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.720654 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.720767 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.720880 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.720994 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.721115 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.721250 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.721368 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.721481 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.721605 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.721721 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.721843 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.721959 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.722072 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.722186 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.722300 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.722413 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.722535 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.722649 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.722762 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.722875 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.722989 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.723102 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.723224 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.723339 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.723463 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.723463 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.723679 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.723791 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.723913 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.724028 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.724140 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.724253 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.724374 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.724489 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.724610 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.724740 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.724938 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.725055 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.725172 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.725302 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.725430 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.725666 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.725784 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.725898 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.726012 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.726125 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.726294 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.726414 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.726527 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.726649 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.726765 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.726885 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.727008 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.727122 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.727236 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.727379 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.727497 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.727611 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.727732 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.727847 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.727960 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.728073 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.728186 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.728299 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.728454 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.728573 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.728687 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.728800 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.728913 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.729026 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.729026 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.729307 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.729424 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.729574 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.729721 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.729835 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.729961 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.730077 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.730190 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.user = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.730303 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.730415 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.730528 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.730650 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.730765 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.730877 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.730980 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.user = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.731074 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.731175 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.731289 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.731403 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.731516 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.731629 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.731749 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.731872 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.731987 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.732099 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.732212 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.732326 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.732438 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.732558 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.732673 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.732787 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.732899 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.733012 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.733125 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.733260 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.733377 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.733490 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.733603 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.733716 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.733829 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.733955 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.734070 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.734184 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.734824 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.734945 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.735059 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.735181 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.735305 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.735422 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.735542 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.735657 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.735770 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.735892 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.736008 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.736121 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.736234 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.736348 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.736461 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.736582 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.736697 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.736810 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.736924 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.737037 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.737150 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.737293 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.737411 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.737524 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.737638 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.737750 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.737865 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.737987 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.738102 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.738216 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.738329 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.738442 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.738555 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.738676 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.738798 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.738912 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.739026 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.739139 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.739252 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] resource.caching = True {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.739378 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.739493 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.739607 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.739720 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.739833 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.739945 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.740067 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] resource.caching = True {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.740183 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.740296 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.740410 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.740523 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.740635 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.740757 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.740872 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.740985 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.741208 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.741340 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.741443 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.741631 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.741750 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] role.caching = True {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.741863 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.741977 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] role.driver = sql {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.741977 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.742191 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.742191 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.742449 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.742563 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] role.caching = True {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.742677 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.742791 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] role.driver = sql {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.742904 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.743026 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.743156 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.743344 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.743462 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.743577 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.743699 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.743815 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.743928 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.744064 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.744180 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.744180 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.744401 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.744517 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.744630 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.744743 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.744856 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.744969 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.745091 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.745213 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.745388 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.745388 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.745600 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.745714 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.745839 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.745956 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.746069 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.746182 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.746296 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.746296 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.746517 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.746632 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.746745 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.746858 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.746971 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.747084 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.747206 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.747320 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.747434 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.747547 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.747660 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.747773 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.747894 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.748009 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.748123 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.748236 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.748349 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.748463 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.748584 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.748699 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.748812 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.748925 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.749038 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.749159 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.749288 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.749404 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.749518 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.749631 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.749744 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.749888 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] token.caching = True {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.750629 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.750756 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.750871 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.750985 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.751098 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.751221 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.751337 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.751451 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.751565 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] token.caching = True {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.751679 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.751792 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.751914 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.752029 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.752143 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.752256 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.752369 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.752482 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.752604 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.752720 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.752834 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.752947 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.753060 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.753173 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.753346 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.753465 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.753579 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.753693 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.753806 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.753919 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.754040 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.754155 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.754275 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.754396 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.754511 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.754624 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.754746 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] database.connection = **** {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.754870 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.754996 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.755112 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.755224 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.755337 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.755455 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.755568 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.755690 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.755806 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] database.connection = **** {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.755927 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.756050 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.756164 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.756164 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.756377 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.756499 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.756614 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.756727 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.756841 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.756955 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.757068 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.757190 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.757321 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.757420 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.757521 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.757632 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.757746 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.757872 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.757989 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.758102 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.758215 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.758328 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.758440 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.758561 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.758677 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.758790 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.758905 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.759018 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 01 19:20:34.759132 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.759132 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.759132 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.759132 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.759132 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:20:34.759132 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 01 19:20:34.785635 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:20:34.785858 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:20:34.785956 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:20:34.786081 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:20:34.786171 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:20:34.786295 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:20:34.794478 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:20:34.794822 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:20:34.823723 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:20:34.823952 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:20:34.824215 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:20:34.824449 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:20:34.966767 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:20:34.966952 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:20:35.017077 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:20:35.017259 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:20:35.017407 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:20:35.017494 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:20:35.082827 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:20:35.082991 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:20:35.083134 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:20:35.083238 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:20:35.083320 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:20:35.083395 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:20:35.083469 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:20:35.083543 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:20:35.083650 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:20:35.083744 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:20:35.083863 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:20:35.083982 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:20:35.109172 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:20:35.109896 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:20:35.110015 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:20:35.110135 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:20:35.110219 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:20:35.110356 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:20:35.110439 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:20:35.110571 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:20:35.110655 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:20:35.110783 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:20:35.110865 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:20:35.110991 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:20:35.111073 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:20:35.111201 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:20:35.122212 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:20:35.122409 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:20:35.134937 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:20:35.135123 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:20:35.135232 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:20:35.135353 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:20:35.135437 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:20:35.135576 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:20:35.135658 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:20:35.135797 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:20:35.135880 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:20:35.136010 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:20:35.136092 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:20:35.136222 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:20:35.136302 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:20:35.136429 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:20:35.153732 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.153939 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 01 19:20:35.154023 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.154219 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 01 19:20:35.154316 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.154455 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 01 19:20:35.154536 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.154721 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.154803 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 01 19:20:35.154979 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.155062 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.155229 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.155310 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.155479 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.155560 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.155728 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.166884 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.167072 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.167168 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.167343 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.167430 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.167607 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.167695 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.167884 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.176080 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80247) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 19:20:35.176249 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80246) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 19:20:35.179657 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80247) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 19:20:35.179813 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80246) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 19:20:35.179931 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.180087 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.180208 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.180366 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.180485 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.180646 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.180760 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.180919 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.181011 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.181172 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.181280 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.181536 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.181642 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.181817 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.181920 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.182002 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.182171 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.182260 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.182337 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.182757 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.209959 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.210132 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.211563 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80246) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 19:20:35.211753 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80247) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 19:20:35.211857 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.212029 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.217149 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80246) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 19:20:35.217346 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80247) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 19:20:35.217434 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.217622 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.217777 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.218016 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.225098 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80246) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 19:20:35.225398 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.225485 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80247) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 19:20:35.225679 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.230016 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80246) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 19:20:35.230178 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80247) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 19:20:35.230265 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.230459 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.230557 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.230736 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.230820 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.231012 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.231096 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.231281 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.231374 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.231548 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.231630 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.231809 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.231892 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.232067 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.251578 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.251843 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.251936 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.252143 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.256824 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80247) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 19:20:35.257185 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80246) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 19:20:35.260486 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.260778 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.260863 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.261072 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.265997 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80247) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 19:20:35.266253 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80246) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 19:20:35.269620 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80247) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 19:20:35.269876 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80246) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 19:20:35.273304 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.273581 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.273668 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.273863 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.273946 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.274146 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.274230 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.274420 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.274503 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.274693 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.274775 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.274966 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.293846 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80247) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 19:20:35.294100 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80246) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 19:20:35.294187 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.294374 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.294471 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.294630 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.294711 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.294881 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.303118 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.303348 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.305078 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.305317 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.305424 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.305596 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.308643 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80247) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 19:20:35.308780 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80246) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 19:20:35.308919 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.309053 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.309199 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.309353 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.309502 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.309631 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.309777 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.309900 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.323174 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80247) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 19:20:35.323294 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80246) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 19:20:35.323460 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.323555 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.323744 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.323837 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.324024 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.324108 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.324306 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.324392 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.325888 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.326000 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.326186 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.326271 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.345218 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80247) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 19:20:35.345341 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80246) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 19:20:35.348512 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80247) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 19:20:35.348600 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80246) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 19:20:35.351880 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.351981 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.353645 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.353745 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.355262 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80246) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 19:20:35.355345 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80247) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 19:20:35.355536 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.355620 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.355814 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.355909 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.363178 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.363274 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.364770 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80246) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 19:20:35.364854 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80247) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 19:20:35.368012 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.368113 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.368297 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.368382 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.368685 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.368783 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.368960 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.369044 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.378139 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80246) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 19:20:35.378228 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80247) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 19:20:35.378420 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.378518 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.378695 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.378780 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.386581 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80246) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 19:20:35.386748 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80247) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 19:20:35.386852 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.386933 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.387118 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.387263 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.387388 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.387475 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.387653 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.387800 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.388022 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.388120 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.388298 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.388394 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.388567 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.388651 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.388846 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.388982 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.389110 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.389262 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.389406 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.389490 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.389664 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.389750 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.389951 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.390047 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.390184 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.390266 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:20:35.429491 dv-cinder-844601-7-smb devstack@keystone.service[80247]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564250c7a9c0 pid: 80247 (default app) Jul 01 19:20:35.429617 dv-cinder-844601-7-smb devstack@keystone.service[80246]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564250c7a9c0 pid: 80246 (default app) Jul 01 19:20:35.432887 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1230aae-e72d-46c5-b2e2-4bf0af384398 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:20:35.433180 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1230aae-e72d-46c5-b2e2-4bf0af384398 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:20:35.433481 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1230aae-e72d-46c5-b2e2-4bf0af384398 None None] PATH_INFO: `/v3` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:20:35.437715 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1/1] 10.222.0.26 () {50 vars in 791 bytes} [Fri Jul 1 19:20:35 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:20:43.028741 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555dbf37-a082-48c8-8da1-27e8ca2e853b None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:20:43.029293 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555dbf37-a082-48c8-8da1-27e8ca2e853b None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:20:43.029293 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555dbf37-a082-48c8-8da1-27e8ca2e853b None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:20:43.033595 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1/2] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:20:43 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 19:20:43.038937 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eafd548-2acb-47c6-bab6-d0601c6005a7 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:20:43.039354 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eafd548-2acb-47c6-bab6-d0601c6005a7 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:20:43.039566 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eafd548-2acb-47c6-bab6-d0601c6005a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:20:43.108962 dv-cinder-844601-7-smb devstack@keystone.service[80247]: INFO dbcounter [None req-1eafd548-2acb-47c6-bab6-d0601c6005a7 None None] Registered counter for database keystone Jul 01 19:20:43.131676 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG oslo_db.sqlalchemy.engines [None req-1eafd548-2acb-47c6-bab6-d0601c6005a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80247) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 19:20:43.137865 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writer thread running {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 19:20:43.318337 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG passlib.handlers.bcrypt [None req-1eafd548-2acb-47c6-bab6-d0601c6005a7 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80247) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 01 19:20:43.318675 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG passlib.handlers.bcrypt [None req-1eafd548-2acb-47c6-bab6-d0601c6005a7 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80247) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 01 19:20:43.372161 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-1eafd548-2acb-47c6-bab6-d0601c6005a7 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:20:43.373816 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-1eafd548-2acb-47c6-bab6-d0601c6005a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:20:43.495485 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 2/3] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:20:43 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 457 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 01 19:20:43.707512 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555dbf37-a082-48c8-8da1-27e8ca2e853b None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:20:43.776969 dv-cinder-844601-7-smb devstack@keystone.service[80246]: INFO dbcounter [None req-555dbf37-a082-48c8-8da1-27e8ca2e853b None None] Registered counter for database keystone Jul 01 19:20:43.796491 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG oslo_db.sqlalchemy.engines [None req-555dbf37-a082-48c8-8da1-27e8ca2e853b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80246) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 19:20:43.803348 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writer thread running {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 19:20:43.922549 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555dbf37-a082-48c8-8da1-27e8ca2e853b None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:20:43.926683 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab08a55-9f01-4dee-b1af-c9fa7f4cd8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:20:43.927338 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab08a55-9f01-4dee-b1af-c9fa7f4cd8aa admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:20:43.927624 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab08a55-9f01-4dee-b1af-c9fa7f4cd8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:20:43.927899 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab08a55-9f01-4dee-b1af-c9fa7f4cd8aa admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:20:43.936220 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab08a55-9f01-4dee-b1af-c9fa7f4cd8aa admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:20:43.988107 dv-cinder-844601-7-smb devstack@keystone.service[80246]: WARNING keystone.common.rbac_enforcer.enforcer [None req-eab08a55-9f01-4dee-b1af-c9fa7f4cd8aa admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 01 19:20:43.988445 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab08a55-9f01-4dee-b1af-c9fa7f4cd8aa admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:20:43.998154 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 2/4] 10.222.0.26 () {58 vars in 1324 bytes} [Fri Jul 1 19:20:43 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 01 19:20:44.004716 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eafd548-2acb-47c6-bab6-d0601c6005a7 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:20:44.019180 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eafd548-2acb-47c6-bab6-d0601c6005a7 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:20:44.023891 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9217dde-8bee-4ed3-88ca-7f87c45b67b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:20:44.025060 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9217dde-8bee-4ed3-88ca-7f87c45b67b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:20:44.025378 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9217dde-8bee-4ed3-88ca-7f87c45b67b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:20:44.025659 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9217dde-8bee-4ed3-88ca-7f87c45b67b5 admin admin] PATH_INFO: `/v3/projects/82f5068f09304c36812a397a31aad7a3` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:20:44.029912 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9217dde-8bee-4ed3-88ca-7f87c45b67b5 admin admin] RBAC: Authorizing `identity:get_project(project_id=82f5068f09304c36812a397a31aad7a3)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:20:44.082704 dv-cinder-844601-7-smb devstack@keystone.service[80247]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f9217dde-8bee-4ed3-88ca-7f87c45b67b5 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 01 19:20:44.083278 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9217dde-8bee-4ed3-88ca-7f87c45b67b5 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:20:44.087892 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 3/5] 10.222.0.26 () {56 vars in 1207 bytes} [Fri Jul 1 19:20:44 2022] GET /identity/v3/projects/82f5068f09304c36812a397a31aad7a3 => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:20:46.077203 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8cf7f6-1c78-4deb-ac79-4001008f0030 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:20:46.077746 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8cf7f6-1c78-4deb-ac79-4001008f0030 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:20:46.077843 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8cf7f6-1c78-4deb-ac79-4001008f0030 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:20:46.081907 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 3/6] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:20:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:20:46.087152 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014040c-229a-4ffe-ad20-1a85c4fbd4a9 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:20:46.087543 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014040c-229a-4ffe-ad20-1a85c4fbd4a9 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:20:46.087748 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014040c-229a-4ffe-ad20-1a85c4fbd4a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:20:46.107599 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-b014040c-229a-4ffe-ad20-1a85c4fbd4a9 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:20:46.109138 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-b014040c-229a-4ffe-ad20-1a85c4fbd4a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:20:46.117634 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 4/7] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:20:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 01 19:20:46.139699 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8cf7f6-1c78-4deb-ac79-4001008f0030 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:20:46.152052 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8cf7f6-1c78-4deb-ac79-4001008f0030 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:20:46.156816 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad993785-eeda-498a-bdc0-74748d1ac0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:20:46.157476 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad993785-eeda-498a-bdc0-74748d1ac0f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:20:46.157763 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad993785-eeda-498a-bdc0-74748d1ac0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:20:46.158039 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad993785-eeda-498a-bdc0-74748d1ac0f8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:20:46.165584 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad993785-eeda-498a-bdc0-74748d1ac0f8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:20:46.167354 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad993785-eeda-498a-bdc0-74748d1ac0f8 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:20:46.175883 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 4/8] 10.222.0.26 () {58 vars in 1324 bytes} [Fri Jul 1 19:20:46 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 01 19:20:46.181438 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b014040c-229a-4ffe-ad20-1a85c4fbd4a9 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:20:46.190399 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b014040c-229a-4ffe-ad20-1a85c4fbd4a9 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:20:46.194798 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9cf27f-a7f4-4c23-b1db-60ab222bb43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:20:46.195647 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9cf27f-a7f4-4c23-b1db-60ab222bb43b admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:20:46.195934 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9cf27f-a7f4-4c23-b1db-60ab222bb43b admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:20:46.196212 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9cf27f-a7f4-4c23-b1db-60ab222bb43b admin admin] PATH_INFO: `/v3/users/ce82020368de483a9fa05847543c000f` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:20:46.197655 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9cf27f-a7f4-4c23-b1db-60ab222bb43b admin admin] RBAC: Authorizing `identity:get_user(user_id=ce82020368de483a9fa05847543c000f)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:20:46.199469 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9cf27f-a7f4-4c23-b1db-60ab222bb43b admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:20:46.201031 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 5/9] 10.222.0.26 () {56 vars in 1198 bytes} [Fri Jul 1 19:20:46 2022] GET /identity/v3/users/ce82020368de483a9fa05847543c000f => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:20:48.290443 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef754d7-2a5d-49e9-acdb-c0a616d3cbf5 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:20:48.290999 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef754d7-2a5d-49e9-acdb-c0a616d3cbf5 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:20:48.291195 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef754d7-2a5d-49e9-acdb-c0a616d3cbf5 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:20:48.293223 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 5/10] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:20:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:20:48.299939 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1128a-6d5f-4183-84af-f0307e39b1c2 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:20:48.301037 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1128a-6d5f-4183-84af-f0307e39b1c2 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:20:48.301037 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1128a-6d5f-4183-84af-f0307e39b1c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:20:48.318684 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-87e1128a-6d5f-4183-84af-f0307e39b1c2 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:20:48.319870 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-87e1128a-6d5f-4183-84af-f0307e39b1c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:20:48.325451 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e957a7d-cd9c-4c19-9150-ed34e39070ac None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:20:48.325744 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e957a7d-cd9c-4c19-9150-ed34e39070ac None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:20:48.326018 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e957a7d-cd9c-4c19-9150-ed34e39070ac None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:20:48.327903 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 6/11] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:20:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 19:20:48.334194 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfda744-e61b-4169-aa5c-fec722e54c48 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:20:48.334597 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfda744-e61b-4169-aa5c-fec722e54c48 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:20:48.335148 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfda744-e61b-4169-aa5c-fec722e54c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:20:48.376245 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG passlib.handlers.bcrypt [None req-3cfda744-e61b-4169-aa5c-fec722e54c48 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80246) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 01 19:20:48.376671 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG passlib.handlers.bcrypt [None req-3cfda744-e61b-4169-aa5c-fec722e54c48 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80246) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 01 19:20:48.404821 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 6/12] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:20:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:20:48.422586 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-3cfda744-e61b-4169-aa5c-fec722e54c48 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:20:48.424184 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-3cfda744-e61b-4169-aa5c-fec722e54c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:20:48.434505 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e1128a-6d5f-4183-84af-f0307e39b1c2 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:20:48.460738 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:20:48.543785 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 7/13] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:20:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 19:20:48.556173 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e1128a-6d5f-4183-84af-f0307e39b1c2 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:20:48.576578 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfda744-e61b-4169-aa5c-fec722e54c48 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:20:48.599600 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f839b54-0011-4c99-8418-4b782fa1cd6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:20:48.600674 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f839b54-0011-4c99-8418-4b782fa1cd6f None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:20:48.601152 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f839b54-0011-4c99-8418-4b782fa1cd6f None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:20:48.601604 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f839b54-0011-4c99-8418-4b782fa1cd6f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:20:48.615764 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f839b54-0011-4c99-8418-4b782fa1cd6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:20:48.629741 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-8f839b54-0011-4c99-8418-4b782fa1cd6f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:20:48.629741 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:20:48.629741 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:20:48.629741 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:20:48.629741 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:20:48.629741 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:20:48.629741 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:20:48.629741 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:20:48.629741 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:20:48.629741 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:20:48.629741 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:20:48.629741 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:20:48.629741 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:20:48.629741 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:20:48.629741 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:20:48.629741 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:20:48.630848 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:20:48.630848 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:20:48.630848 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:20:48.630848 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:20:48.630848 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:20:48.630848 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:20:48.630848 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:20:48.630848 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:20:48.630848 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:20:48.630848 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:20:48.630848 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:20:48.630848 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:20:48.630848 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:20:48.630848 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:20:48.630848 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:20:48.630848 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:20:48.631667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:20:48.631667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:20:48.631667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:20:48.631667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:20:48.631667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:20:48.631667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:20:48.631667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:20:48.631667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:20:48.631667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:20:48.631667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:20:48.631667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:20:48.631667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:20:48.632579 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 7/14] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Jul 1 19:20:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:20:48.639491 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f839b54-0011-4c99-8418-4b782fa1cd6f None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:20:48.697115 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfda744-e61b-4169-aa5c-fec722e54c48 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:20:48.699848 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:20:48.736670 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:20:48.746963 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2370395-9019-4333-808e-cb506c78481d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:20:48.747899 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2370395-9019-4333-808e-cb506c78481d None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:20:48.748186 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2370395-9019-4333-808e-cb506c78481d None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:20:48.748461 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2370395-9019-4333-808e-cb506c78481d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:20:48.758004 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f839b54-0011-4c99-8418-4b782fa1cd6f None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:20:48.793004 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4420952e-5ba1-4da6-b795-979be743a07e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:20:48.793713 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4420952e-5ba1-4da6-b795-979be743a07e None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:20:48.794053 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4420952e-5ba1-4da6-b795-979be743a07e None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:20:48.794273 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4420952e-5ba1-4da6-b795-979be743a07e None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:20:48.795025 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4420952e-5ba1-4da6-b795-979be743a07e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:20:48.795332 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4420952e-5ba1-4da6-b795-979be743a07e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:20:48.796767 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4420952e-5ba1-4da6-b795-979be743a07e None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:20:48.809328 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 8/15] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Jul 1 19:20:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:20:48.815612 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4420952e-5ba1-4da6-b795-979be743a07e None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:20:48.820528 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2370395-9019-4333-808e-cb506c78481d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:20:48.822240 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2370395-9019-4333-808e-cb506c78481d None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:20:48.915430 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4420952e-5ba1-4da6-b795-979be743a07e None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:20:48.922968 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 8/16] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Jul 1 19:20:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 01 19:20:48.928567 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2370395-9019-4333-808e-cb506c78481d None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:20:48.932271 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:20:48.951047 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e3333c-3156-471e-84e1-7817e527c376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:20:48.951918 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e3333c-3156-471e-84e1-7817e527c376 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:20:48.952204 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e3333c-3156-471e-84e1-7817e527c376 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:20:48.952481 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e3333c-3156-471e-84e1-7817e527c376 None admin] PATH_INFO: `/v3/users/ce82020368de483a9fa05847543c000f` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:20:48.954330 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e3333c-3156-471e-84e1-7817e527c376 None admin] RBAC: Authorizing `identity:get_user(user_id=ce82020368de483a9fa05847543c000f)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:20:48.955856 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e3333c-3156-471e-84e1-7817e527c376 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:20:48.957464 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 9/17] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Jul 1 19:20:48 2022] GET /identity/v3/users/ce82020368de483a9fa05847543c000f => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:20:48.963098 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e3333c-3156-471e-84e1-7817e527c376 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:20:48.977391 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:20:49.031091 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2370395-9019-4333-808e-cb506c78481d None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:20:49.063709 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e3333c-3156-471e-84e1-7817e527c376 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:20:49.065851 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a03cd3-dd6f-486e-9124-1464b0ce12c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:20:49.066674 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a03cd3-dd6f-486e-9124-1464b0ce12c2 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:20:49.066965 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a03cd3-dd6f-486e-9124-1464b0ce12c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:20:49.067246 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a03cd3-dd6f-486e-9124-1464b0ce12c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:20:49.086392 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a03cd3-dd6f-486e-9124-1464b0ce12c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:20:49.087887 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a03cd3-dd6f-486e-9124-1464b0ce12c2 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:20:49.098712 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68938320-5730-4216-9322-942f6e1f98c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:20:49.099507 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68938320-5730-4216-9322-942f6e1f98c2 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:20:49.099793 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68938320-5730-4216-9322-942f6e1f98c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:20:49.100070 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68938320-5730-4216-9322-942f6e1f98c2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:20:49.101271 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68938320-5730-4216-9322-942f6e1f98c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:20:49.102718 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68938320-5730-4216-9322-942f6e1f98c2 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:20:49.104327 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 10/18] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:20:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:20:49.110609 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68938320-5730-4216-9322-942f6e1f98c2 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:20:49.111129 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-61a03cd3-dd6f-486e-9124-1464b0ce12c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:20:49.111129 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:20:49.111129 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:20:49.111129 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:20:49.111129 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:20:49.111129 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:20:49.111129 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:20:49.111129 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:20:49.111129 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:20:49.111129 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:20:49.111129 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:20:49.111129 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:20:49.111129 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:20:49.111129 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:20:49.111129 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:20:49.112001 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:20:49.112001 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:20:49.112001 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:20:49.112001 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:20:49.112001 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:20:49.112001 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:20:49.112001 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:20:49.112001 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:20:49.112001 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:20:49.112001 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:20:49.112001 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:20:49.112001 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:20:49.112001 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:20:49.112001 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:20:49.112001 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:20:49.112001 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:20:49.112001 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:20:49.112802 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:20:49.112802 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:20:49.112802 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:20:49.112802 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:20:49.112802 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 9/19] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:20:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:20:49.118036 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a03cd3-dd6f-486e-9124-1464b0ce12c2 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:20:49.175647 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:20:49.194008 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:20:49.213751 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68938320-5730-4216-9322-942f6e1f98c2 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:20:49.220868 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a03cd3-dd6f-486e-9124-1464b0ce12c2 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:20:49.251829 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2b948c-6070-424c-8c52-cc17f4f6c8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:20:49.252491 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b948c-6070-424c-8c52-cc17f4f6c8ba None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:20:49.252776 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b948c-6070-424c-8c52-cc17f4f6c8ba None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:20:49.253054 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b948c-6070-424c-8c52-cc17f4f6c8ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:20:49.253919 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2b948c-6070-424c-8c52-cc17f4f6c8ba None admin] RBAC: Adding query filter params (role.id=6cb03785fb184ef587509b3174622f69, scope.domain.id=default, user.id=ce82020368de483a9fa05847543c000f) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:20:49.254234 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2b948c-6070-424c-8c52-cc17f4f6c8ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:20:49.255345 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd0aa9d-c1e5-4680-bc72-99fe89b970dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:20:49.255681 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2b948c-6070-424c-8c52-cc17f4f6c8ba None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:20:49.256002 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd0aa9d-c1e5-4680-bc72-99fe89b970dd None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:20:49.256290 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd0aa9d-c1e5-4680-bc72-99fe89b970dd None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:20:49.256571 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd0aa9d-c1e5-4680-bc72-99fe89b970dd None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:20:49.257319 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd0aa9d-c1e5-4680-bc72-99fe89b970dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:20:49.257801 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd0aa9d-c1e5-4680-bc72-99fe89b970dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:20:49.259184 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd0aa9d-c1e5-4680-bc72-99fe89b970dd None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:20:49.262402 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 11/20] 10.222.0.26 () {56 vars in 1322 bytes} [Fri Jul 1 19:20:49 2022] GET /identity/v3/role_assignments?user.id=ce82020368de483a9fa05847543c000f&scope.domain.id=default&role.id=6cb03785fb184ef587509b3174622f69 => generated 233 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:20:49.278559 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 10/21] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Jul 1 19:20:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:20:51.700092 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f5fcb0-1e80-419f-b6fc-372b3ba039ce None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:20:51.701037 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f5fcb0-1e80-419f-b6fc-372b3ba039ce None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:20:51.701557 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f5fcb0-1e80-419f-b6fc-372b3ba039ce None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:20:51.703407 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 12/22] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:20:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:20:51.708589 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4decae24-5de0-46a3-890a-c418894c9de0 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:20:51.709423 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4decae24-5de0-46a3-890a-c418894c9de0 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:20:51.709938 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4decae24-5de0-46a3-890a-c418894c9de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:20:51.734729 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-4decae24-5de0-46a3-890a-c418894c9de0 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:20:51.736213 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-4decae24-5de0-46a3-890a-c418894c9de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:20:51.822812 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 11/23] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:20:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 19:20:51.857573 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f5fcb0-1e80-419f-b6fc-372b3ba039ce None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:20:51.989825 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f5fcb0-1e80-419f-b6fc-372b3ba039ce None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:20:52.043946 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ea2e2-9e7e-4f15-a04a-99bd67816aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:20:52.045111 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ea2e2-9e7e-4f15-a04a-99bd67816aec None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:20:52.045625 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ea2e2-9e7e-4f15-a04a-99bd67816aec None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:20:52.046104 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ea2e2-9e7e-4f15-a04a-99bd67816aec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:20:52.064592 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150ea2e2-9e7e-4f15-a04a-99bd67816aec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:20:52.072667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-150ea2e2-9e7e-4f15-a04a-99bd67816aec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:20:52.072667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:20:52.072667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:20:52.072667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:20:52.072667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:20:52.072667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:20:52.072667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:20:52.072667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:20:52.072667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:20:52.072667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:20:52.072667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:20:52.072667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:20:52.072667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:20:52.072667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:20:52.072667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:20:52.072667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:20:52.073558 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:20:52.073558 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:20:52.073558 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:20:52.073558 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:20:52.073558 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:20:52.073558 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:20:52.073558 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:20:52.073558 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:20:52.073558 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:20:52.073558 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:20:52.073558 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:20:52.073558 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:20:52.073558 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:20:52.073558 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:20:52.073558 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:20:52.073558 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:20:52.074332 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:20:52.074332 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:20:52.074332 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:20:52.074332 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:20:52.074332 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:20:52.074332 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:20:52.074332 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:20:52.074332 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:20:52.074332 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:20:52.074332 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:20:52.074332 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:20:52.074332 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:20:52.076728 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 13/24] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Jul 1 19:20:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:20:52.083486 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4decae24-5de0-46a3-890a-c418894c9de0 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:20:52.144629 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:20:52.213601 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4decae24-5de0-46a3-890a-c418894c9de0 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:20:52.232851 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810c730-4657-4aac-a8fd-274e63494067 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:20:52.233151 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810c730-4657-4aac-a8fd-274e63494067 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:20:52.233462 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810c730-4657-4aac-a8fd-274e63494067 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:20:52.236140 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 14/25] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:20:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:20:52.250769 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300d8ce-020f-415c-8e33-a7f5f8393cb9 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:20:52.250949 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300d8ce-020f-415c-8e33-a7f5f8393cb9 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:20:52.251229 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300d8ce-020f-415c-8e33-a7f5f8393cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:20:52.261050 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:20:52.280720 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-4300d8ce-020f-415c-8e33-a7f5f8393cb9 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:20:52.282352 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-4300d8ce-020f-415c-8e33-a7f5f8393cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:20:52.301528 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f13da5-8cd8-4ea2-8af0-bf1fa40124f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:20:52.302219 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f13da5-8cd8-4ea2-8af0-bf1fa40124f7 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:20:52.302507 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f13da5-8cd8-4ea2-8af0-bf1fa40124f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:20:52.302786 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f13da5-8cd8-4ea2-8af0-bf1fa40124f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:20:52.303554 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f13da5-8cd8-4ea2-8af0-bf1fa40124f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:20:52.304122 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f13da5-8cd8-4ea2-8af0-bf1fa40124f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:20:52.305560 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f13da5-8cd8-4ea2-8af0-bf1fa40124f7 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:20:52.325187 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 12/26] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Jul 1 19:20:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:20:52.326336 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14310d5d-11de-4e4f-bf86-a08780d4eaee None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:20:52.326636 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14310d5d-11de-4e4f-bf86-a08780d4eaee None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:20:52.326920 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14310d5d-11de-4e4f-bf86-a08780d4eaee None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:20:52.328569 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 13/27] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:20:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:20:52.333383 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14310d5d-11de-4e4f-bf86-a08780d4eaee None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:20:52.454360 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 15/28] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:20:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 01 19:20:52.465265 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa282f90-6114-4b43-9c10-bd2c6fc40514 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:20:52.465265 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa282f90-6114-4b43-9c10-bd2c6fc40514 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:20:52.465265 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa282f90-6114-4b43-9c10-bd2c6fc40514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:20:52.465707 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14310d5d-11de-4e4f-bf86-a08780d4eaee None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:20:52.478169 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:20:52.491950 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-aa282f90-6114-4b43-9c10-bd2c6fc40514 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:20:52.493178 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-aa282f90-6114-4b43-9c10-bd2c6fc40514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:20:52.506464 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785c5d64-afc7-4055-bdd4-04b159553c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:20:52.507571 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c5d64-afc7-4055-bdd4-04b159553c6b None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:20:52.507999 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c5d64-afc7-4055-bdd4-04b159553c6b None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:20:52.508514 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c5d64-afc7-4055-bdd4-04b159553c6b None admin] PATH_INFO: `/v3/users/ce82020368de483a9fa05847543c000f` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:20:52.510651 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785c5d64-afc7-4055-bdd4-04b159553c6b None admin] RBAC: Authorizing `identity:get_user(user_id=ce82020368de483a9fa05847543c000f)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:20:52.512389 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785c5d64-afc7-4055-bdd4-04b159553c6b None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:20:52.514684 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 14/29] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Jul 1 19:20:52 2022] GET /identity/v3/users/ce82020368de483a9fa05847543c000f => generated 247 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:20:52.516273 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b011d4f-7f5c-4d66-b03a-b10b67b8c180 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:20:52.516826 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b011d4f-7f5c-4d66-b03a-b10b67b8c180 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:20:52.517309 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b011d4f-7f5c-4d66-b03a-b10b67b8c180 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:20:52.519070 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 15/30] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:20:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:20:52.520161 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b011d4f-7f5c-4d66-b03a-b10b67b8c180 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:20:52.582616 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 16/31] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:20:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:20:52.583861 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa282f90-6114-4b43-9c10-bd2c6fc40514 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:20:52.637056 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b011d4f-7f5c-4d66-b03a-b10b67b8c180 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:20:52.671261 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:20:52.679748 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f5f19e-c2dd-4063-9b2e-1165a4593fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:20:52.681287 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f5f19e-c2dd-4063-9b2e-1165a4593fff None admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:20:52.682676 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f5f19e-c2dd-4063-9b2e-1165a4593fff None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:20:52.683136 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f5f19e-c2dd-4063-9b2e-1165a4593fff None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:20:52.684059 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f5f19e-c2dd-4063-9b2e-1165a4593fff None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:20:52.685624 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f5f19e-c2dd-4063-9b2e-1165a4593fff None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:20:52.717429 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa282f90-6114-4b43-9c10-bd2c6fc40514 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:20:52.757185 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f4bec7-3ee3-40f9-b044-6136f1b19546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:20:52.757944 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f4bec7-3ee3-40f9-b044-6136f1b19546 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:20:52.758235 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f4bec7-3ee3-40f9-b044-6136f1b19546 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:20:52.758516 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f4bec7-3ee3-40f9-b044-6136f1b19546 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:20:52.759815 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f4bec7-3ee3-40f9-b044-6136f1b19546 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:20:52.761361 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f4bec7-3ee3-40f9-b044-6136f1b19546 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:20:52.767945 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 17/32] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:20:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:20:52.767945 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7bb8b3-7e69-432b-a7d0-9a8641e110fe None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:20:52.767945 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7bb8b3-7e69-432b-a7d0-9a8641e110fe None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:20:52.767945 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7bb8b3-7e69-432b-a7d0-9a8641e110fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:20:52.786025 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-2c7bb8b3-7e69-432b-a7d0-9a8641e110fe None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:20:52.787534 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-2c7bb8b3-7e69-432b-a7d0-9a8641e110fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:20:52.853259 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 16/33] 10.222.0.26 () {60 vars in 1131 bytes} [Fri Jul 1 19:20:52 2022] POST /identity/v3/roles => generated 219 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:20:52.855241 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f5f19e-c2dd-4063-9b2e-1165a4593fff None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:20:52.863051 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 18/34] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:20:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:20:52.869441 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7bb8b3-7e69-432b-a7d0-9a8641e110fe None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:20:52.917155 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:20:52.954880 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:20:52.992027 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f5f19e-c2dd-4063-9b2e-1165a4593fff None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:20:53.001041 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7bb8b3-7e69-432b-a7d0-9a8641e110fe None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:20:53.029862 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107aa67b-6cb5-485f-acef-667b6ca85ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:20:53.030532 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107aa67b-6cb5-485f-acef-667b6ca85ae2 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:20:53.030831 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107aa67b-6cb5-485f-acef-667b6ca85ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:20:53.031696 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107aa67b-6cb5-485f-acef-667b6ca85ae2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:20:53.041915 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b6e768-d565-4479-8c57-f479e9dbe89b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:20:53.042634 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107aa67b-6cb5-485f-acef-667b6ca85ae2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:20:53.043448 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b6e768-d565-4479-8c57-f479e9dbe89b None admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:20:53.043935 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b6e768-d565-4479-8c57-f479e9dbe89b None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:20:53.044393 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107aa67b-6cb5-485f-acef-667b6ca85ae2 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:20:53.044632 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b6e768-d565-4479-8c57-f479e9dbe89b None admin] PATH_INFO: `/v3/domains/default/users/ce82020368de483a9fa05847543c000f/roles/6cb03785fb184ef587509b3174622f69` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:20:53.047231 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b6e768-d565-4479-8c57-f479e9dbe89b None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=ce82020368de483a9fa05847543c000f, role_id=6cb03785fb184ef587509b3174622f69)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:20:53.048964 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b6e768-d565-4479-8c57-f479e9dbe89b None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:20:53.066646 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-107aa67b-6cb5-485f-acef-667b6ca85ae2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:20:53.066646 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:20:53.066646 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:20:53.066646 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:20:53.066646 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:20:53.066646 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:20:53.066646 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:20:53.066646 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:20:53.066646 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:20:53.066646 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:20:53.066646 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:20:53.066646 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:20:53.066646 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:20:53.066646 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:20:53.066646 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:20:53.067620 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:20:53.067620 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:20:53.067620 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:20:53.067620 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:20:53.067620 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:20:53.067620 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:20:53.067620 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:20:53.067620 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:20:53.067620 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:20:53.067620 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:20:53.067620 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:20:53.067620 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:20:53.067620 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:20:53.067620 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:20:53.067620 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:20:53.067620 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:20:53.067620 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:20:53.068496 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:20:53.068496 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:20:53.068496 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:20:53.068496 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:20:53.068496 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 17/35] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:20:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:20:53.069306 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107aa67b-6cb5-485f-acef-667b6ca85ae2 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:20:53.214487 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:20:53.231405 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 19/36] 10.222.0.26 () {58 vars in 1361 bytes} [Fri Jul 1 19:20:52 2022] PUT /identity/v3/domains/default/users/ce82020368de483a9fa05847543c000f/roles/6cb03785fb184ef587509b3174622f69 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:20:53.233326 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b6e768-d565-4479-8c57-f479e9dbe89b None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:20:53.234371 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107aa67b-6cb5-485f-acef-667b6ca85ae2 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:20:53.311624 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea669cc2-97d2-4740-be14-ea98c3413123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:20:53.313885 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea669cc2-97d2-4740-be14-ea98c3413123 None admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:20:53.314474 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea669cc2-97d2-4740-be14-ea98c3413123 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:20:53.315290 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea669cc2-97d2-4740-be14-ea98c3413123 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:20:53.316626 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea669cc2-97d2-4740-be14-ea98c3413123 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:20:53.318536 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea669cc2-97d2-4740-be14-ea98c3413123 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:20:53.345580 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 18/37] 10.222.0.26 () {60 vars in 1131 bytes} [Fri Jul 1 19:20:53 2022] POST /identity/v3/roles => generated 225 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:20:53.348037 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac462a32-8d02-4da0-a07c-5f13485822b5 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:20:53.348343 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac462a32-8d02-4da0-a07c-5f13485822b5 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:20:53.348635 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac462a32-8d02-4da0-a07c-5f13485822b5 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:20:53.350282 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 19/38] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:20:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:20:53.357684 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d193d6-6027-4227-be1c-b48374ee2af4 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:20:53.358141 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d193d6-6027-4227-be1c-b48374ee2af4 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:20:53.358554 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d193d6-6027-4227-be1c-b48374ee2af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:20:53.387525 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-45d193d6-6027-4227-be1c-b48374ee2af4 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:20:53.391011 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-45d193d6-6027-4227-be1c-b48374ee2af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:20:53.450038 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b6e768-d565-4479-8c57-f479e9dbe89b None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:20:53.492908 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:20:53.510400 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 20/39] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:20:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:20:53.519604 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2822f0e-8023-4ec6-ac6b-52f25f3cb340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:20:53.520290 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2822f0e-8023-4ec6-ac6b-52f25f3cb340 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:20:53.520576 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2822f0e-8023-4ec6-ac6b-52f25f3cb340 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:20:53.520925 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2822f0e-8023-4ec6-ac6b-52f25f3cb340 None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:20:53.521690 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2822f0e-8023-4ec6-ac6b-52f25f3cb340 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:20:53.522001 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2822f0e-8023-4ec6-ac6b-52f25f3cb340 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:20:53.523844 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2822f0e-8023-4ec6-ac6b-52f25f3cb340 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:20:53.538786 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d193d6-6027-4227-be1c-b48374ee2af4 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:20:53.551889 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 20/40] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Jul 1 19:20:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:20:53.558417 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2822f0e-8023-4ec6-ac6b-52f25f3cb340 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:20:53.647296 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:20:53.677561 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d193d6-6027-4227-be1c-b48374ee2af4 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:20:53.692072 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2822f0e-8023-4ec6-ac6b-52f25f3cb340 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:20:53.716791 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20fa760-5a20-40ed-8f3d-ae9ccfb42d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:20:53.717677 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20fa760-5a20-40ed-8f3d-ae9ccfb42d8c None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:20:53.717970 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20fa760-5a20-40ed-8f3d-ae9ccfb42d8c None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:20:53.718252 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20fa760-5a20-40ed-8f3d-ae9ccfb42d8c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:20:53.720233 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20fa760-5a20-40ed-8f3d-ae9ccfb42d8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:20:53.721805 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20fa760-5a20-40ed-8f3d-ae9ccfb42d8c None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:20:53.723639 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 21/41] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:20:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:20:53.729729 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20fa760-5a20-40ed-8f3d-ae9ccfb42d8c None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:20:53.735248 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2400addd-fd89-4e2b-8a1a-0d27f3669801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:20:53.735923 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2400addd-fd89-4e2b-8a1a-0d27f3669801 None admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:20:53.736245 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2400addd-fd89-4e2b-8a1a-0d27f3669801 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:20:53.736533 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2400addd-fd89-4e2b-8a1a-0d27f3669801 None admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:20:53.737286 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2400addd-fd89-4e2b-8a1a-0d27f3669801 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:20:53.739210 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2400addd-fd89-4e2b-8a1a-0d27f3669801 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:20:53.853612 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20fa760-5a20-40ed-8f3d-ae9ccfb42d8c None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:20:53.899833 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6361fa2-527d-4ae2-8c04-22c61764f09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:20:53.900477 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6361fa2-527d-4ae2-8c04-22c61764f09c None admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:20:53.900767 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6361fa2-527d-4ae2-8c04-22c61764f09c None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:20:53.901075 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 21/42] 10.222.0.26 () {60 vars in 1141 bytes} [Fri Jul 1 19:20:53 2022] POST /identity/v3/projects => generated 301 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:20:53.905499 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6361fa2-527d-4ae2-8c04-22c61764f09c None admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:20:53.907049 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6361fa2-527d-4ae2-8c04-22c61764f09c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:20:53.908593 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6361fa2-527d-4ae2-8c04-22c61764f09c None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:20:53.939698 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:20:53.942773 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 22/43] 10.222.0.26 () {60 vars in 1141 bytes} [Fri Jul 1 19:20:53 2022] POST /identity/v3/projects => generated 312 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 19:20:53.975247 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe825c15-f667-45d3-9254-68746a26d991 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:20:53.975666 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe825c15-f667-45d3-9254-68746a26d991 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:20:53.975960 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe825c15-f667-45d3-9254-68746a26d991 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:20:53.977485 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 22/44] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:20:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:20:53.983644 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd74b82-2381-49ac-884e-62418a62d85a None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:20:53.983951 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd74b82-2381-49ac-884e-62418a62d85a None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:20:53.984287 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd74b82-2381-49ac-884e-62418a62d85a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:20:54.004067 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-cdd74b82-2381-49ac-884e-62418a62d85a None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:20:54.005384 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-cdd74b82-2381-49ac-884e-62418a62d85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:20:54.092495 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 23/45] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:20:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:20:54.115480 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe825c15-f667-45d3-9254-68746a26d991 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:20:54.157915 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:20:54.231800 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe825c15-f667-45d3-9254-68746a26d991 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:20:54.268883 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e7162-c2d0-4ad6-bf0d-397f02ca799c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:20:54.269690 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e7162-c2d0-4ad6-bf0d-397f02ca799c None admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:20:54.269980 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e7162-c2d0-4ad6-bf0d-397f02ca799c None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:20:54.270259 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e7162-c2d0-4ad6-bf0d-397f02ca799c None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:20:54.271007 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68e7162-c2d0-4ad6-bf0d-397f02ca799c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:20:54.272407 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68e7162-c2d0-4ad6-bf0d-397f02ca799c None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:20:54.288604 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 23/46] 10.222.0.26 () {60 vars in 1131 bytes} [Fri Jul 1 19:20:54 2022] POST /identity/v3/roles => generated 223 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:20:55.470109 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e632ee-d47a-415a-8909-28ae90eb5d78 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:20:55.470638 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e632ee-d47a-415a-8909-28ae90eb5d78 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:20:55.470721 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e632ee-d47a-415a-8909-28ae90eb5d78 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:20:55.472043 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 24/47] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:20:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:20:55.477491 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8125f58-0295-4be6-8901-c0a37e61a28f None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:20:55.477908 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8125f58-0295-4be6-8901-c0a37e61a28f None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:20:55.478056 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8125f58-0295-4be6-8901-c0a37e61a28f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:20:55.494803 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-b8125f58-0295-4be6-8901-c0a37e61a28f None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:20:55.496310 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-b8125f58-0295-4be6-8901-c0a37e61a28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:20:55.563785 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 24/48] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:20:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:20:55.587577 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e632ee-d47a-415a-8909-28ae90eb5d78 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:20:55.690575 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e632ee-d47a-415a-8909-28ae90eb5d78 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:20:55.716971 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:20:55.725054 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34f415a-f57e-4d25-a824-cf6014973339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:20:55.725882 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f415a-f57e-4d25-a824-cf6014973339 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:20:55.726164 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f415a-f57e-4d25-a824-cf6014973339 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:20:55.726436 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f415a-f57e-4d25-a824-cf6014973339 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:20:55.737398 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34f415a-f57e-4d25-a824-cf6014973339 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:20:55.746136 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-d34f415a-f57e-4d25-a824-cf6014973339 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:20:55.746136 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:20:55.746136 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:20:55.746136 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:20:55.746136 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:20:55.746136 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:20:55.746136 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:20:55.746136 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:20:55.746136 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:20:55.746136 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:20:55.746136 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:20:55.746136 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:20:55.746136 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:20:55.746136 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:20:55.746136 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:20:55.746136 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:20:55.747171 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:20:55.747171 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:20:55.747171 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:20:55.747171 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:20:55.747171 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:20:55.747171 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:20:55.747171 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:20:55.747171 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:20:55.747171 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:20:55.747171 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:20:55.747171 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:20:55.747171 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:20:55.747171 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:20:55.747171 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:20:55.747171 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:20:55.747171 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:20:55.753335 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:20:55.753335 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:20:55.753335 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:20:55.753335 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:20:55.753335 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:20:55.753335 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:20:55.753335 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:20:55.753335 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:20:55.753335 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:20:55.753335 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:20:55.753335 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:20:55.753335 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:20:55.753335 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 25/49] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Jul 1 19:20:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:20:55.755210 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8125f58-0295-4be6-8901-c0a37e61a28f None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:20:55.782595 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:20:55.858331 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8125f58-0295-4be6-8901-c0a37e61a28f None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:20:55.892367 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f778324-2f8f-4be1-a818-67d83d17d605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:20:55.893041 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f778324-2f8f-4be1-a818-67d83d17d605 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:20:55.893364 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f778324-2f8f-4be1-a818-67d83d17d605 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:20:55.893654 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f778324-2f8f-4be1-a818-67d83d17d605 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:20:55.894412 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f778324-2f8f-4be1-a818-67d83d17d605 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:20:55.894732 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f778324-2f8f-4be1-a818-67d83d17d605 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:20:55.896142 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f778324-2f8f-4be1-a818-67d83d17d605 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:20:55.904245 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 25/50] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Jul 1 19:20:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:20:55.909928 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34f415a-f57e-4d25-a824-cf6014973339 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:20:56.010123 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34f415a-f57e-4d25-a824-cf6014973339 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:20:56.042957 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd69d5-67ae-46b6-96b3-fad3f45335ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:20:56.043828 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd69d5-67ae-46b6-96b3-fad3f45335ba None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:20:56.044114 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd69d5-67ae-46b6-96b3-fad3f45335ba None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:20:56.044392 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd69d5-67ae-46b6-96b3-fad3f45335ba None admin] PATH_INFO: `/v3/users/ce82020368de483a9fa05847543c000f` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:20:56.045612 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cd69d5-67ae-46b6-96b3-fad3f45335ba None admin] RBAC: Authorizing `identity:get_user(user_id=ce82020368de483a9fa05847543c000f)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:20:56.047676 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cd69d5-67ae-46b6-96b3-fad3f45335ba None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:20:56.049356 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 26/51] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Jul 1 19:20:55 2022] GET /identity/v3/users/ce82020368de483a9fa05847543c000f => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:20:56.055271 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f778324-2f8f-4be1-a818-67d83d17d605 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:20:56.077991 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a969d-1d5e-4c85-9ac9-88750a98c3b2 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:20:56.078283 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a969d-1d5e-4c85-9ac9-88750a98c3b2 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:20:56.078568 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a969d-1d5e-4c85-9ac9-88750a98c3b2 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:20:56.080251 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 27/52] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:20:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 19:20:56.085711 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4208afd3-a021-4ab1-9467-96087cd680de None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:20:56.086002 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4208afd3-a021-4ab1-9467-96087cd680de None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:20:56.086285 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4208afd3-a021-4ab1-9467-96087cd680de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:20:56.146904 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:20:56.162961 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f778324-2f8f-4be1-a818-67d83d17d605 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:20:56.201196 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f03a1f-6f1e-4945-bfd7-e446f7caa37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:20:56.202031 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f03a1f-6f1e-4945-bfd7-e446f7caa37c None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:20:56.202318 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f03a1f-6f1e-4945-bfd7-e446f7caa37c None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:20:56.202597 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f03a1f-6f1e-4945-bfd7-e446f7caa37c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:20:56.203875 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f03a1f-6f1e-4945-bfd7-e446f7caa37c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:20:56.205387 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f03a1f-6f1e-4945-bfd7-e446f7caa37c None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:20:56.207061 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 26/53] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:20:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:20:56.210940 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-4208afd3-a021-4ab1-9467-96087cd680de None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:20:56.212253 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-4208afd3-a021-4ab1-9467-96087cd680de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:20:56.212793 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f03a1f-6f1e-4945-bfd7-e446f7caa37c None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:20:56.268009 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:20:56.285217 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 28/54] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:20:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 19:20:56.308512 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4208afd3-a021-4ab1-9467-96087cd680de None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:20:56.320996 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f03a1f-6f1e-4945-bfd7-e446f7caa37c None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:20:56.355284 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12203c60-16ec-48cb-ae2e-c5c9f6f78182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:20:56.355940 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12203c60-16ec-48cb-ae2e-c5c9f6f78182 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:20:56.356226 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12203c60-16ec-48cb-ae2e-c5c9f6f78182 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:20:56.356509 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12203c60-16ec-48cb-ae2e-c5c9f6f78182 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:20:56.357368 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12203c60-16ec-48cb-ae2e-c5c9f6f78182 None admin] RBAC: Adding query filter params (role.id=6cb03785fb184ef587509b3174622f69, scope.domain.id=default, user.id=ce82020368de483a9fa05847543c000f) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:20:56.357686 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12203c60-16ec-48cb-ae2e-c5c9f6f78182 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:20:56.359821 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12203c60-16ec-48cb-ae2e-c5c9f6f78182 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:20:56.365678 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 27/55] 10.222.0.26 () {56 vars in 1322 bytes} [Fri Jul 1 19:20:56 2022] GET /identity/v3/role_assignments?user.id=ce82020368de483a9fa05847543c000f&scope.domain.id=default&role.id=6cb03785fb184ef587509b3174622f69 => generated 530 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:20:56.409484 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4208afd3-a021-4ab1-9467-96087cd680de None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:20:56.446469 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed56c85-b47b-47d9-a843-43db057faa2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:20:56.447287 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed56c85-b47b-47d9-a843-43db057faa2a None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:20:56.447572 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed56c85-b47b-47d9-a843-43db057faa2a None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:20:56.447846 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed56c85-b47b-47d9-a843-43db057faa2a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:20:56.449052 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed56c85-b47b-47d9-a843-43db057faa2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:20:56.450608 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed56c85-b47b-47d9-a843-43db057faa2a None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:20:56.452254 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 29/56] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:20:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:20:56.458179 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12203c60-16ec-48cb-ae2e-c5c9f6f78182 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:20:56.480411 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:20:56.564997 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12203c60-16ec-48cb-ae2e-c5c9f6f78182 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:20:56.599205 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9940024f-6325-450e-bdd9-cd94df87f722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:20:56.599872 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940024f-6325-450e-bdd9-cd94df87f722 None admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:20:56.600177 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940024f-6325-450e-bdd9-cd94df87f722 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:20:56.600536 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940024f-6325-450e-bdd9-cd94df87f722 None admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:20:56.601297 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9940024f-6325-450e-bdd9-cd94df87f722 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:20:56.602770 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9940024f-6325-450e-bdd9-cd94df87f722 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:20:56.627733 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 28/57] 10.222.0.26 () {60 vars in 1140 bytes} [Fri Jul 1 19:20:56 2022] POST /identity/v3/projects => generated 298 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:20:58.673384 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363560e5-0d0f-4950-afe1-3bfd020f9c2a None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:20:58.673833 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363560e5-0d0f-4950-afe1-3bfd020f9c2a None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:20:58.673945 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363560e5-0d0f-4950-afe1-3bfd020f9c2a None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:20:58.675326 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 30/58] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:20:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:20:58.681174 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d982f69a-04e1-405b-ab0e-0907716da9fe None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:20:58.681587 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d982f69a-04e1-405b-ab0e-0907716da9fe None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:20:58.681768 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d982f69a-04e1-405b-ab0e-0907716da9fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:20:58.697864 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-d982f69a-04e1-405b-ab0e-0907716da9fe None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:20:58.699045 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-d982f69a-04e1-405b-ab0e-0907716da9fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:20:58.759983 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:20:58.765097 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 29/59] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:20:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 19:20:58.790013 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363560e5-0d0f-4950-afe1-3bfd020f9c2a None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:20:58.846648 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:20:58.890959 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363560e5-0d0f-4950-afe1-3bfd020f9c2a None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:20:58.923560 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7153f4-873a-4f8e-a421-04ab925c408e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:20:58.924335 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7153f4-873a-4f8e-a421-04ab925c408e None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:20:58.924623 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7153f4-873a-4f8e-a421-04ab925c408e None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:20:58.924905 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7153f4-873a-4f8e-a421-04ab925c408e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:20:58.926107 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7153f4-873a-4f8e-a421-04ab925c408e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:20:58.927554 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7153f4-873a-4f8e-a421-04ab925c408e None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:20:58.929433 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 31/60] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:20:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:20:58.934881 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d982f69a-04e1-405b-ab0e-0907716da9fe None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:20:59.031616 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d982f69a-04e1-405b-ab0e-0907716da9fe None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:20:59.064278 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd92201-b654-42da-8ac2-7b0ad8d377ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:20:59.064942 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd92201-b654-42da-8ac2-7b0ad8d377ab None admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:20:59.065257 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd92201-b654-42da-8ac2-7b0ad8d377ab None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:20:59.065545 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd92201-b654-42da-8ac2-7b0ad8d377ab None admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:20:59.066266 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd92201-b654-42da-8ac2-7b0ad8d377ab None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:20:59.067717 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd92201-b654-42da-8ac2-7b0ad8d377ab None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:20:59.092657 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 30/61] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Jul 1 19:20:58 2022] POST /identity/v3/users => generated 275 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:21:02.393754 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b93365f-5bc0-4892-9479-f336ac3202cb None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:02.393754 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b93365f-5bc0-4892-9479-f336ac3202cb None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:02.393754 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b93365f-5bc0-4892-9479-f336ac3202cb None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:02.393754 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 32/62] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:21:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:21:02.407522 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e503d32a-e839-4cf7-9b03-45ea06ae2a02 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:02.408471 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e503d32a-e839-4cf7-9b03-45ea06ae2a02 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:02.408965 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e503d32a-e839-4cf7-9b03-45ea06ae2a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:02.434401 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-e503d32a-e839-4cf7-9b03-45ea06ae2a02 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:21:02.435700 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-e503d32a-e839-4cf7-9b03-45ea06ae2a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:21:02.503361 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:02.527288 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 31/63] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:21:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:21:02.561956 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094f91f-b355-440c-8ac0-3e70599ae63f None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:02.562165 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e503d32a-e839-4cf7-9b03-45ea06ae2a02 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:02.562698 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094f91f-b355-440c-8ac0-3e70599ae63f None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:02.563175 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094f91f-b355-440c-8ac0-3e70599ae63f None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:02.564981 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 33/64] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:21:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:21:02.587152 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e15ce6-efe9-4d96-8948-b47bcf34cdc5 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:02.587803 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e15ce6-efe9-4d96-8948-b47bcf34cdc5 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:02.588277 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e15ce6-efe9-4d96-8948-b47bcf34cdc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:02.626326 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-26e15ce6-efe9-4d96-8948-b47bcf34cdc5 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:21:02.627861 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-26e15ce6-efe9-4d96-8948-b47bcf34cdc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:21:02.684917 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e503d32a-e839-4cf7-9b03-45ea06ae2a02 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:02.722783 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fa57e0-c899-4f55-97f9-318bd731ae4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:02.723839 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fa57e0-c899-4f55-97f9-318bd731ae4d None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:02.724273 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fa57e0-c899-4f55-97f9-318bd731ae4d None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:02.724696 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fa57e0-c899-4f55-97f9-318bd731ae4d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:02.737271 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fa57e0-c899-4f55-97f9-318bd731ae4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:21:02.745653 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-a2fa57e0-c899-4f55-97f9-318bd731ae4d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 19:21:02.745653 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:21:02.745653 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:21:02.745653 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:21:02.745653 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:21:02.745653 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:21:02.745653 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:21:02.745653 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:21:02.745653 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:21:02.745653 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:21:02.745653 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:21:02.745653 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:21:02.745653 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:21:02.745653 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:21:02.745653 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:21:02.745653 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:21:02.746500 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:21:02.746500 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:21:02.746500 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:21:02.746500 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:21:02.746500 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:21:02.746500 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:21:02.746500 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:21:02.746500 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:21:02.746500 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:21:02.746500 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:21:02.746500 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:21:02.746500 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:21:02.746500 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:21:02.746500 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:21:02.746500 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:21:02.746500 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:21:02.747347 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:21:02.747347 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:21:02.747347 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:21:02.747347 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:21:02.747347 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:21:02.747347 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:21:02.747347 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:21:02.747347 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:21:02.747347 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:21:02.747347 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:21:02.747347 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 19:21:02.747347 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:21:02.749770 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 32/65] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Jul 1 19:21:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:21:02.751286 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a9bebc-afff-4e6c-b16c-eb9aead83d06 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:02.751775 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a9bebc-afff-4e6c-b16c-eb9aead83d06 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:02.752249 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a9bebc-afff-4e6c-b16c-eb9aead83d06 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:02.754266 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 33/66] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:21:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:21:02.756124 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a9bebc-afff-4e6c-b16c-eb9aead83d06 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:02.769205 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 34/67] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:21:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 19:21:02.771404 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8bae56-c4d0-42ea-b89e-b00c3b2a0f1e None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:02.771728 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8bae56-c4d0-42ea-b89e-b00c3b2a0f1e None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:02.772024 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8bae56-c4d0-42ea-b89e-b00c3b2a0f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:02.801842 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-0b8bae56-c4d0-42ea-b89e-b00c3b2a0f1e None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:21:02.803437 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-0b8bae56-c4d0-42ea-b89e-b00c3b2a0f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:21:02.820041 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:02.862880 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:02.881166 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a9bebc-afff-4e6c-b16c-eb9aead83d06 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:02.886538 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 35/68] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:21:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:21:02.887859 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece4bcf-bd4b-4134-b936-c8c6c84eaf47 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:02.888163 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece4bcf-bd4b-4134-b936-c8c6c84eaf47 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:02.888447 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece4bcf-bd4b-4134-b936-c8c6c84eaf47 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:02.889930 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 36/69] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:21:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:21:02.890973 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bece4bcf-bd4b-4134-b936-c8c6c84eaf47 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:02.921566 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcce379-59b4-49e1-95b6-9b603fc79b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:02.922246 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcce379-59b4-49e1-95b6-9b603fc79b83 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:02.922563 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcce379-59b4-49e1-95b6-9b603fc79b83 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:02.922816 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcce379-59b4-49e1-95b6-9b603fc79b83 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:02.923690 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcce379-59b4-49e1-95b6-9b603fc79b83 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:02.924234 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcce379-59b4-49e1-95b6-9b603fc79b83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:02.925681 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcce379-59b4-49e1-95b6-9b603fc79b83 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:02.934460 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 34/70] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Jul 1 19:21:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:02.935783 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff67b4e-3c2b-4745-af91-dd8e0b2d1e1b None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:02.936020 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff67b4e-3c2b-4745-af91-dd8e0b2d1e1b None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:02.936304 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff67b4e-3c2b-4745-af91-dd8e0b2d1e1b None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:02.937779 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 35/71] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:21:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:21:02.938645 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f0cdf-a2e1-4093-bc2e-869f6a54458e None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:02.938934 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f0cdf-a2e1-4093-bc2e-869f6a54458e None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:02.939451 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f0cdf-a2e1-4093-bc2e-869f6a54458e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:02.956250 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-f69f0cdf-a2e1-4093-bc2e-869f6a54458e None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:21:02.957480 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-f69f0cdf-a2e1-4093-bc2e-869f6a54458e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:21:03.000328 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bece4bcf-bd4b-4134-b936-c8c6c84eaf47 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:03.024513 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 36/72] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:21:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:21:03.037440 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69f0cdf-a2e1-4093-bc2e-869f6a54458e None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:03.037548 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb81af19-7174-483a-b7b7-059fabbdec40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:03.037548 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81af19-7174-483a-b7b7-059fabbdec40 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:03.037548 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81af19-7174-483a-b7b7-059fabbdec40 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:03.037548 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81af19-7174-483a-b7b7-059fabbdec40 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:03.048658 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb81af19-7174-483a-b7b7-059fabbdec40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:21:03.056699 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-bb81af19-7174-483a-b7b7-059fabbdec40 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 01 19:21:03.056699 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:21:03.056699 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:21:03.056699 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:21:03.056699 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:21:03.056699 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:21:03.056699 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:21:03.056699 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:21:03.056699 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:21:03.056699 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:21:03.056699 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:21:03.056699 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:21:03.056699 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:21:03.056699 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:21:03.056699 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:21:03.056699 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:21:03.057747 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:21:03.057747 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:21:03.057747 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:21:03.057747 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:21:03.057747 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:21:03.057747 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:21:03.057747 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:21:03.057747 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:21:03.057747 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:21:03.057747 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:21:03.057747 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:21:03.057747 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:21:03.057747 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:21:03.057747 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:21:03.057747 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:21:03.057747 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:21:03.058537 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:21:03.058537 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:21:03.058537 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:21:03.058537 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:21:03.058537 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:21:03.058537 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:21:03.058537 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:21:03.058537 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:21:03.058537 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:21:03.058537 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:21:03.058537 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 01 19:21:03.058537 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:21:03.058537 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 37/73] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Jul 1 19:21:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:21:03.059244 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb81af19-7174-483a-b7b7-059fabbdec40 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:03.069432 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:03.106836 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:03.131089 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69f0cdf-a2e1-4093-bc2e-869f6a54458e None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:03.164327 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb81af19-7174-483a-b7b7-059fabbdec40 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:03.165698 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0bdffa-abdd-4b83-8c44-2b221ae76bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:03.166567 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0bdffa-abdd-4b83-8c44-2b221ae76bb4 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:03.166856 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0bdffa-abdd-4b83-8c44-2b221ae76bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:03.167133 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0bdffa-abdd-4b83-8c44-2b221ae76bb4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:03.177282 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0bdffa-abdd-4b83-8c44-2b221ae76bb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:21:03.185045 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-bb0bdffa-abdd-4b83-8c44-2b221ae76bb4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:21:03.185045 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:21:03.185045 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:21:03.185045 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:21:03.185045 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:21:03.185045 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:21:03.185045 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:21:03.185045 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:21:03.185045 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:21:03.185045 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:21:03.185045 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:21:03.185045 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:21:03.185045 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:21:03.185045 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:21:03.185045 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:21:03.185045 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:21:03.186024 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:21:03.186024 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:21:03.186024 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:21:03.186024 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:21:03.186024 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:21:03.186024 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:21:03.186024 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:21:03.186024 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:21:03.186024 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:21:03.186024 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:21:03.186024 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:21:03.186024 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:21:03.186024 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:21:03.186024 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:21:03.186024 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:21:03.186024 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:21:03.186784 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:21:03.186784 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:21:03.186784 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:21:03.186784 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:21:03.186784 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:21:03.186784 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:21:03.186784 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:21:03.186784 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:21:03.186784 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:21:03.186784 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:21:03.186784 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:21:03.186784 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:21:03.186784 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 37/74] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Jul 1 19:21:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:21:03.188091 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2eb31-a1d8-4bfc-b136-62d0e240b3d7 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:03.188519 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2eb31-a1d8-4bfc-b136-62d0e240b3d7 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:03.188519 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2eb31-a1d8-4bfc-b136-62d0e240b3d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:03.203436 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf981fe-67ec-4984-92e2-9f5a6a66e302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:03.204308 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf981fe-67ec-4984-92e2-9f5a6a66e302 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:03.204623 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf981fe-67ec-4984-92e2-9f5a6a66e302 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:03.204903 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf981fe-67ec-4984-92e2-9f5a6a66e302 None admin] PATH_INFO: `/v3/users/076da96929604363947a23159f348388` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:03.205446 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-a9a2eb31-a1d8-4bfc-b136-62d0e240b3d7 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:21:03.206628 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-a9a2eb31-a1d8-4bfc-b136-62d0e240b3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:21:03.220867 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf981fe-67ec-4984-92e2-9f5a6a66e302 None admin] RBAC: Authorizing `identity:get_user(user_id=076da96929604363947a23159f348388)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:03.222393 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf981fe-67ec-4984-92e2-9f5a6a66e302 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:03.224124 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 38/75] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Jul 1 19:21:03 2022] GET /identity/v3/users/076da96929604363947a23159f348388 => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:03.224987 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf981fe-67ec-4984-92e2-9f5a6a66e302 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:03.272366 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 38/76] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:21:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:21:03.273201 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a2eb31-a1d8-4bfc-b136-62d0e240b3d7 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:03.308073 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:03.324177 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:03.327159 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf981fe-67ec-4984-92e2-9f5a6a66e302 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:03.362176 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea77063-c141-4ec2-8708-41c3960ab927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:03.362976 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea77063-c141-4ec2-8708-41c3960ab927 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:03.363268 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea77063-c141-4ec2-8708-41c3960ab927 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:03.363550 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea77063-c141-4ec2-8708-41c3960ab927 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:03.373887 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea77063-c141-4ec2-8708-41c3960ab927 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:21:03.380135 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a2eb31-a1d8-4bfc-b136-62d0e240b3d7 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:03.381891 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-3ea77063-c141-4ec2-8708-41c3960ab927 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 01 19:21:03.381891 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:21:03.381891 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:21:03.381891 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:21:03.381891 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:21:03.381891 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:21:03.381891 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:21:03.381891 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:21:03.381891 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:21:03.381891 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:21:03.381891 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:21:03.381891 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:21:03.381891 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:21:03.381891 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:21:03.381891 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:21:03.381891 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:21:03.382723 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:21:03.382723 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:21:03.382723 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:21:03.382723 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:21:03.382723 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:21:03.382723 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:21:03.382723 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:21:03.382723 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:21:03.382723 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:21:03.382723 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:21:03.382723 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:21:03.382723 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:21:03.382723 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:21:03.382723 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:21:03.382723 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:21:03.382723 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:21:03.383470 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:21:03.383470 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:21:03.383470 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:21:03.383470 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:21:03.383470 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:21:03.383470 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:21:03.383470 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:21:03.383470 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:21:03.383470 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:21:03.383470 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:21:03.383470 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 01 19:21:03.383470 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:21:03.383470 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 39/77] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Jul 1 19:21:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:21:03.384091 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea77063-c141-4ec2-8708-41c3960ab927 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:03.413969 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3617416c-480e-48e6-9144-beff75fac9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:03.414639 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3617416c-480e-48e6-9144-beff75fac9a8 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:03.414929 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3617416c-480e-48e6-9144-beff75fac9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:03.415216 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3617416c-480e-48e6-9144-beff75fac9a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:03.415968 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3617416c-480e-48e6-9144-beff75fac9a8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:03.416286 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3617416c-480e-48e6-9144-beff75fac9a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:03.417715 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3617416c-480e-48e6-9144-beff75fac9a8 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:03.426346 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 39/78] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Jul 1 19:21:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:03.427134 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3617416c-480e-48e6-9144-beff75fac9a8 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:03.489442 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea77063-c141-4ec2-8708-41c3960ab927 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:03.517589 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:03.523389 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f4395e-20ea-427a-b31b-64657d33fcfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:03.524059 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4395e-20ea-427a-b31b-64657d33fcfc None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:03.524353 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4395e-20ea-427a-b31b-64657d33fcfc None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:03.524638 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4395e-20ea-427a-b31b-64657d33fcfc None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:03.525425 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f4395e-20ea-427a-b31b-64657d33fcfc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:03.525743 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f4395e-20ea-427a-b31b-64657d33fcfc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:03.527122 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f4395e-20ea-427a-b31b-64657d33fcfc None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:03.527848 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3617416c-480e-48e6-9144-beff75fac9a8 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:03.536231 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 40/79] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Jul 1 19:21:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:03.537044 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f4395e-20ea-427a-b31b-64657d33fcfc None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:03.562489 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bd2a3b-835e-4317-895a-029f4eb5c50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:03.562666 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:03.563138 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd2a3b-835e-4317-895a-029f4eb5c50b None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:03.563423 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd2a3b-835e-4317-895a-029f4eb5c50b None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:03.563700 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd2a3b-835e-4317-895a-029f4eb5c50b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:03.641484 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bd2a3b-835e-4317-895a-029f4eb5c50b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:03.642292 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f4395e-20ea-427a-b31b-64657d33fcfc None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:03.643425 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bd2a3b-835e-4317-895a-029f4eb5c50b None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:03.676819 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c63a7-ea68-4227-aad3-b3de67d87a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:03.677643 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c63a7-ea68-4227-aad3-b3de67d87a47 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:03.677940 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c63a7-ea68-4227-aad3-b3de67d87a47 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:03.678228 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c63a7-ea68-4227-aad3-b3de67d87a47 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:03.679683 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34c63a7-ea68-4227-aad3-b3de67d87a47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:03.681136 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34c63a7-ea68-4227-aad3-b3de67d87a47 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:03.682790 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 41/80] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:21:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:03.683563 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c63a7-ea68-4227-aad3-b3de67d87a47 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:03.732878 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:03.743786 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 40/81] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Jul 1 19:21:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 19:21:03.744559 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bd2a3b-835e-4317-895a-029f4eb5c50b None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:03.782048 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:03.792127 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c63a7-ea68-4227-aad3-b3de67d87a47 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:03.826953 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ecef39-fb71-4889-8be1-cbb588f0328f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:03.827611 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ecef39-fb71-4889-8be1-cbb588f0328f None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:03.827897 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ecef39-fb71-4889-8be1-cbb588f0328f None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:03.828175 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ecef39-fb71-4889-8be1-cbb588f0328f None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:03.828916 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ecef39-fb71-4889-8be1-cbb588f0328f None admin] RBAC: Adding query filter params (name=member) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:03.829222 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ecef39-fb71-4889-8be1-cbb588f0328f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:03.830641 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ecef39-fb71-4889-8be1-cbb588f0328f None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:03.838796 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 42/82] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Jul 1 19:21:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:03.839574 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ecef39-fb71-4889-8be1-cbb588f0328f None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:03.846185 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bd2a3b-835e-4317-895a-029f4eb5c50b None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:03.880779 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4ec995-4bad-4388-ae2e-789db6a7ca37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:03.881770 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ec995-4bad-4388-ae2e-789db6a7ca37 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:03.882060 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ec995-4bad-4388-ae2e-789db6a7ca37 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:03.882351 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ec995-4bad-4388-ae2e-789db6a7ca37 None admin] PATH_INFO: `/v3/users/076da96929604363947a23159f348388` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:03.883561 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4ec995-4bad-4388-ae2e-789db6a7ca37 None admin] RBAC: Authorizing `identity:get_user(user_id=076da96929604363947a23159f348388)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:03.885020 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4ec995-4bad-4388-ae2e-789db6a7ca37 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:03.891294 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 41/83] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Jul 1 19:21:03 2022] GET /identity/v3/users/076da96929604363947a23159f348388 => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:03.891294 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4ec995-4bad-4388-ae2e-789db6a7ca37 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:03.937969 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ecef39-fb71-4889-8be1-cbb588f0328f None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:03.947110 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:03.971264 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cefc064-5a07-439f-a1c6-89168558e473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:03.972133 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cefc064-5a07-439f-a1c6-89168558e473 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:03.972420 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cefc064-5a07-439f-a1c6-89168558e473 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:03.972699 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cefc064-5a07-439f-a1c6-89168558e473 None admin] PATH_INFO: `/v3/users/ce82020368de483a9fa05847543c000f` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:03.973936 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cefc064-5a07-439f-a1c6-89168558e473 None admin] RBAC: Authorizing `identity:get_user(user_id=ce82020368de483a9fa05847543c000f)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:03.975390 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cefc064-5a07-439f-a1c6-89168558e473 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:03.981712 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 43/84] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Jul 1 19:21:03 2022] GET /identity/v3/users/ce82020368de483a9fa05847543c000f => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:03.981712 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cefc064-5a07-439f-a1c6-89168558e473 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:03.989623 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4ec995-4bad-4388-ae2e-789db6a7ca37 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:03.999477 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:04.025183 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c056fe24-5040-42c0-a1eb-d2257c2ca3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:04.025891 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c056fe24-5040-42c0-a1eb-d2257c2ca3ef None admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:04.026180 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c056fe24-5040-42c0-a1eb-d2257c2ca3ef None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:04.026463 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c056fe24-5040-42c0-a1eb-d2257c2ca3ef None admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:04.027191 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c056fe24-5040-42c0-a1eb-d2257c2ca3ef None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:04.028650 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c056fe24-5040-42c0-a1eb-d2257c2ca3ef None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:04.048121 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 42/85] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Jul 1 19:21:03 2022] POST /identity/v3/users => generated 289 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:21:04.048942 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c056fe24-5040-42c0-a1eb-d2257c2ca3ef None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:04.084413 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cefc064-5a07-439f-a1c6-89168558e473 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:04.123075 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb7e88a-44bb-48d4-ab7d-2b26dcbff5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:04.123960 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb7e88a-44bb-48d4-ab7d-2b26dcbff5ef None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:04.124250 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb7e88a-44bb-48d4-ab7d-2b26dcbff5ef None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:04.125112 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb7e88a-44bb-48d4-ab7d-2b26dcbff5ef None admin] PATH_INFO: `/v3/projects/9260fc0eba4449f190981e3ec5a011ad` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:04.126590 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb7e88a-44bb-48d4-ab7d-2b26dcbff5ef None admin] RBAC: Authorizing `identity:get_project(project_id=9260fc0eba4449f190981e3ec5a011ad)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:04.128062 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb7e88a-44bb-48d4-ab7d-2b26dcbff5ef None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:04.134617 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 44/86] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Jul 1 19:21:03 2022] GET /identity/v3/projects/9260fc0eba4449f190981e3ec5a011ad => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:04.134617 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb7e88a-44bb-48d4-ab7d-2b26dcbff5ef None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:04.185373 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c056fe24-5040-42c0-a1eb-d2257c2ca3ef None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:04.201406 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:04.233961 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e1374-84ec-4de9-beae-3d4083e66694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:04.235612 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e1374-84ec-4de9-beae-3d4083e66694 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:04.235902 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e1374-84ec-4de9-beae-3d4083e66694 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:04.236183 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e1374-84ec-4de9-beae-3d4083e66694 None admin] PATH_INFO: `/v3/users/076da96929604363947a23159f348388` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:04.237453 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6e1374-84ec-4de9-beae-3d4083e66694 None admin] RBAC: Authorizing `identity:get_user(user_id=076da96929604363947a23159f348388)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:04.239065 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6e1374-84ec-4de9-beae-3d4083e66694 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:04.240708 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 43/87] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Jul 1 19:21:04 2022] GET /identity/v3/users/076da96929604363947a23159f348388 => generated 275 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:04.241943 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:04.243548 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e1374-84ec-4de9-beae-3d4083e66694 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:04.256643 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb7e88a-44bb-48d4-ab7d-2b26dcbff5ef None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:04.298610 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859989f5-f510-4457-8169-89cd9de42427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:04.299276 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859989f5-f510-4457-8169-89cd9de42427 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:04.299564 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859989f5-f510-4457-8169-89cd9de42427 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:04.299848 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859989f5-f510-4457-8169-89cd9de42427 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:04.366659 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e1374-84ec-4de9-beae-3d4083e66694 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:04.387652 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859989f5-f510-4457-8169-89cd9de42427 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:04.389147 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859989f5-f510-4457-8169-89cd9de42427 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:04.422552 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b161802-97ef-4074-8359-3a511f16ba78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:04.424650 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b161802-97ef-4074-8359-3a511f16ba78 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:04.425459 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b161802-97ef-4074-8359-3a511f16ba78 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:04.425943 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b161802-97ef-4074-8359-3a511f16ba78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:04.489797 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:04.500293 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:04.514625 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 45/88] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Jul 1 19:21:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 19:21:04.516573 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859989f5-f510-4457-8169-89cd9de42427 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:04.523985 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b161802-97ef-4074-8359-3a511f16ba78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:04.525534 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b161802-97ef-4074-8359-3a511f16ba78 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:04.646485 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 44/89] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Jul 1 19:21:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 19:21:04.647629 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b161802-97ef-4074-8359-3a511f16ba78 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:04.671685 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859989f5-f510-4457-8169-89cd9de42427 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:04.710519 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ecedae-a6e7-4624-99db-effaf02cb2e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:04.711317 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ecedae-a6e7-4624-99db-effaf02cb2e7 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:04.711497 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ecedae-a6e7-4624-99db-effaf02cb2e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:04.711766 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ecedae-a6e7-4624-99db-effaf02cb2e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:04.712620 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ecedae-a6e7-4624-99db-effaf02cb2e7 None admin] RBAC: Adding query filter params (role.id=dd71f7898e6a4d9f99d1554dd7d27033, scope.project.id=9260fc0eba4449f190981e3ec5a011ad, user.id=076da96929604363947a23159f348388) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:04.712944 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ecedae-a6e7-4624-99db-effaf02cb2e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:04.714522 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ecedae-a6e7-4624-99db-effaf02cb2e7 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:04.724025 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 46/90] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Jul 1 19:21:04 2022] GET /identity/v3/role_assignments?user.id=076da96929604363947a23159f348388&scope.project.id=9260fc0eba4449f190981e3ec5a011ad&role.id=dd71f7898e6a4d9f99d1554dd7d27033 => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:04.724662 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ecedae-a6e7-4624-99db-effaf02cb2e7 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:04.760907 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b161802-97ef-4074-8359-3a511f16ba78 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:04.785567 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:04.800405 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:04.809820 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7088a09e-19e1-4f7e-81b1-22ffc6bbdecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:04.810515 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088a09e-19e1-4f7e-81b1-22ffc6bbdecd None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:04.810854 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088a09e-19e1-4f7e-81b1-22ffc6bbdecd None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:04.811144 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088a09e-19e1-4f7e-81b1-22ffc6bbdecd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:04.917780 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ecedae-a6e7-4624-99db-effaf02cb2e7 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:04.957806 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7088a09e-19e1-4f7e-81b1-22ffc6bbdecd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:04.960647 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7088a09e-19e1-4f7e-81b1-22ffc6bbdecd None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:04.968112 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197d7384-5efd-4932-b091-52a277738101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:04.969136 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197d7384-5efd-4932-b091-52a277738101 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:04.969520 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197d7384-5efd-4932-b091-52a277738101 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:04.969917 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197d7384-5efd-4932-b091-52a277738101 None admin] PATH_INFO: `/v3/projects/9260fc0eba4449f190981e3ec5a011ad` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:04.971177 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197d7384-5efd-4932-b091-52a277738101 None admin] RBAC: Authorizing `identity:get_project(project_id=9260fc0eba4449f190981e3ec5a011ad)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:04.972698 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197d7384-5efd-4932-b091-52a277738101 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:04.974514 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 47/91] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Jul 1 19:21:04 2022] GET /identity/v3/projects/9260fc0eba4449f190981e3ec5a011ad => generated 298 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:04.975531 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197d7384-5efd-4932-b091-52a277738101 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:05.065729 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:05.080811 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 45/92] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Jul 1 19:21:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 19:21:05.086194 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7088a09e-19e1-4f7e-81b1-22ffc6bbdecd None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:05.159891 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197d7384-5efd-4932-b091-52a277738101 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:05.183430 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:05.201292 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b610cf-0868-436a-99c0-6e676dcf9419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:05.202425 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b610cf-0868-436a-99c0-6e676dcf9419 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:05.203522 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b610cf-0868-436a-99c0-6e676dcf9419 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:05.204004 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b610cf-0868-436a-99c0-6e676dcf9419 None admin] PATH_INFO: `/v3/projects/9260fc0eba4449f190981e3ec5a011ad` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:05.205409 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b610cf-0868-436a-99c0-6e676dcf9419 None admin] RBAC: Authorizing `identity:get_project(project_id=9260fc0eba4449f190981e3ec5a011ad)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:05.207028 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b610cf-0868-436a-99c0-6e676dcf9419 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:05.209571 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 48/93] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Jul 1 19:21:04 2022] GET /identity/v3/projects/9260fc0eba4449f190981e3ec5a011ad => generated 298 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:05.210539 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b610cf-0868-436a-99c0-6e676dcf9419 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:05.325770 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b610cf-0868-436a-99c0-6e676dcf9419 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:05.339220 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7088a09e-19e1-4f7e-81b1-22ffc6bbdecd None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:05.362914 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503744b6-752c-4a64-b889-8e452b5ba60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:05.363806 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503744b6-752c-4a64-b889-8e452b5ba60a None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:05.364093 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503744b6-752c-4a64-b889-8e452b5ba60a None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:05.364372 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503744b6-752c-4a64-b889-8e452b5ba60a None admin] PATH_INFO: `/v3/projects/1505be130f184ead97ccbacb96223727` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:05.365823 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503744b6-752c-4a64-b889-8e452b5ba60a None admin] RBAC: Authorizing `identity:get_project(project_id=1505be130f184ead97ccbacb96223727)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:05.367306 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503744b6-752c-4a64-b889-8e452b5ba60a None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:05.368984 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 49/94] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Jul 1 19:21:05 2022] GET /identity/v3/projects/1505be130f184ead97ccbacb96223727 => generated 312 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:05.369817 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503744b6-752c-4a64-b889-8e452b5ba60a None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:05.432424 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:05.453966 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2832bcb4-d763-467d-b7ca-01d2a51f061e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:05.454646 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2832bcb4-d763-467d-b7ca-01d2a51f061e None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:05.454942 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2832bcb4-d763-467d-b7ca-01d2a51f061e None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:05.455224 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2832bcb4-d763-467d-b7ca-01d2a51f061e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:05.456073 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2832bcb4-d763-467d-b7ca-01d2a51f061e None admin] RBAC: Adding query filter params (role.id=4cbf6ec846eb4b7c8cc52e9bfd6f076f, scope.project.id=9260fc0eba4449f190981e3ec5a011ad, user.id=076da96929604363947a23159f348388) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:05.456394 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2832bcb4-d763-467d-b7ca-01d2a51f061e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:05.457890 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2832bcb4-d763-467d-b7ca-01d2a51f061e None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:05.471442 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 46/95] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Jul 1 19:21:05 2022] GET /identity/v3/role_assignments?user.id=076da96929604363947a23159f348388&scope.project.id=9260fc0eba4449f190981e3ec5a011ad&role.id=4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 259 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:05.472574 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2832bcb4-d763-467d-b7ca-01d2a51f061e None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:05.481089 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503744b6-752c-4a64-b889-8e452b5ba60a None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:05.518647 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dc5c4f-9c43-49f5-bd22-2577b78aa52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:05.519326 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc5c4f-9c43-49f5-bd22-2577b78aa52c None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:05.519622 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc5c4f-9c43-49f5-bd22-2577b78aa52c None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:05.519879 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc5c4f-9c43-49f5-bd22-2577b78aa52c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:05.520744 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dc5c4f-9c43-49f5-bd22-2577b78aa52c None admin] RBAC: Adding query filter params (role.id=6cb03785fb184ef587509b3174622f69, scope.project.id=9260fc0eba4449f190981e3ec5a011ad, user.id=ce82020368de483a9fa05847543c000f) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:05.521069 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dc5c4f-9c43-49f5-bd22-2577b78aa52c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:05.529295 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dc5c4f-9c43-49f5-bd22-2577b78aa52c None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:05.537668 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 50/96] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Jul 1 19:21:05 2022] GET /identity/v3/role_assignments?user.id=ce82020368de483a9fa05847543c000f&scope.project.id=9260fc0eba4449f190981e3ec5a011ad&role.id=6cb03785fb184ef587509b3174622f69 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:05.586909 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:05.680273 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2832bcb4-d763-467d-b7ca-01d2a51f061e None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:05.730274 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03c4eaf-edf9-4c47-889b-6b6c7397720d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:05.731360 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c4eaf-edf9-4c47-889b-6b6c7397720d None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:05.731858 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c4eaf-edf9-4c47-889b-6b6c7397720d None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:05.732373 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c4eaf-edf9-4c47-889b-6b6c7397720d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:05.733460 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03c4eaf-edf9-4c47-889b-6b6c7397720d None admin] RBAC: Adding query filter params (role.id=4cbf6ec846eb4b7c8cc52e9bfd6f076f, scope.project.id=1505be130f184ead97ccbacb96223727, user.id=076da96929604363947a23159f348388) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:05.734037 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03c4eaf-edf9-4c47-889b-6b6c7397720d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:05.735726 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03c4eaf-edf9-4c47-889b-6b6c7397720d None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:05.742710 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 47/97] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Jul 1 19:21:05 2022] GET /identity/v3/role_assignments?user.id=076da96929604363947a23159f348388&scope.project.id=1505be130f184ead97ccbacb96223727&role.id=4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 259 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:06.846936 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a10f45-9690-44bd-b216-c3b16c67a2fd None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:06.847441 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a10f45-9690-44bd-b216-c3b16c67a2fd None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:06.847538 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a10f45-9690-44bd-b216-c3b16c67a2fd None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:06.849357 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 51/98] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:21:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:21:06.852697 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b9135-f6c7-4d4c-a049-e395b585f1c1 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:06.853517 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b9135-f6c7-4d4c-a049-e395b585f1c1 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:06.853993 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b9135-f6c7-4d4c-a049-e395b585f1c1 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:06.854645 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3e063-76f9-4c00-a712-1ff363f0321f None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:06.854991 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3e063-76f9-4c00-a712-1ff363f0321f None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:06.855281 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3e063-76f9-4c00-a712-1ff363f0321f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:06.856388 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 48/99] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:21:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:21:06.861256 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef1bfb-3203-4991-a70c-cf5fb4e11fcc None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:06.861771 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef1bfb-3203-4991-a70c-cf5fb4e11fcc None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:06.862245 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef1bfb-3203-4991-a70c-cf5fb4e11fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:06.872922 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-0bb3e063-76f9-4c00-a712-1ff363f0321f None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:21:06.874181 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-0bb3e063-76f9-4c00-a712-1ff363f0321f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:21:06.890835 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-0cef1bfb-3203-4991-a70c-cf5fb4e11fcc None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:21:06.892313 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-0cef1bfb-3203-4991-a70c-cf5fb4e11fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:21:06.945650 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 52/100] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:21:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 19:21:06.972140 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb3e063-76f9-4c00-a712-1ff363f0321f None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:07.020791 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 49/101] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:21:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 19:21:07.024016 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:07.052484 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cef1bfb-3203-4991-a70c-cf5fb4e11fcc None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:07.078696 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb3e063-76f9-4c00-a712-1ff363f0321f None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:07.116855 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:07.119836 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050ae9a2-0047-4ec3-9b71-25baf4b7a66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:07.120712 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ae9a2-0047-4ec3-9b71-25baf4b7a66d None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:07.121045 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ae9a2-0047-4ec3-9b71-25baf4b7a66d None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:07.122061 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ae9a2-0047-4ec3-9b71-25baf4b7a66d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:07.123282 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050ae9a2-0047-4ec3-9b71-25baf4b7a66d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:07.125291 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050ae9a2-0047-4ec3-9b71-25baf4b7a66d None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:07.127301 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 53/102] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:21:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:07.132863 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050ae9a2-0047-4ec3-9b71-25baf4b7a66d None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:07.240162 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050ae9a2-0047-4ec3-9b71-25baf4b7a66d None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:07.260269 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:07.260985 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cef1bfb-3203-4991-a70c-cf5fb4e11fcc None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:07.278972 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24eefd4-8328-43b2-bd28-78d734e0d357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:07.279647 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24eefd4-8328-43b2-bd28-78d734e0d357 None admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:07.279939 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24eefd4-8328-43b2-bd28-78d734e0d357 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:07.280222 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24eefd4-8328-43b2-bd28-78d734e0d357 None admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:07.280994 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24eefd4-8328-43b2-bd28-78d734e0d357 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:07.282515 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24eefd4-8328-43b2-bd28-78d734e0d357 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:07.316889 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 54/103] 10.222.0.26 () {60 vars in 1141 bytes} [Fri Jul 1 19:21:07 2022] POST /identity/v3/projects => generated 302 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:21:07.333993 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727fcf72-3090-4e85-af9a-70e4ee8d4db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:07.334948 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727fcf72-3090-4e85-af9a-70e4ee8d4db0 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:07.335247 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727fcf72-3090-4e85-af9a-70e4ee8d4db0 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:07.335532 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727fcf72-3090-4e85-af9a-70e4ee8d4db0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:07.351420 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727fcf72-3090-4e85-af9a-70e4ee8d4db0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:21:07.359587 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-727fcf72-3090-4e85-af9a-70e4ee8d4db0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 01 19:21:07.359587 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:21:07.359587 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:21:07.359587 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:21:07.359587 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:21:07.359587 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:21:07.359587 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:21:07.359587 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:21:07.359587 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:21:07.359587 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:21:07.359587 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:21:07.359587 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:21:07.359587 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:21:07.359587 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:21:07.359587 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:21:07.359587 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:21:07.360428 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:21:07.360428 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:21:07.360428 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:21:07.360428 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:21:07.360428 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:21:07.360428 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:21:07.360428 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:21:07.360428 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:21:07.360428 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:21:07.360428 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:21:07.360428 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:21:07.360428 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:21:07.360428 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:21:07.360428 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:21:07.360428 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:21:07.360428 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:21:07.361199 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:21:07.361199 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:21:07.361199 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:21:07.361199 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:21:07.361199 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:21:07.361199 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:21:07.361199 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:21:07.361199 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:21:07.361199 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:21:07.361199 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:21:07.361199 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 01 19:21:07.361199 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:21:07.361199 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 50/104] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Jul 1 19:21:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:21:07.366971 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24eefd4-8328-43b2-bd28-78d734e0d357 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:07.501195 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24eefd4-8328-43b2-bd28-78d734e0d357 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:07.544502 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5672f2e8-23fc-4772-9c77-0a03fc24a22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:07.545182 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5672f2e8-23fc-4772-9c77-0a03fc24a22b None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:07.545497 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5672f2e8-23fc-4772-9c77-0a03fc24a22b None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:07.545778 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5672f2e8-23fc-4772-9c77-0a03fc24a22b None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:07.547065 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5672f2e8-23fc-4772-9c77-0a03fc24a22b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:07.547381 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5672f2e8-23fc-4772-9c77-0a03fc24a22b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:07.548787 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5672f2e8-23fc-4772-9c77-0a03fc24a22b None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:07.560159 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 55/105] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Jul 1 19:21:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:07.566159 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727fcf72-3090-4e85-af9a-70e4ee8d4db0 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:07.708364 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:07.712191 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727fcf72-3090-4e85-af9a-70e4ee8d4db0 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:07.758254 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d2d6d5-5992-4fba-874f-bec647a2a9ff None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:07.758534 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d2d6d5-5992-4fba-874f-bec647a2a9ff None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:07.758776 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d2d6d5-5992-4fba-874f-bec647a2a9ff None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:07.760392 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 56/106] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:21:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:21:07.761283 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61232a45-42e1-44f8-bcf5-ee2372129615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:07.762190 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61232a45-42e1-44f8-bcf5-ee2372129615 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:07.762481 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61232a45-42e1-44f8-bcf5-ee2372129615 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:07.762762 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61232a45-42e1-44f8-bcf5-ee2372129615 None admin] PATH_INFO: `/v3/users/ea3be7a3ccab4001ad64c40b19728c28` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:07.767844 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d2e488-a5cb-4a80-8564-b0ab6e6a2f55 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:07.768168 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d2e488-a5cb-4a80-8564-b0ab6e6a2f55 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:07.768427 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d2e488-a5cb-4a80-8564-b0ab6e6a2f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:07.783913 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61232a45-42e1-44f8-bcf5-ee2372129615 None admin] RBAC: Authorizing `identity:get_user(user_id=ea3be7a3ccab4001ad64c40b19728c28)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:07.785449 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61232a45-42e1-44f8-bcf5-ee2372129615 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:07.787266 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 51/107] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Jul 1 19:21:07 2022] GET /identity/v3/users/ea3be7a3ccab4001ad64c40b19728c28 => generated 289 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:07.792753 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61232a45-42e1-44f8-bcf5-ee2372129615 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:07.797738 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-13d2e488-a5cb-4a80-8564-b0ab6e6a2f55 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:21:07.798934 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-13d2e488-a5cb-4a80-8564-b0ab6e6a2f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:21:07.835679 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:07.905149 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 57/108] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:21:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 19:21:07.948463 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d2e488-a5cb-4a80-8564-b0ab6e6a2f55 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:07.973679 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61232a45-42e1-44f8-bcf5-ee2372129615 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:08.039046 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe07d7b9-b0c1-4c01-a2ec-98128e5a9405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:08.039628 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe07d7b9-b0c1-4c01-a2ec-98128e5a9405 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:08.039917 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe07d7b9-b0c1-4c01-a2ec-98128e5a9405 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:08.040201 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe07d7b9-b0c1-4c01-a2ec-98128e5a9405 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:08.100968 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:08.139753 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d2e488-a5cb-4a80-8564-b0ab6e6a2f55 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:08.171870 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe07d7b9-b0c1-4c01-a2ec-98128e5a9405 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:08.173486 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe07d7b9-b0c1-4c01-a2ec-98128e5a9405 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:08.198557 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c48b6-92e7-4ab7-be59-dd4dc7fd0e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:08.199495 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c48b6-92e7-4ab7-be59-dd4dc7fd0e82 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:08.199904 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c48b6-92e7-4ab7-be59-dd4dc7fd0e82 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:08.200190 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c48b6-92e7-4ab7-be59-dd4dc7fd0e82 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:08.212349 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1c48b6-92e7-4ab7-be59-dd4dc7fd0e82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:21:08.221527 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-fa1c48b6-92e7-4ab7-be59-dd4dc7fd0e82 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 19:21:08.221527 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:21:08.221527 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:21:08.221527 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:21:08.221527 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:21:08.221527 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:21:08.221527 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:21:08.221527 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:21:08.221527 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:21:08.221527 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:21:08.221527 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:21:08.221527 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:21:08.221527 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:21:08.221527 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:21:08.221527 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:21:08.221527 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:21:08.222620 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:21:08.222620 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:21:08.222620 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:21:08.222620 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:21:08.222620 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:21:08.222620 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:21:08.222620 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:21:08.222620 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:21:08.222620 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:21:08.222620 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:21:08.222620 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:21:08.222620 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:21:08.222620 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:21:08.222620 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:21:08.222620 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:21:08.222620 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:21:08.223588 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:21:08.223588 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:21:08.223588 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:21:08.223588 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:21:08.223588 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:21:08.223588 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:21:08.223588 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:21:08.223588 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:21:08.223588 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:21:08.223588 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:21:08.223588 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 19:21:08.223588 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:21:08.223588 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 58/109] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Jul 1 19:21:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:21:08.232577 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c48b6-92e7-4ab7-be59-dd4dc7fd0e82 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:08.282704 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:08.352777 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 52/110] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Jul 1 19:21:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 19:21:08.358064 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe07d7b9-b0c1-4c01-a2ec-98128e5a9405 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:08.451381 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:08.473480 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c48b6-92e7-4ab7-be59-dd4dc7fd0e82 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:08.509483 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1440652-3bd3-46a2-b853-bdcaae982c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:08.510541 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1440652-3bd3-46a2-b853-bdcaae982c77 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:08.511038 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1440652-3bd3-46a2-b853-bdcaae982c77 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:08.511516 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1440652-3bd3-46a2-b853-bdcaae982c77 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:08.512509 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1440652-3bd3-46a2-b853-bdcaae982c77 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:08.513076 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1440652-3bd3-46a2-b853-bdcaae982c77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:08.514672 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1440652-3bd3-46a2-b853-bdcaae982c77 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:08.516881 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe07d7b9-b0c1-4c01-a2ec-98128e5a9405 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:08.523833 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 59/111] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Jul 1 19:21:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:08.525487 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d8619-5b4e-4415-bb10-8d829681618a None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:08.526008 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d8619-5b4e-4415-bb10-8d829681618a None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:08.526487 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d8619-5b4e-4415-bb10-8d829681618a None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:08.528167 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 60/112] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:21:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:21:08.529061 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d8619-5b4e-4415-bb10-8d829681618a None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:08.591187 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be52eea3-5df2-48ab-85a7-ab5f09646bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:08.592062 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be52eea3-5df2-48ab-85a7-ab5f09646bd4 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:08.592394 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be52eea3-5df2-48ab-85a7-ab5f09646bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:08.592630 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be52eea3-5df2-48ab-85a7-ab5f09646bd4 None admin] PATH_INFO: `/v3/projects/9260fc0eba4449f190981e3ec5a011ad` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:08.598088 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be52eea3-5df2-48ab-85a7-ab5f09646bd4 None admin] RBAC: Authorizing `identity:get_project(project_id=9260fc0eba4449f190981e3ec5a011ad)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:08.599490 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be52eea3-5df2-48ab-85a7-ab5f09646bd4 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:08.601542 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 53/113] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Jul 1 19:21:08 2022] GET /identity/v3/projects/9260fc0eba4449f190981e3ec5a011ad => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:08.602717 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf0930-8cfc-4d55-b045-1e60b744c881 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:08.603070 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf0930-8cfc-4d55-b045-1e60b744c881 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:08.603301 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf0930-8cfc-4d55-b045-1e60b744c881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:08.638377 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-6fdf0930-8cfc-4d55-b045-1e60b744c881 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:21:08.639539 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-6fdf0930-8cfc-4d55-b045-1e60b744c881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:21:08.649618 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:08.661826 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d8619-5b4e-4415-bb10-8d829681618a None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:08.726821 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46614371-e51c-4f2f-a3a5-24ddaac799ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:08.728057 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46614371-e51c-4f2f-a3a5-24ddaac799ef None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:08.728568 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46614371-e51c-4f2f-a3a5-24ddaac799ef None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:08.729042 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46614371-e51c-4f2f-a3a5-24ddaac799ef None admin] PATH_INFO: `/v3/users/076da96929604363947a23159f348388` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:08.731825 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46614371-e51c-4f2f-a3a5-24ddaac799ef None admin] RBAC: Authorizing `identity:get_user(user_id=076da96929604363947a23159f348388)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:08.735347 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46614371-e51c-4f2f-a3a5-24ddaac799ef None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:08.738183 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 61/114] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Jul 1 19:21:08 2022] GET /identity/v3/users/076da96929604363947a23159f348388 => generated 275 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:08.740578 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46614371-e51c-4f2f-a3a5-24ddaac799ef None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:08.765180 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 54/115] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:21:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:21:08.771012 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdf0930-8cfc-4d55-b045-1e60b744c881 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:08.853696 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:08.880240 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46614371-e51c-4f2f-a3a5-24ddaac799ef None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:08.904699 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdf0930-8cfc-4d55-b045-1e60b744c881 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:08.925648 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff075a7-54a5-45fd-9780-b337aca0ceca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:08.926662 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff075a7-54a5-45fd-9780-b337aca0ceca None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:08.926970 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff075a7-54a5-45fd-9780-b337aca0ceca None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:08.927256 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff075a7-54a5-45fd-9780-b337aca0ceca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:08.928109 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff075a7-54a5-45fd-9780-b337aca0ceca None admin] RBAC: Adding query filter params (role.id=f4f5eb791e8749f18c9d57c113558e15, scope.project.id=9260fc0eba4449f190981e3ec5a011ad, user.id=ea3be7a3ccab4001ad64c40b19728c28) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:08.928428 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff075a7-54a5-45fd-9780-b337aca0ceca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:08.930167 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff075a7-54a5-45fd-9780-b337aca0ceca None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:08.941266 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 62/116] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Jul 1 19:21:08 2022] GET /identity/v3/role_assignments?user.id=ea3be7a3ccab4001ad64c40b19728c28&scope.project.id=9260fc0eba4449f190981e3ec5a011ad&role.id=f4f5eb791e8749f18c9d57c113558e15 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:08.941266 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8facec7b-8588-4fc9-9454-190a1b7b045c None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:08.941266 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8facec7b-8588-4fc9-9454-190a1b7b045c None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:08.941266 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8facec7b-8588-4fc9-9454-190a1b7b045c None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:08.941266 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 63/117] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:21:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:21:08.941695 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8facec7b-8588-4fc9-9454-190a1b7b045c None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:08.950720 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa7da5-faaf-4fdf-b6cb-ed6a077e1824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:08.951610 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa7da5-faaf-4fdf-b6cb-ed6a077e1824 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:08.951897 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa7da5-faaf-4fdf-b6cb-ed6a077e1824 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:08.952179 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa7da5-faaf-4fdf-b6cb-ed6a077e1824 None admin] PATH_INFO: `/v3/projects/9260fc0eba4449f190981e3ec5a011ad` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:08.958285 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daa7da5-faaf-4fdf-b6cb-ed6a077e1824 None admin] RBAC: Authorizing `identity:get_project(project_id=9260fc0eba4449f190981e3ec5a011ad)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:08.960376 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daa7da5-faaf-4fdf-b6cb-ed6a077e1824 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:08.962710 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 55/118] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Jul 1 19:21:08 2022] GET /identity/v3/projects/9260fc0eba4449f190981e3ec5a011ad => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:08.964254 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b13381c-d64e-401f-b9f0-72fedd0af972 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:08.964819 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b13381c-d64e-401f-b9f0-72fedd0af972 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:08.965322 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b13381c-d64e-401f-b9f0-72fedd0af972 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:08.966925 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 56/119] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:21:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:21:08.968992 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43293401-56db-434b-bb16-6e9ae18b5c80 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:08.969526 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43293401-56db-434b-bb16-6e9ae18b5c80 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:08.969981 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43293401-56db-434b-bb16-6e9ae18b5c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:08.981967 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:08.989875 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-43293401-56db-434b-bb16-6e9ae18b5c80 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:21:08.991936 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-43293401-56db-434b-bb16-6e9ae18b5c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:21:09.078503 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 57/120] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:21:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:21:09.085656 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43293401-56db-434b-bb16-6e9ae18b5c80 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:09.108563 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8facec7b-8588-4fc9-9454-190a1b7b045c None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:09.153344 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bbef27-55e4-41d3-baab-5c3c5bb15842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:09.154178 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:09.156532 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bbef27-55e4-41d3-baab-5c3c5bb15842 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:09.157362 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bbef27-55e4-41d3-baab-5c3c5bb15842 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:09.157829 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bbef27-55e4-41d3-baab-5c3c5bb15842 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:09.173656 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bbef27-55e4-41d3-baab-5c3c5bb15842 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:21:09.183575 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-f6bbef27-55e4-41d3-baab-5c3c5bb15842 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:21:09.183575 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:21:09.183575 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:21:09.183575 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:21:09.183575 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:21:09.183575 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:21:09.183575 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:21:09.183575 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:21:09.183575 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:21:09.183575 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:21:09.183575 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:21:09.183575 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:21:09.183575 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:21:09.183575 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:21:09.183575 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:21:09.183575 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:21:09.184644 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:21:09.184644 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:21:09.184644 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:21:09.184644 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:21:09.184644 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:21:09.184644 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:21:09.184644 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:21:09.184644 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:21:09.184644 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:21:09.184644 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:21:09.184644 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:21:09.184644 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:21:09.184644 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:21:09.184644 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:21:09.184644 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:21:09.184644 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:21:09.185585 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:21:09.185585 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:21:09.185585 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:21:09.185585 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:21:09.185585 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:21:09.185585 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:21:09.185585 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:21:09.185585 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:21:09.185585 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:21:09.185585 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:21:09.185585 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:21:09.185585 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:21:09.186591 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 64/121] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Jul 1 19:21:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:21:09.188743 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b02bd-9daa-4877-be06-3240e5b089e9 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:09.190122 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b02bd-9daa-4877-be06-3240e5b089e9 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:09.190613 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b02bd-9daa-4877-be06-3240e5b089e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:09.211342 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43293401-56db-434b-bb16-6e9ae18b5c80 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:09.217834 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-4f0b02bd-9daa-4877-be06-3240e5b089e9 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:21:09.220330 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-4f0b02bd-9daa-4877-be06-3240e5b089e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:21:09.249621 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe827e60-c3d0-40d5-8845-0bc0ff43a798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:09.250517 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe827e60-c3d0-40d5-8845-0bc0ff43a798 None admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:09.250922 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe827e60-c3d0-40d5-8845-0bc0ff43a798 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:09.251197 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe827e60-c3d0-40d5-8845-0bc0ff43a798 None admin] PATH_INFO: `/v3/projects/9260fc0eba4449f190981e3ec5a011ad/users/076da96929604363947a23159f348388/roles/dd71f7898e6a4d9f99d1554dd7d27033` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:09.253560 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe827e60-c3d0-40d5-8845-0bc0ff43a798 None admin] RBAC: Authorizing `identity:create_grant(project_id=9260fc0eba4449f190981e3ec5a011ad, user_id=076da96929604363947a23159f348388, role_id=dd71f7898e6a4d9f99d1554dd7d27033)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:09.255066 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe827e60-c3d0-40d5-8845-0bc0ff43a798 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:09.271792 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 58/122] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Jul 1 19:21:09 2022] PUT /identity/v3/projects/9260fc0eba4449f190981e3ec5a011ad/users/076da96929604363947a23159f348388/roles/dd71f7898e6a4d9f99d1554dd7d27033 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:21:09.279452 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe827e60-c3d0-40d5-8845-0bc0ff43a798 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:09.337777 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 65/123] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:21:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:21:09.339922 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0b02bd-9daa-4877-be06-3240e5b089e9 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:09.355304 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:09.453384 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe827e60-c3d0-40d5-8845-0bc0ff43a798 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:09.469864 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:09.493068 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34383d07-1ec4-47d1-8132-71f8f4d2e5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:09.494248 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34383d07-1ec4-47d1-8132-71f8f4d2e5a2 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:09.494753 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34383d07-1ec4-47d1-8132-71f8f4d2e5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:09.495230 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34383d07-1ec4-47d1-8132-71f8f4d2e5a2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:09.513552 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34383d07-1ec4-47d1-8132-71f8f4d2e5a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:21:09.522127 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-34383d07-1ec4-47d1-8132-71f8f4d2e5a2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 01 19:21:09.522127 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:21:09.522127 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:21:09.522127 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:21:09.522127 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:21:09.522127 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:21:09.522127 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:21:09.522127 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:21:09.522127 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:21:09.522127 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:21:09.522127 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:21:09.522127 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:21:09.522127 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:21:09.522127 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:21:09.522127 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:21:09.522127 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:21:09.522989 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:21:09.522989 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:21:09.522989 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:21:09.522989 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:21:09.522989 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:21:09.522989 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:21:09.522989 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:21:09.522989 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:21:09.522989 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:21:09.522989 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:21:09.522989 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:21:09.522989 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:21:09.522989 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:21:09.522989 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:21:09.522989 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:21:09.522989 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:21:09.523763 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:21:09.523763 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:21:09.523763 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:21:09.523763 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:21:09.523763 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:21:09.523763 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:21:09.523763 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:21:09.523763 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:21:09.523763 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:21:09.523763 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:21:09.523763 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 01 19:21:09.523763 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:21:09.523763 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 59/124] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Jul 1 19:21:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:21:09.524387 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34383d07-1ec4-47d1-8132-71f8f4d2e5a2 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:09.552490 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0b02bd-9daa-4877-be06-3240e5b089e9 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:09.618337 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778e8f30-4838-4743-9a44-2c11886f94a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:09.619020 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e8f30-4838-4743-9a44-2c11886f94a0 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:09.619306 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e8f30-4838-4743-9a44-2c11886f94a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:09.619584 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e8f30-4838-4743-9a44-2c11886f94a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:09.620337 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778e8f30-4838-4743-9a44-2c11886f94a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:09.620646 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778e8f30-4838-4743-9a44-2c11886f94a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:09.622062 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778e8f30-4838-4743-9a44-2c11886f94a0 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:09.650702 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 66/125] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Jul 1 19:21:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:09.651478 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778e8f30-4838-4743-9a44-2c11886f94a0 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:09.727949 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34383d07-1ec4-47d1-8132-71f8f4d2e5a2 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:09.748298 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:09.789352 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778e8f30-4838-4743-9a44-2c11886f94a0 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:09.817959 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc7ccf1-6b19-45cf-9598-9e016d11045c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:09.819326 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7ccf1-6b19-45cf-9598-9e016d11045c None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:09.819824 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7ccf1-6b19-45cf-9598-9e016d11045c None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:09.820351 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7ccf1-6b19-45cf-9598-9e016d11045c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:09.829317 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5fefb2-92bb-4265-9f1a-53d15c17a681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:09.830097 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5fefb2-92bb-4265-9f1a-53d15c17a681 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:09.830392 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5fefb2-92bb-4265-9f1a-53d15c17a681 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:09.830677 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5fefb2-92bb-4265-9f1a-53d15c17a681 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:09.833182 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5fefb2-92bb-4265-9f1a-53d15c17a681 None admin] RBAC: Adding query filter params (name=member) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:09.833546 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5fefb2-92bb-4265-9f1a-53d15c17a681 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:09.836317 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5fefb2-92bb-4265-9f1a-53d15c17a681 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:09.847368 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc7ccf1-6b19-45cf-9598-9e016d11045c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:21:09.856024 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 67/126] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Jul 1 19:21:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:09.860085 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5fefb2-92bb-4265-9f1a-53d15c17a681 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:09.862695 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-3dc7ccf1-6b19-45cf-9598-9e016d11045c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 01 19:21:09.862695 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:21:09.862695 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:21:09.862695 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:21:09.862695 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:21:09.862695 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:21:09.862695 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:21:09.862695 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:21:09.862695 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:21:09.862695 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:21:09.862695 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:21:09.862695 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:21:09.862695 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:21:09.862695 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:21:09.862695 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:21:09.862695 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:21:09.863660 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:21:09.863660 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:21:09.863660 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:21:09.863660 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:21:09.863660 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:21:09.863660 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:21:09.863660 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:21:09.863660 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:21:09.863660 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:21:09.863660 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:21:09.863660 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:21:09.863660 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:21:09.863660 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:21:09.863660 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:21:09.863660 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:21:09.863660 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:21:09.864466 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:21:09.864466 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:21:09.864466 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:21:09.864466 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:21:09.864466 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:21:09.864466 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:21:09.864466 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:21:09.864466 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:21:09.864466 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:21:09.864466 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:21:09.864466 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 01 19:21:09.864466 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:21:09.870011 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 60/127] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Jul 1 19:21:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:21:09.871312 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc7ccf1-6b19-45cf-9598-9e016d11045c None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:09.937836 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:10.003509 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5fefb2-92bb-4265-9f1a-53d15c17a681 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:10.008162 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc7ccf1-6b19-45cf-9598-9e016d11045c None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:10.036853 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:10.043697 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d031b455-830d-4b1d-b1c8-72d6dd9707c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:10.044717 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d031b455-830d-4b1d-b1c8-72d6dd9707c3 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:10.045115 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d031b455-830d-4b1d-b1c8-72d6dd9707c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:10.045559 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d031b455-830d-4b1d-b1c8-72d6dd9707c3 None admin] PATH_INFO: `/v3/users/ce82020368de483a9fa05847543c000f` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:10.050531 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d031b455-830d-4b1d-b1c8-72d6dd9707c3 None admin] RBAC: Authorizing `identity:get_user(user_id=ce82020368de483a9fa05847543c000f)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:10.052003 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d031b455-830d-4b1d-b1c8-72d6dd9707c3 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:10.056863 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe9cfd-0901-4735-aa0d-8fba3f4a092e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:10.057778 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe9cfd-0901-4735-aa0d-8fba3f4a092e None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:10.058075 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe9cfd-0901-4735-aa0d-8fba3f4a092e None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:10.058360 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe9cfd-0901-4735-aa0d-8fba3f4a092e None admin] PATH_INFO: `/v3/users/076da96929604363947a23159f348388` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:10.059486 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 68/128] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Jul 1 19:21:09 2022] GET /identity/v3/users/ce82020368de483a9fa05847543c000f => generated 247 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:10.060273 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d031b455-830d-4b1d-b1c8-72d6dd9707c3 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:10.068966 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fe9cfd-0901-4735-aa0d-8fba3f4a092e None admin] RBAC: Authorizing `identity:get_user(user_id=076da96929604363947a23159f348388)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:10.070588 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fe9cfd-0901-4735-aa0d-8fba3f4a092e None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:10.072617 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 61/129] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Jul 1 19:21:09 2022] GET /identity/v3/users/076da96929604363947a23159f348388 => generated 275 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:10.073540 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe9cfd-0901-4735-aa0d-8fba3f4a092e None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:10.187421 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d031b455-830d-4b1d-b1c8-72d6dd9707c3 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:10.222974 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe9cfd-0901-4735-aa0d-8fba3f4a092e None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:10.226053 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:10.231289 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3be04a0-e6ae-40f8-ae5c-cae3c40ebea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:10.231981 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be04a0-e6ae-40f8-ae5c-cae3c40ebea5 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:10.232257 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be04a0-e6ae-40f8-ae5c-cae3c40ebea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:10.232535 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be04a0-e6ae-40f8-ae5c-cae3c40ebea5 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:10.233320 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3be04a0-e6ae-40f8-ae5c-cae3c40ebea5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:10.233638 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3be04a0-e6ae-40f8-ae5c-cae3c40ebea5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:10.236045 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3be04a0-e6ae-40f8-ae5c-cae3c40ebea5 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:10.246699 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 69/130] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Jul 1 19:21:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:10.252085 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3be04a0-e6ae-40f8-ae5c-cae3c40ebea5 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:10.269373 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635dff85-0765-4084-ad1e-a3aff443346f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:10.271298 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635dff85-0765-4084-ad1e-a3aff443346f None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:10.271802 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635dff85-0765-4084-ad1e-a3aff443346f None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:10.272522 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635dff85-0765-4084-ad1e-a3aff443346f None admin] PATH_INFO: `/v3/projects/9260fc0eba4449f190981e3ec5a011ad` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:10.274380 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635dff85-0765-4084-ad1e-a3aff443346f None admin] RBAC: Authorizing `identity:get_project(project_id=9260fc0eba4449f190981e3ec5a011ad)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:10.276591 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635dff85-0765-4084-ad1e-a3aff443346f None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:10.279822 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 62/131] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Jul 1 19:21:10 2022] GET /identity/v3/projects/9260fc0eba4449f190981e3ec5a011ad => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:10.282553 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8f8fb-b7b8-427a-942b-02c1716e5d89 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:10.283418 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8f8fb-b7b8-427a-942b-02c1716e5d89 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:10.284257 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8f8fb-b7b8-427a-942b-02c1716e5d89 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:10.286785 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 63/132] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:21:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:21:10.287723 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8f8fb-b7b8-427a-942b-02c1716e5d89 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:10.322739 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:10.370612 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3be04a0-e6ae-40f8-ae5c-cae3c40ebea5 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:10.407328 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a77f3c0-71d8-4520-8bab-dbbfb07203bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:10.408343 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77f3c0-71d8-4520-8bab-dbbfb07203bf None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:10.408628 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77f3c0-71d8-4520-8bab-dbbfb07203bf None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:10.408907 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77f3c0-71d8-4520-8bab-dbbfb07203bf None admin] PATH_INFO: `/v3/projects/9260fc0eba4449f190981e3ec5a011ad` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:10.410406 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a77f3c0-71d8-4520-8bab-dbbfb07203bf None admin] RBAC: Authorizing `identity:get_project(project_id=9260fc0eba4449f190981e3ec5a011ad)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:10.411863 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a77f3c0-71d8-4520-8bab-dbbfb07203bf None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:10.414059 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 70/133] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Jul 1 19:21:10 2022] GET /identity/v3/projects/9260fc0eba4449f190981e3ec5a011ad => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:10.415048 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a77f3c0-71d8-4520-8bab-dbbfb07203bf None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:10.429752 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8f8fb-b7b8-427a-942b-02c1716e5d89 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:10.475409 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb8b62f-3d59-43a0-a491-8c06a2712b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:10.476910 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8b62f-3d59-43a0-a491-8c06a2712b72 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:10.477877 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8b62f-3d59-43a0-a491-8c06a2712b72 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:10.478422 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8b62f-3d59-43a0-a491-8c06a2712b72 None admin] PATH_INFO: `/v3/users/076da96929604363947a23159f348388` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:10.479850 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb8b62f-3d59-43a0-a491-8c06a2712b72 None admin] RBAC: Authorizing `identity:get_user(user_id=076da96929604363947a23159f348388)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:10.482521 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb8b62f-3d59-43a0-a491-8c06a2712b72 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:10.486254 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 64/134] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Jul 1 19:21:10 2022] GET /identity/v3/users/076da96929604363947a23159f348388 => generated 275 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:10.487854 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416ac5f-858d-4f6e-9a01-6a2656811716 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:10.488451 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416ac5f-858d-4f6e-9a01-6a2656811716 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:10.488935 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416ac5f-858d-4f6e-9a01-6a2656811716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:10.511291 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-6416ac5f-858d-4f6e-9a01-6a2656811716 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:21:10.513279 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-6416ac5f-858d-4f6e-9a01-6a2656811716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:21:10.540413 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a77f3c0-71d8-4520-8bab-dbbfb07203bf None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:10.554858 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:10.572556 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:10.584830 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da80070f-396e-41d5-b295-85a1a58ed9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:10.585831 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da80070f-396e-41d5-b295-85a1a58ed9de None admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:10.586114 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da80070f-396e-41d5-b295-85a1a58ed9de None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:10.586396 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da80070f-396e-41d5-b295-85a1a58ed9de None admin] PATH_INFO: `/v3/projects/9260fc0eba4449f190981e3ec5a011ad/users/ce82020368de483a9fa05847543c000f/roles/6cb03785fb184ef587509b3174622f69` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:10.588669 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da80070f-396e-41d5-b295-85a1a58ed9de None admin] RBAC: Authorizing `identity:create_grant(project_id=9260fc0eba4449f190981e3ec5a011ad, user_id=ce82020368de483a9fa05847543c000f, role_id=6cb03785fb184ef587509b3174622f69)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:10.590589 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da80070f-396e-41d5-b295-85a1a58ed9de None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:10.608721 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 65/135] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:21:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:21:10.608894 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 71/136] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Jul 1 19:21:10 2022] PUT /identity/v3/projects/9260fc0eba4449f190981e3ec5a011ad/users/ce82020368de483a9fa05847543c000f/roles/6cb03785fb184ef587509b3174622f69 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:21:10.610047 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6416ac5f-858d-4f6e-9a01-6a2656811716 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:10.614105 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da80070f-396e-41d5-b295-85a1a58ed9de None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:10.758335 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6416ac5f-858d-4f6e-9a01-6a2656811716 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:10.803165 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9f8777-755a-4200-9c8a-6c689b3f405c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:10.805134 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f8777-755a-4200-9c8a-6c689b3f405c None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:10.806172 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f8777-755a-4200-9c8a-6c689b3f405c None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:10.806172 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f8777-755a-4200-9c8a-6c689b3f405c None admin] PATH_INFO: `/v3/projects/1505be130f184ead97ccbacb96223727` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:10.807819 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9f8777-755a-4200-9c8a-6c689b3f405c None admin] RBAC: Authorizing `identity:get_project(project_id=1505be130f184ead97ccbacb96223727)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:10.809547 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9f8777-755a-4200-9c8a-6c689b3f405c None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:10.812095 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 66/137] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Jul 1 19:21:10 2022] GET /identity/v3/projects/1505be130f184ead97ccbacb96223727 => generated 312 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:10.812709 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9f8777-755a-4200-9c8a-6c689b3f405c None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:10.813078 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da80070f-396e-41d5-b295-85a1a58ed9de None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:10.856388 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a4027c-fd98-45f9-820f-01f01d7519e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:10.857422 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4027c-fd98-45f9-820f-01f01d7519e0 None admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:10.857787 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4027c-fd98-45f9-820f-01f01d7519e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:10.858168 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4027c-fd98-45f9-820f-01f01d7519e0 None admin] PATH_INFO: `/v3/projects/9260fc0eba4449f190981e3ec5a011ad/users/076da96929604363947a23159f348388/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:10.860298 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a4027c-fd98-45f9-820f-01f01d7519e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=9260fc0eba4449f190981e3ec5a011ad, user_id=076da96929604363947a23159f348388, role_id=4cbf6ec846eb4b7c8cc52e9bfd6f076f)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:10.861902 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a4027c-fd98-45f9-820f-01f01d7519e0 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:10.864295 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:10.888639 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 72/138] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Jul 1 19:21:10 2022] PUT /identity/v3/projects/9260fc0eba4449f190981e3ec5a011ad/users/076da96929604363947a23159f348388/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:21:10.889557 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a4027c-fd98-45f9-820f-01f01d7519e0 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:11.003947 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9f8777-755a-4200-9c8a-6c689b3f405c None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:11.005607 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:11.071418 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6b65de-41e3-4a22-8212-c092c2f0ddb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:11.072207 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b65de-41e3-4a22-8212-c092c2f0ddb0 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:11.072504 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b65de-41e3-4a22-8212-c092c2f0ddb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:11.072788 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b65de-41e3-4a22-8212-c092c2f0ddb0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:11.078698 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6b65de-41e3-4a22-8212-c092c2f0ddb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:11.080235 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6b65de-41e3-4a22-8212-c092c2f0ddb0 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:11.082241 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 67/139] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:21:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:11.088707 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6b65de-41e3-4a22-8212-c092c2f0ddb0 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:11.105595 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a4027c-fd98-45f9-820f-01f01d7519e0 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:11.163777 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee1a544-2ca5-4c80-8a39-6617bfe005ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:11.164702 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee1a544-2ca5-4c80-8a39-6617bfe005ec None admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:11.164987 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee1a544-2ca5-4c80-8a39-6617bfe005ec None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:11.165316 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee1a544-2ca5-4c80-8a39-6617bfe005ec None admin] PATH_INFO: `/v3/projects/1505be130f184ead97ccbacb96223727/users/076da96929604363947a23159f348388/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:11.167537 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee1a544-2ca5-4c80-8a39-6617bfe005ec None admin] RBAC: Authorizing `identity:create_grant(project_id=1505be130f184ead97ccbacb96223727, user_id=076da96929604363947a23159f348388, role_id=4cbf6ec846eb4b7c8cc52e9bfd6f076f)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:11.169000 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee1a544-2ca5-4c80-8a39-6617bfe005ec None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:11.200453 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 73/140] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Jul 1 19:21:10 2022] PUT /identity/v3/projects/1505be130f184ead97ccbacb96223727/users/076da96929604363947a23159f348388/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:21:11.237611 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6b65de-41e3-4a22-8212-c092c2f0ddb0 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:11.243247 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:11.282819 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2251cff3-57bc-43e8-8f62-7305a44bb608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:11.283577 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2251cff3-57bc-43e8-8f62-7305a44bb608 None admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:11.283868 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2251cff3-57bc-43e8-8f62-7305a44bb608 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:11.284205 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2251cff3-57bc-43e8-8f62-7305a44bb608 None admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:11.284954 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2251cff3-57bc-43e8-8f62-7305a44bb608 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:11.286704 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2251cff3-57bc-43e8-8f62-7305a44bb608 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:11.311527 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 68/141] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Jul 1 19:21:11 2022] POST /identity/v3/users => generated 283 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:21:11.355234 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc869b74-89af-4fe3-bfcb-898bbad349b1 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:11.355543 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc869b74-89af-4fe3-bfcb-898bbad349b1 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:11.355735 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc869b74-89af-4fe3-bfcb-898bbad349b1 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:11.357611 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 74/142] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:21:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:21:11.364845 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d84841-5f29-4e6c-8465-463776718597 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:11.365157 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d84841-5f29-4e6c-8465-463776718597 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:11.365445 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d84841-5f29-4e6c-8465-463776718597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:11.387170 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-f9d84841-5f29-4e6c-8465-463776718597 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:21:11.388420 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-f9d84841-5f29-4e6c-8465-463776718597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:21:11.469323 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 69/143] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:21:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:21:11.503913 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc869b74-89af-4fe3-bfcb-898bbad349b1 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:11.655067 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc869b74-89af-4fe3-bfcb-898bbad349b1 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:11.669653 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:11.705182 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6626b7-bb40-46a2-9d30-567d4d441a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:11.706242 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6626b7-bb40-46a2-9d30-567d4d441a80 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:11.706673 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6626b7-bb40-46a2-9d30-567d4d441a80 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:11.707121 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6626b7-bb40-46a2-9d30-567d4d441a80 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:11.726179 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6626b7-bb40-46a2-9d30-567d4d441a80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:21:11.734879 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-ab6626b7-bb40-46a2-9d30-567d4d441a80 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 01 19:21:11.734879 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:21:11.734879 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:21:11.734879 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:21:11.734879 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:21:11.734879 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:21:11.734879 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:21:11.734879 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:21:11.734879 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:21:11.734879 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:21:11.734879 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:21:11.734879 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:21:11.734879 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:21:11.734879 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:21:11.734879 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:21:11.734879 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:21:11.735919 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:21:11.735919 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:21:11.735919 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:21:11.735919 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:21:11.735919 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:21:11.735919 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:21:11.735919 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:21:11.735919 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:21:11.735919 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:21:11.735919 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:21:11.735919 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:21:11.735919 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:21:11.735919 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:21:11.735919 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:21:11.735919 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:21:11.735919 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:21:11.736913 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:21:11.736913 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:21:11.736913 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:21:11.736913 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:21:11.736913 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:21:11.736913 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:21:11.736913 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:21:11.736913 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:21:11.736913 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:21:11.736913 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:21:11.736913 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 01 19:21:11.736913 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:21:11.739035 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 75/144] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Jul 1 19:21:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:21:11.744941 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d84841-5f29-4e6c-8465-463776718597 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:11.876101 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:11.886980 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d84841-5f29-4e6c-8465-463776718597 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:11.927641 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44211305-f3dc-4b8f-83cb-1551df12f4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:11.928240 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44211305-f3dc-4b8f-83cb-1551df12f4c3 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:11.928524 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44211305-f3dc-4b8f-83cb-1551df12f4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:11.929060 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44211305-f3dc-4b8f-83cb-1551df12f4c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:11.929874 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44211305-f3dc-4b8f-83cb-1551df12f4c3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:11.930185 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44211305-f3dc-4b8f-83cb-1551df12f4c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:11.931641 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44211305-f3dc-4b8f-83cb-1551df12f4c3 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:11.941942 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 70/145] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Jul 1 19:21:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:11.947743 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6626b7-bb40-46a2-9d30-567d4d441a80 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:11.998044 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18d2ce-4ca2-41f6-aab7-f91f3a7e9637 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:11.998400 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18d2ce-4ca2-41f6-aab7-f91f3a7e9637 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:11.998690 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18d2ce-4ca2-41f6-aab7-f91f3a7e9637 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:12.000423 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 71/146] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:21:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:21:12.005582 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff214fd0-29d3-4f26-aa3e-34cad156c4b9 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:12.005875 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff214fd0-29d3-4f26-aa3e-34cad156c4b9 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:12.006156 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff214fd0-29d3-4f26-aa3e-34cad156c4b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:12.031887 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-ff214fd0-29d3-4f26-aa3e-34cad156c4b9 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:21:12.033417 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-ff214fd0-29d3-4f26-aa3e-34cad156c4b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:21:12.125462 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 72/147] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:21:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:21:12.145061 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6626b7-bb40-46a2-9d30-567d4d441a80 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:12.154468 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff214fd0-29d3-4f26-aa3e-34cad156c4b9 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:12.215213 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a816e-c878-4465-ad34-e21649f19eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:12.216333 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a816e-c878-4465-ad34-e21649f19eac None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:12.216784 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a816e-c878-4465-ad34-e21649f19eac None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:12.217215 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a816e-c878-4465-ad34-e21649f19eac None admin] PATH_INFO: `/v3/users/ea3be7a3ccab4001ad64c40b19728c28` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:12.223978 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6a816e-c878-4465-ad34-e21649f19eac None admin] RBAC: Authorizing `identity:get_user(user_id=ea3be7a3ccab4001ad64c40b19728c28)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:12.225692 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6a816e-c878-4465-ad34-e21649f19eac None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:12.227883 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 76/148] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Jul 1 19:21:11 2022] GET /identity/v3/users/ea3be7a3ccab4001ad64c40b19728c28 => generated 289 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:12.240218 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a816e-c878-4465-ad34-e21649f19eac None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:12.313422 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:12.324028 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:12.357698 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff214fd0-29d3-4f26-aa3e-34cad156c4b9 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:12.420188 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a816e-c878-4465-ad34-e21649f19eac None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:12.423784 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b071fb9a-55d6-4033-bc28-8b5e965fb97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:12.424610 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071fb9a-55d6-4033-bc28-8b5e965fb97f None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:12.424896 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071fb9a-55d6-4033-bc28-8b5e965fb97f None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:12.425177 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071fb9a-55d6-4033-bc28-8b5e965fb97f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:12.446870 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b071fb9a-55d6-4033-bc28-8b5e965fb97f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:21:12.460865 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22af877c-ebad-4d7d-b69b-1027b1efc2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:12.461759 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af877c-ebad-4d7d-b69b-1027b1efc2b1 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:12.462042 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af877c-ebad-4d7d-b69b-1027b1efc2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:12.462319 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af877c-ebad-4d7d-b69b-1027b1efc2b1 None admin] PATH_INFO: `/v3/projects/9260fc0eba4449f190981e3ec5a011ad` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:12.462803 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-b071fb9a-55d6-4033-bc28-8b5e965fb97f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 19:21:12.462803 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:21:12.462803 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:21:12.462803 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:21:12.462803 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:21:12.462803 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:21:12.462803 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:21:12.462803 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:21:12.462803 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:21:12.462803 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:21:12.462803 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:21:12.462803 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:21:12.462803 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:21:12.462803 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:21:12.462803 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:21:12.462803 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:21:12.463668 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:21:12.463668 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:21:12.463668 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:21:12.463668 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:21:12.463668 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:21:12.463668 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:21:12.463668 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:21:12.463668 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:21:12.463668 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:21:12.463668 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:21:12.463668 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:21:12.463668 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:21:12.463668 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:21:12.463668 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:21:12.463668 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:21:12.463668 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:21:12.465024 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:21:12.465024 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:21:12.465024 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:21:12.465024 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:21:12.465024 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:21:12.465024 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:21:12.465024 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:21:12.465024 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:21:12.465024 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:21:12.465024 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:21:12.465024 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 19:21:12.465024 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:21:12.465729 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22af877c-ebad-4d7d-b69b-1027b1efc2b1 None admin] RBAC: Authorizing `identity:get_project(project_id=9260fc0eba4449f190981e3ec5a011ad)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:12.465820 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 73/149] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Jul 1 19:21:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:21:12.465893 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22af877c-ebad-4d7d-b69b-1027b1efc2b1 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:12.467033 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 77/150] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Jul 1 19:21:12 2022] GET /identity/v3/projects/9260fc0eba4449f190981e3ec5a011ad => generated 298 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:12.473359 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22af877c-ebad-4d7d-b69b-1027b1efc2b1 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:12.473589 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b071fb9a-55d6-4033-bc28-8b5e965fb97f None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:12.660002 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b071fb9a-55d6-4033-bc28-8b5e965fb97f None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:12.682120 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22af877c-ebad-4d7d-b69b-1027b1efc2b1 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:12.690243 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:12.726823 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4ffef7-f4ad-4770-8934-8f58d926157c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:12.727428 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ffef7-f4ad-4770-8934-8f58d926157c None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:12.727710 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ffef7-f4ad-4770-8934-8f58d926157c None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:12.727986 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ffef7-f4ad-4770-8934-8f58d926157c None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:12.728742 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4ffef7-f4ad-4770-8934-8f58d926157c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:12.729049 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4ffef7-f4ad-4770-8934-8f58d926157c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:12.730779 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4ffef7-f4ad-4770-8934-8f58d926157c None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:12.743599 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 74/151] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Jul 1 19:21:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:21:12.748171 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a217ef-4ba9-4b5a-9afe-477acc470de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:12.749100 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a217ef-4ba9-4b5a-9afe-477acc470de7 None admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:12.749944 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a217ef-4ba9-4b5a-9afe-477acc470de7 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:12.750225 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a217ef-4ba9-4b5a-9afe-477acc470de7 None admin] PATH_INFO: `/v3/projects/9260fc0eba4449f190981e3ec5a011ad/users/ea3be7a3ccab4001ad64c40b19728c28/roles/f4f5eb791e8749f18c9d57c113558e15` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:12.752206 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a217ef-4ba9-4b5a-9afe-477acc470de7 None admin] RBAC: Authorizing `identity:create_grant(project_id=9260fc0eba4449f190981e3ec5a011ad, user_id=ea3be7a3ccab4001ad64c40b19728c28, role_id=f4f5eb791e8749f18c9d57c113558e15)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:12.753693 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a217ef-4ba9-4b5a-9afe-477acc470de7 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:12.761892 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4ffef7-f4ad-4770-8934-8f58d926157c None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:12.770634 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:12.784614 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 78/152] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Jul 1 19:21:12 2022] PUT /identity/v3/projects/9260fc0eba4449f190981e3ec5a011ad/users/ea3be7a3ccab4001ad64c40b19728c28/roles/f4f5eb791e8749f18c9d57c113558e15 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:21:12.900244 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4ffef7-f4ad-4770-8934-8f58d926157c None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:12.940315 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fc9906-a052-4b67-875f-b31aca93c606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:12.941284 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc9906-a052-4b67-875f-b31aca93c606 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:12.941577 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc9906-a052-4b67-875f-b31aca93c606 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:12.941854 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc9906-a052-4b67-875f-b31aca93c606 None admin] PATH_INFO: `/v3/users/076da96929604363947a23159f348388` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:12.946207 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fc9906-a052-4b67-875f-b31aca93c606 None admin] RBAC: Authorizing `identity:get_user(user_id=076da96929604363947a23159f348388)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:12.947798 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fc9906-a052-4b67-875f-b31aca93c606 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:12.949820 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 75/153] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Jul 1 19:21:12 2022] GET /identity/v3/users/076da96929604363947a23159f348388 => generated 275 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:21:12.955152 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a217ef-4ba9-4b5a-9afe-477acc470de7 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:13.109788 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a217ef-4ba9-4b5a-9afe-477acc470de7 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:13.147221 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad002b12-38c7-4b6e-8021-ccdf3e6653cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:13.147995 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad002b12-38c7-4b6e-8021-ccdf3e6653cb None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:13.148160 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad002b12-38c7-4b6e-8021-ccdf3e6653cb None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:13.148406 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad002b12-38c7-4b6e-8021-ccdf3e6653cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:13.186270 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:13.226974 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad002b12-38c7-4b6e-8021-ccdf3e6653cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:13.228446 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad002b12-38c7-4b6e-8021-ccdf3e6653cb None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:13.345159 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 79/154] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Jul 1 19:21:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 19:21:13.350570 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fc9906-a052-4b67-875f-b31aca93c606 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:13.436389 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:13.473388 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fc9906-a052-4b67-875f-b31aca93c606 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:13.508882 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229badee-1717-4c39-bd80-5572e99b19f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:13.510062 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229badee-1717-4c39-bd80-5572e99b19f7 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:13.510546 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229badee-1717-4c39-bd80-5572e99b19f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:13.511008 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229badee-1717-4c39-bd80-5572e99b19f7 None admin] PATH_INFO: `/v3/projects/9260fc0eba4449f190981e3ec5a011ad` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:13.512411 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229badee-1717-4c39-bd80-5572e99b19f7 None admin] RBAC: Authorizing `identity:get_project(project_id=9260fc0eba4449f190981e3ec5a011ad)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:13.514072 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229badee-1717-4c39-bd80-5572e99b19f7 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:13.516519 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 76/155] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Jul 1 19:21:13 2022] GET /identity/v3/projects/9260fc0eba4449f190981e3ec5a011ad => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:13.522702 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad002b12-38c7-4b6e-8021-ccdf3e6653cb None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:13.597659 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:13.662993 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad002b12-38c7-4b6e-8021-ccdf3e6653cb None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:13.705620 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6762dbee-7261-402e-8fc0-382f6e4c5758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:13.706195 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762dbee-7261-402e-8fc0-382f6e4c5758 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:13.706480 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762dbee-7261-402e-8fc0-382f6e4c5758 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:13.706755 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762dbee-7261-402e-8fc0-382f6e4c5758 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:13.707595 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6762dbee-7261-402e-8fc0-382f6e4c5758 None admin] RBAC: Adding query filter params (role.id=dd71f7898e6a4d9f99d1554dd7d27033, scope.project.id=9260fc0eba4449f190981e3ec5a011ad, user.id=076da96929604363947a23159f348388) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:13.707910 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6762dbee-7261-402e-8fc0-382f6e4c5758 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:13.709389 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6762dbee-7261-402e-8fc0-382f6e4c5758 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:13.717994 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 80/156] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Jul 1 19:21:13 2022] GET /identity/v3/role_assignments?user.id=076da96929604363947a23159f348388&scope.project.id=9260fc0eba4449f190981e3ec5a011ad&role.id=dd71f7898e6a4d9f99d1554dd7d27033 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:13.858731 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f0a498-f780-40df-b2fd-ba816b9fa7c6 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:13.859426 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f0a498-f780-40df-b2fd-ba816b9fa7c6 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:13.859925 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f0a498-f780-40df-b2fd-ba816b9fa7c6 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:13.861816 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 77/157] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:21:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:21:13.866765 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db377a0-dac0-469b-bb42-169760c10ecd None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:13.867102 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db377a0-dac0-469b-bb42-169760c10ecd None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:13.867333 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db377a0-dac0-469b-bb42-169760c10ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:13.890653 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-4db377a0-dac0-469b-bb42-169760c10ecd None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:21:13.891848 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-4db377a0-dac0-469b-bb42-169760c10ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:21:13.985485 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 81/158] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:21:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 19:21:14.036389 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f0a498-f780-40df-b2fd-ba816b9fa7c6 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:14.162941 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f0a498-f780-40df-b2fd-ba816b9fa7c6 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:14.206722 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff7a0d5-86ed-4c99-8af8-363eb43695fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:14.207528 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff7a0d5-86ed-4c99-8af8-363eb43695fa None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:14.207815 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff7a0d5-86ed-4c99-8af8-363eb43695fa None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:14.208093 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff7a0d5-86ed-4c99-8af8-363eb43695fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:14.219675 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:14.222764 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff7a0d5-86ed-4c99-8af8-363eb43695fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:21:14.231514 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-dff7a0d5-86ed-4c99-8af8-363eb43695fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:21:14.231514 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:21:14.231514 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:21:14.231514 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:21:14.231514 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:21:14.231514 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:21:14.231514 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:21:14.231514 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:21:14.231514 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:21:14.231514 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:21:14.231514 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:21:14.231514 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:21:14.231514 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:21:14.231514 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:21:14.231514 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:21:14.231514 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:21:14.232472 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:21:14.232472 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:21:14.232472 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:21:14.232472 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:21:14.232472 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:21:14.232472 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:21:14.232472 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:21:14.232472 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:21:14.232472 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:21:14.232472 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:21:14.232472 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:21:14.232472 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:21:14.232472 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:21:14.232472 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:21:14.232472 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:21:14.232472 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:21:14.233274 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:21:14.233274 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:21:14.233274 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:21:14.233274 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:21:14.233274 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:21:14.233274 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:21:14.233274 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:21:14.233274 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:21:14.233274 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:21:14.233274 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:21:14.233274 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:21:14.233274 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:21:14.233274 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 78/159] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Jul 1 19:21:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:21:14.238688 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db377a0-dac0-469b-bb42-169760c10ecd None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:14.333824 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:14.394296 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db377a0-dac0-469b-bb42-169760c10ecd None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:14.441563 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a3bf2-e91f-406c-ac36-afd83c40e15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:14.442246 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a3bf2-e91f-406c-ac36-afd83c40e15b None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:14.442534 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a3bf2-e91f-406c-ac36-afd83c40e15b None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:14.442817 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a3bf2-e91f-406c-ac36-afd83c40e15b None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:14.443584 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430a3bf2-e91f-406c-ac36-afd83c40e15b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:14.443940 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430a3bf2-e91f-406c-ac36-afd83c40e15b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:14.445357 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430a3bf2-e91f-406c-ac36-afd83c40e15b None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:14.456837 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 82/160] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Jul 1 19:21:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:14.466347 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff7a0d5-86ed-4c99-8af8-363eb43695fa None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:14.612181 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff7a0d5-86ed-4c99-8af8-363eb43695fa None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:14.654065 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b08537-5863-4a30-adb6-e325ff2d7179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:14.654953 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b08537-5863-4a30-adb6-e325ff2d7179 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:14.655240 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b08537-5863-4a30-adb6-e325ff2d7179 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:14.656042 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b08537-5863-4a30-adb6-e325ff2d7179 None admin] PATH_INFO: `/v3/users/ce82020368de483a9fa05847543c000f` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:14.657275 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b08537-5863-4a30-adb6-e325ff2d7179 None admin] RBAC: Authorizing `identity:get_user(user_id=ce82020368de483a9fa05847543c000f)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:14.658752 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b08537-5863-4a30-adb6-e325ff2d7179 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:14.660397 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 79/161] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Jul 1 19:21:14 2022] GET /identity/v3/users/ce82020368de483a9fa05847543c000f => generated 247 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:14.666149 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a3bf2-e91f-406c-ac36-afd83c40e15b None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:14.784589 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a3bf2-e91f-406c-ac36-afd83c40e15b None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:14.805745 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:14.820633 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a0fb0-bae9-4039-bd3b-c91ed48e5f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:14.821321 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a0fb0-bae9-4039-bd3b-c91ed48e5f3c None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:14.821611 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a0fb0-bae9-4039-bd3b-c91ed48e5f3c None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:14.821895 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a0fb0-bae9-4039-bd3b-c91ed48e5f3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:14.906952 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626a0fb0-bae9-4039-bd3b-c91ed48e5f3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:14.908335 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626a0fb0-bae9-4039-bd3b-c91ed48e5f3c None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:15.022763 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 83/162] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Jul 1 19:21:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 19:21:15.031825 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b08537-5863-4a30-adb6-e325ff2d7179 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:15.108149 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:15.140914 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8dc305-ab9e-490b-8c16-896067a072d0 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:15.141260 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8dc305-ab9e-490b-8c16-896067a072d0 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:15.141519 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8dc305-ab9e-490b-8c16-896067a072d0 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:15.143144 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 84/163] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:21:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:21:15.148561 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb53dd5-3694-4fd3-8619-6fe0811d98d1 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:15.148858 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb53dd5-3694-4fd3-8619-6fe0811d98d1 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:15.149146 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb53dd5-3694-4fd3-8619-6fe0811d98d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:15.179323 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-4bb53dd5-3694-4fd3-8619-6fe0811d98d1 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:21:15.180450 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-4bb53dd5-3694-4fd3-8619-6fe0811d98d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:21:15.183331 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b08537-5863-4a30-adb6-e325ff2d7179 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:15.209595 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:15.245089 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc070be0-d7f8-4378-a940-debcad31175e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:15.245998 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc070be0-d7f8-4378-a940-debcad31175e None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:15.246288 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc070be0-d7f8-4378-a940-debcad31175e None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:15.246573 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc070be0-d7f8-4378-a940-debcad31175e None admin] PATH_INFO: `/v3/projects/9260fc0eba4449f190981e3ec5a011ad` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:15.248755 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc070be0-d7f8-4378-a940-debcad31175e None admin] RBAC: Authorizing `identity:get_project(project_id=9260fc0eba4449f190981e3ec5a011ad)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:15.251641 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc070be0-d7f8-4378-a940-debcad31175e None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:15.253418 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 80/164] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Jul 1 19:21:15 2022] GET /identity/v3/projects/9260fc0eba4449f190981e3ec5a011ad => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:15.260279 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc070be0-d7f8-4378-a940-debcad31175e None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:15.309388 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 85/165] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:21:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 19:21:15.347026 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb53dd5-3694-4fd3-8619-6fe0811d98d1 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:15.379931 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc070be0-d7f8-4378-a940-debcad31175e None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:15.434426 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917799cc-30aa-4340-b4af-50151ee2b8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:15.435098 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917799cc-30aa-4340-b4af-50151ee2b8f8 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:15.435436 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917799cc-30aa-4340-b4af-50151ee2b8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:15.435881 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917799cc-30aa-4340-b4af-50151ee2b8f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:15.437557 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917799cc-30aa-4340-b4af-50151ee2b8f8 None admin] RBAC: Adding query filter params (role.id=6cb03785fb184ef587509b3174622f69, scope.project.id=9260fc0eba4449f190981e3ec5a011ad, user.id=ce82020368de483a9fa05847543c000f) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:15.438048 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917799cc-30aa-4340-b4af-50151ee2b8f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:15.439818 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917799cc-30aa-4340-b4af-50151ee2b8f8 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:15.443561 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:15.455227 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 81/166] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Jul 1 19:21:15 2022] GET /identity/v3/role_assignments?user.id=ce82020368de483a9fa05847543c000f&scope.project.id=9260fc0eba4449f190981e3ec5a011ad&role.id=6cb03785fb184ef587509b3174622f69 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:15.509297 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb53dd5-3694-4fd3-8619-6fe0811d98d1 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:15.543379 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c8da45-f73b-47cf-a1b4-5d54c0f97b6f None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:15.544499 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c8da45-f73b-47cf-a1b4-5d54c0f97b6f None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:15.545102 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c8da45-f73b-47cf-a1b4-5d54c0f97b6f None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:15.547201 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 82/167] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:21:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 19:21:15.547465 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded5a25e-bb7f-4721-ba61-0f9a89e93a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:15.551614 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5a25e-bb7f-4721-ba61-0f9a89e93a5e None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:15.551614 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5a25e-bb7f-4721-ba61-0f9a89e93a5e None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:15.551614 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5a25e-bb7f-4721-ba61-0f9a89e93a5e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:15.556046 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee1a7c-5602-40e5-a983-ac35496f0385 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:15.556800 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee1a7c-5602-40e5-a983-ac35496f0385 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:15.557514 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee1a7c-5602-40e5-a983-ac35496f0385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:15.565990 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded5a25e-bb7f-4721-ba61-0f9a89e93a5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:21:15.574184 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-ded5a25e-bb7f-4721-ba61-0f9a89e93a5e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 01 19:21:15.574184 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:21:15.574184 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:21:15.574184 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:21:15.574184 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:21:15.574184 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:21:15.574184 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:21:15.574184 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:21:15.574184 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:21:15.574184 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:21:15.574184 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:21:15.574184 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:21:15.574184 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:21:15.574184 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:21:15.574184 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:21:15.574184 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:21:15.575375 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:21:15.575375 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:21:15.575375 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:21:15.575375 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:21:15.575375 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:21:15.575375 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:21:15.575375 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:21:15.575375 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:21:15.575375 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:21:15.575375 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:21:15.575375 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:21:15.575375 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:21:15.575375 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:21:15.575375 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:21:15.575375 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:21:15.575375 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:21:15.576187 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:21:15.576187 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:21:15.576187 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:21:15.576187 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:21:15.576187 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:21:15.576187 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:21:15.576187 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:21:15.576187 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:21:15.576187 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:21:15.576187 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:21:15.576187 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 01 19:21:15.576187 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:21:15.576187 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 86/168] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Jul 1 19:21:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:21:15.582736 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded5a25e-bb7f-4721-ba61-0f9a89e93a5e None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:15.599696 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-31ee1a7c-5602-40e5-a983-ac35496f0385 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:21:15.601814 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-31ee1a7c-5602-40e5-a983-ac35496f0385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:21:15.607525 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:15.755059 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 83/169] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:21:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:21:15.799721 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded5a25e-bb7f-4721-ba61-0f9a89e93a5e None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:15.801489 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ee1a7c-5602-40e5-a983-ac35496f0385 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:15.850260 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c983fb1b-2905-4910-997c-f3b7ba78b931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:15.850945 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c983fb1b-2905-4910-997c-f3b7ba78b931 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:15.851234 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c983fb1b-2905-4910-997c-f3b7ba78b931 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:15.851519 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c983fb1b-2905-4910-997c-f3b7ba78b931 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:15.852282 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c983fb1b-2905-4910-997c-f3b7ba78b931 None admin] RBAC: Adding query filter params (name=member) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:15.852598 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c983fb1b-2905-4910-997c-f3b7ba78b931 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:15.854028 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c983fb1b-2905-4910-997c-f3b7ba78b931 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:15.866957 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 87/170] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Jul 1 19:21:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:21:15.872616 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c983fb1b-2905-4910-997c-f3b7ba78b931 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:15.973605 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:16.012593 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ee1a7c-5602-40e5-a983-ac35496f0385 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:16.023208 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c983fb1b-2905-4910-997c-f3b7ba78b931 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:16.066467 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:16.070215 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49d3da1-4c15-42c5-9489-24497ba3b4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:16.071292 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d3da1-4c15-42c5-9489-24497ba3b4a5 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:16.071939 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d3da1-4c15-42c5-9489-24497ba3b4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:16.071939 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d3da1-4c15-42c5-9489-24497ba3b4a5 None admin] PATH_INFO: `/v3/users/076da96929604363947a23159f348388` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:16.073389 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49d3da1-4c15-42c5-9489-24497ba3b4a5 None admin] RBAC: Authorizing `identity:get_user(user_id=076da96929604363947a23159f348388)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:16.074933 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49d3da1-4c15-42c5-9489-24497ba3b4a5 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:16.076765 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 88/171] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Jul 1 19:21:15 2022] GET /identity/v3/users/076da96929604363947a23159f348388 => generated 275 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:21:16.078159 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a054393-1ef9-4a5b-9951-0780c9eee5fa None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:16.078271 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ed838d-47af-42d5-b409-52e71d1200e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:16.078574 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a054393-1ef9-4a5b-9951-0780c9eee5fa None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:16.078962 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a054393-1ef9-4a5b-9951-0780c9eee5fa None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:16.079063 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed838d-47af-42d5-b409-52e71d1200e4 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:16.079334 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed838d-47af-42d5-b409-52e71d1200e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:16.079613 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed838d-47af-42d5-b409-52e71d1200e4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:16.081013 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 89/172] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:21:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:21:16.086477 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a054393-1ef9-4a5b-9951-0780c9eee5fa None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:16.110809 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ed838d-47af-42d5-b409-52e71d1200e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:21:16.118619 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-a6ed838d-47af-42d5-b409-52e71d1200e4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 01 19:21:16.118619 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:21:16.118619 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:21:16.118619 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:21:16.118619 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:21:16.118619 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:21:16.118619 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:21:16.118619 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:21:16.118619 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:21:16.118619 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:21:16.118619 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:21:16.118619 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:21:16.118619 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:21:16.118619 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:21:16.118619 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:21:16.118619 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:21:16.119561 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:21:16.119561 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:21:16.119561 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:21:16.119561 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:21:16.119561 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:21:16.119561 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:21:16.119561 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:21:16.119561 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:21:16.119561 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:21:16.119561 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:21:16.119561 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:21:16.119561 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:21:16.119561 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:21:16.119561 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:21:16.119561 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:21:16.119561 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:21:16.120353 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:21:16.120353 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:21:16.120353 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:21:16.120353 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:21:16.120353 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:21:16.120353 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:21:16.120353 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:21:16.120353 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:21:16.120353 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:21:16.120353 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:21:16.120353 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 01 19:21:16.120353 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:21:16.120353 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 84/173] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Jul 1 19:21:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:21:16.121764 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d0337-22d2-4bbc-aebe-f3aa72bd69dc None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:16.132718 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d0337-22d2-4bbc-aebe-f3aa72bd69dc None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:16.133074 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d0337-22d2-4bbc-aebe-f3aa72bd69dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:16.159375 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-263d0337-22d2-4bbc-aebe-f3aa72bd69dc None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:21:16.160770 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-263d0337-22d2-4bbc-aebe-f3aa72bd69dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:21:16.296089 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 85/174] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:21:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:21:16.300875 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263d0337-22d2-4bbc-aebe-f3aa72bd69dc None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:16.331528 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a054393-1ef9-4a5b-9951-0780c9eee5fa None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:16.384686 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e137158c-28e2-46c2-a266-e337a5bfd7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:16.385666 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e137158c-28e2-46c2-a266-e337a5bfd7a8 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:16.385964 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e137158c-28e2-46c2-a266-e337a5bfd7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:16.386247 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e137158c-28e2-46c2-a266-e337a5bfd7a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:16.402812 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:16.450915 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263d0337-22d2-4bbc-aebe-f3aa72bd69dc None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:16.474866 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:16.481105 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e137158c-28e2-46c2-a266-e337a5bfd7a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:16.483568 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e137158c-28e2-46c2-a266-e337a5bfd7a8 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:16.491881 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e135cb4-e253-4a09-a5c5-d2aabf2e8a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:16.492667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e135cb4-e253-4a09-a5c5-d2aabf2e8a12 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:16.493021 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e135cb4-e253-4a09-a5c5-d2aabf2e8a12 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:16.493447 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e135cb4-e253-4a09-a5c5-d2aabf2e8a12 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:16.494280 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e135cb4-e253-4a09-a5c5-d2aabf2e8a12 None admin] RBAC: Adding query filter params (name=member) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:16.494661 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e135cb4-e253-4a09-a5c5-d2aabf2e8a12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:16.496259 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e135cb4-e253-4a09-a5c5-d2aabf2e8a12 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:16.510011 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 86/175] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Jul 1 19:21:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:16.510011 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab42322-443b-44dd-88ad-f230ca56d74e None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:16.510011 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab42322-443b-44dd-88ad-f230ca56d74e None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:16.510011 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab42322-443b-44dd-88ad-f230ca56d74e None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:16.513635 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 87/176] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:21:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:21:16.514527 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab42322-443b-44dd-88ad-f230ca56d74e None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:16.637271 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 90/177] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Jul 1 19:21:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 19:21:16.637271 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e8960-aa65-4fcd-a2ed-193448daf1d7 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:16.637271 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e8960-aa65-4fcd-a2ed-193448daf1d7 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:16.637271 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e8960-aa65-4fcd-a2ed-193448daf1d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:16.656760 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-227e8960-aa65-4fcd-a2ed-193448daf1d7 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:21:16.658652 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-227e8960-aa65-4fcd-a2ed-193448daf1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:21:16.665722 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab42322-443b-44dd-88ad-f230ca56d74e None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:16.703255 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:16.711882 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c483b10a-f869-47a6-9b25-6bf582e3c78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:16.712688 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c483b10a-f869-47a6-9b25-6bf582e3c78a None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:16.713399 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c483b10a-f869-47a6-9b25-6bf582e3c78a None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:16.713686 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c483b10a-f869-47a6-9b25-6bf582e3c78a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:16.725657 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c483b10a-f869-47a6-9b25-6bf582e3c78a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:21:16.733327 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-c483b10a-f869-47a6-9b25-6bf582e3c78a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:21:16.733327 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:21:16.733327 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:21:16.733327 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:21:16.733327 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:21:16.733327 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:21:16.733327 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:21:16.733327 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:21:16.733327 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:21:16.733327 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:21:16.733327 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:21:16.733327 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:21:16.733327 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:21:16.733327 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:21:16.733327 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:21:16.733327 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:21:16.734248 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:21:16.734248 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:21:16.734248 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:21:16.734248 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:21:16.734248 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:21:16.734248 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:21:16.734248 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:21:16.734248 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:21:16.734248 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:21:16.734248 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:21:16.734248 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:21:16.734248 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:21:16.734248 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:21:16.734248 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:21:16.734248 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:21:16.734248 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:21:16.740128 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:21:16.740128 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:21:16.740128 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:21:16.740128 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:21:16.740128 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:21:16.740128 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:21:16.740128 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:21:16.740128 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:21:16.740128 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:21:16.740128 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:21:16.740128 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:21:16.740128 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:21:16.740128 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 88/178] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Jul 1 19:21:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:21:16.740128 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c483b10a-f869-47a6-9b25-6bf582e3c78a None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:16.749077 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 91/179] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:21:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:21:16.750105 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227e8960-aa65-4fcd-a2ed-193448daf1d7 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:16.797185 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:16.860335 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c483b10a-f869-47a6-9b25-6bf582e3c78a None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:16.862654 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227e8960-aa65-4fcd-a2ed-193448daf1d7 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:16.894789 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d004f81-499c-4494-b744-874cd2bdc801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:16.895584 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d004f81-499c-4494-b744-874cd2bdc801 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:16.895867 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d004f81-499c-4494-b744-874cd2bdc801 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:16.896149 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d004f81-499c-4494-b744-874cd2bdc801 None admin] PATH_INFO: `/v3/users/076da96929604363947a23159f348388` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:16.897389 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d004f81-499c-4494-b744-874cd2bdc801 None admin] RBAC: Authorizing `identity:get_user(user_id=076da96929604363947a23159f348388)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:16.897530 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285612fb-f82e-40a2-a408-f2430aa32093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:16.898394 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285612fb-f82e-40a2-a408-f2430aa32093 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:16.898680 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285612fb-f82e-40a2-a408-f2430aa32093 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:16.898859 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d004f81-499c-4494-b744-874cd2bdc801 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:16.898965 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285612fb-f82e-40a2-a408-f2430aa32093 None admin] PATH_INFO: `/v3/projects/1505be130f184ead97ccbacb96223727` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:16.900145 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285612fb-f82e-40a2-a408-f2430aa32093 None admin] RBAC: Authorizing `identity:get_project(project_id=1505be130f184ead97ccbacb96223727)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:16.909536 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 89/180] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Jul 1 19:21:16 2022] GET /identity/v3/users/076da96929604363947a23159f348388 => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:16.909708 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285612fb-f82e-40a2-a408-f2430aa32093 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:16.909813 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d27d49-3a65-4f8b-8d19-47e9adf6a0d3 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:16.909813 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d27d49-3a65-4f8b-8d19-47e9adf6a0d3 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:16.909813 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d27d49-3a65-4f8b-8d19-47e9adf6a0d3 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:16.910045 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 92/181] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Jul 1 19:21:16 2022] GET /identity/v3/projects/1505be130f184ead97ccbacb96223727 => generated 312 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:16.910124 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 90/182] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:21:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:21:16.910124 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d27d49-3a65-4f8b-8d19-47e9adf6a0d3 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:16.910279 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285612fb-f82e-40a2-a408-f2430aa32093 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:16.951219 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:17.006272 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d27d49-3a65-4f8b-8d19-47e9adf6a0d3 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:17.012931 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285612fb-f82e-40a2-a408-f2430aa32093 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:17.017321 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:17.041285 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7ff2d3-72fe-4ff0-aa00-b3e63ecaadc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:17.042078 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ff2d3-72fe-4ff0-aa00-b3e63ecaadc4 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:17.042360 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ff2d3-72fe-4ff0-aa00-b3e63ecaadc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:17.042633 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ff2d3-72fe-4ff0-aa00-b3e63ecaadc4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:17.043787 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7ff2d3-72fe-4ff0-aa00-b3e63ecaadc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:17.045248 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7ff2d3-72fe-4ff0-aa00-b3e63ecaadc4 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:17.046891 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 91/183] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:21:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:17.047423 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb9cc5b-66e4-4aab-accd-e1895f7c630e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:17.048158 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb9cc5b-66e4-4aab-accd-e1895f7c630e None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:17.048447 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb9cc5b-66e4-4aab-accd-e1895f7c630e None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:17.048724 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb9cc5b-66e4-4aab-accd-e1895f7c630e None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:17.049510 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb9cc5b-66e4-4aab-accd-e1895f7c630e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:17.049817 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb9cc5b-66e4-4aab-accd-e1895f7c630e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:17.050899 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50ff10-25f6-484c-8b3c-486b66844e90 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:17.051277 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb9cc5b-66e4-4aab-accd-e1895f7c630e None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:17.051514 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50ff10-25f6-484c-8b3c-486b66844e90 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:17.051866 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50ff10-25f6-484c-8b3c-486b66844e90 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:17.053171 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 92/184] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:21:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:21:17.057978 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee50ff10-25f6-484c-8b3c-486b66844e90 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:17.060309 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 93/185] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Jul 1 19:21:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:17.061126 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb9cc5b-66e4-4aab-accd-e1895f7c630e None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:17.166607 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:17.170048 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb9cc5b-66e4-4aab-accd-e1895f7c630e None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:17.171883 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee50ff10-25f6-484c-8b3c-486b66844e90 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:17.205590 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11ce311-cd89-458a-aba3-27a8d3d57f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:17.206252 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ce311-cd89-458a-aba3-27a8d3d57f4e None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:17.206536 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ce311-cd89-458a-aba3-27a8d3d57f4e None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:17.206817 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ce311-cd89-458a-aba3-27a8d3d57f4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:17.207649 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11ce311-cd89-458a-aba3-27a8d3d57f4e None admin] RBAC: Adding query filter params (role.id=4cbf6ec846eb4b7c8cc52e9bfd6f076f, scope.project.id=1505be130f184ead97ccbacb96223727, user.id=076da96929604363947a23159f348388) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:17.207964 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11ce311-cd89-458a-aba3-27a8d3d57f4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:17.209661 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11ce311-cd89-458a-aba3-27a8d3d57f4e None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:17.211451 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baec1bc5-21bf-411d-82e9-678c999d113d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:17.212099 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec1bc5-21bf-411d-82e9-678c999d113d None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:17.212381 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec1bc5-21bf-411d-82e9-678c999d113d None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:17.212655 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec1bc5-21bf-411d-82e9-678c999d113d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:17.215817 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 94/186] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Jul 1 19:21:17 2022] GET /identity/v3/role_assignments?user.id=076da96929604363947a23159f348388&scope.project.id=1505be130f184ead97ccbacb96223727&role.id=4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:17.227255 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6359039d-4656-450f-9234-20776a78c236 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:17.227892 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6359039d-4656-450f-9234-20776a78c236 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:17.228208 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6359039d-4656-450f-9234-20776a78c236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:17.248378 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-6359039d-4656-450f-9234-20776a78c236 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:21:17.250186 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-6359039d-4656-450f-9234-20776a78c236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:21:17.275546 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:17.306329 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baec1bc5-21bf-411d-82e9-678c999d113d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:17.307781 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baec1bc5-21bf-411d-82e9-678c999d113d None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:17.326701 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 95/187] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:21:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:21:17.327606 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6359039d-4656-450f-9234-20776a78c236 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:17.451547 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:17.454582 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 93/188] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Jul 1 19:21:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 19:21:17.456410 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a2675-0544-4b6b-b445-7591df08fc78 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:17.456787 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a2675-0544-4b6b-b445-7591df08fc78 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:17.457252 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a2675-0544-4b6b-b445-7591df08fc78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:17.459387 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6359039d-4656-450f-9234-20776a78c236 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:17.475653 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-0b8a2675-0544-4b6b-b445-7591df08fc78 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:21:17.476992 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-0b8a2675-0544-4b6b-b445-7591df08fc78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:21:17.494674 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cba548-e7d3-4d68-810d-b20d564fdff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:17.495431 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cba548-e7d3-4d68-810d-b20d564fdff1 None admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:17.495758 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cba548-e7d3-4d68-810d-b20d564fdff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:17.496107 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cba548-e7d3-4d68-810d-b20d564fdff1 None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:17.497203 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cba548-e7d3-4d68-810d-b20d564fdff1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:17.498921 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cba548-e7d3-4d68-810d-b20d564fdff1 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:17.535914 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 96/189] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Jul 1 19:21:17 2022] POST /identity/v3/users => generated 297 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:21:17.535914 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cba548-e7d3-4d68-810d-b20d564fdff1 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:17.567800 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 94/190] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:21:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:21:17.569098 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8a2675-0544-4b6b-b445-7591df08fc78 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:17.592184 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:17.679891 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cba548-e7d3-4d68-810d-b20d564fdff1 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:17.708418 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8a2675-0544-4b6b-b445-7591df08fc78 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:17.725788 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3677335-f33b-4469-a14b-059c6da08a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:17.726678 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3677335-f33b-4469-a14b-059c6da08a44 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:17.726964 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3677335-f33b-4469-a14b-059c6da08a44 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:17.727240 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3677335-f33b-4469-a14b-059c6da08a44 None admin] PATH_INFO: `/v3/users/29bf1d71ba094d579e15c2ecc72505b6` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:17.744255 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3677335-f33b-4469-a14b-059c6da08a44 None admin] RBAC: Authorizing `identity:get_user(user_id=29bf1d71ba094d579e15c2ecc72505b6)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:17.746452 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3677335-f33b-4469-a14b-059c6da08a44 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:17.753115 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 97/191] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Jul 1 19:21:17 2022] GET /identity/v3/users/29bf1d71ba094d579e15c2ecc72505b6 => generated 283 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:17.753115 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3677335-f33b-4469-a14b-059c6da08a44 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:17.757519 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e575f07a-8f9a-4993-ba68-3c14cb3ba9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:17.758555 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e575f07a-8f9a-4993-ba68-3c14cb3ba9d9 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:17.758843 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e575f07a-8f9a-4993-ba68-3c14cb3ba9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:17.759124 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e575f07a-8f9a-4993-ba68-3c14cb3ba9d9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:17.763010 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:17.775359 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e575f07a-8f9a-4993-ba68-3c14cb3ba9d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:21:17.790187 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-e575f07a-8f9a-4993-ba68-3c14cb3ba9d9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 01 19:21:17.790187 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:21:17.790187 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:21:17.790187 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:21:17.790187 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:21:17.790187 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:21:17.790187 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:21:17.790187 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:21:17.790187 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:21:17.790187 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:21:17.790187 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:21:17.790187 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:21:17.790187 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:21:17.790187 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:21:17.790187 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:21:17.790187 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:21:17.791171 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:21:17.791171 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:21:17.791171 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:21:17.791171 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:21:17.791171 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:21:17.791171 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:21:17.791171 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:21:17.791171 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:21:17.791171 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:21:17.791171 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:21:17.791171 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:21:17.791171 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:21:17.791171 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:21:17.791171 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:21:17.791171 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:21:17.791171 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:21:17.791967 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:21:17.791967 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:21:17.791967 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:21:17.791967 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:21:17.791967 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:21:17.791967 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:21:17.791967 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:21:17.791967 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:21:17.791967 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:21:17.791967 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:21:17.791967 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 01 19:21:17.791967 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:21:17.791967 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 95/192] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Jul 1 19:21:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:21:17.793098 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e575f07a-8f9a-4993-ba68-3c14cb3ba9d9 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:17.894281 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3677335-f33b-4469-a14b-059c6da08a44 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:17.900954 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:17.939325 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe67a11-1232-4eb0-89bb-fdd43a87c010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:17.940174 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe67a11-1232-4eb0-89bb-fdd43a87c010 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:17.940459 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe67a11-1232-4eb0-89bb-fdd43a87c010 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:17.940737 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe67a11-1232-4eb0-89bb-fdd43a87c010 None admin] PATH_INFO: `/v3/projects/9260fc0eba4449f190981e3ec5a011ad` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:17.942067 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe67a11-1232-4eb0-89bb-fdd43a87c010 None admin] RBAC: Authorizing `identity:get_project(project_id=9260fc0eba4449f190981e3ec5a011ad)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:17.943583 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe67a11-1232-4eb0-89bb-fdd43a87c010 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:17.945328 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 98/193] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Jul 1 19:21:17 2022] GET /identity/v3/projects/9260fc0eba4449f190981e3ec5a011ad => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:17.946442 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe67a11-1232-4eb0-89bb-fdd43a87c010 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:17.953348 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e575f07a-8f9a-4993-ba68-3c14cb3ba9d9 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:17.999242 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8db6f3-4b77-42c1-ac8b-937fc30bfff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:18.000553 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8db6f3-4b77-42c1-ac8b-937fc30bfff6 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:18.001348 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8db6f3-4b77-42c1-ac8b-937fc30bfff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:18.001769 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8db6f3-4b77-42c1-ac8b-937fc30bfff6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:18.016725 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8db6f3-4b77-42c1-ac8b-937fc30bfff6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:21:18.028654 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-4a8db6f3-4b77-42c1-ac8b-937fc30bfff6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 19:21:18.028654 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:21:18.028654 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:21:18.028654 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:21:18.028654 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:21:18.028654 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:21:18.028654 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:21:18.028654 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:21:18.028654 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:21:18.028654 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:21:18.028654 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:21:18.028654 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:21:18.028654 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:21:18.028654 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:21:18.028654 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:21:18.028654 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:21:18.029787 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:21:18.029787 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:21:18.029787 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:21:18.029787 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:21:18.029787 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:21:18.029787 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:21:18.029787 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:21:18.029787 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:21:18.029787 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:21:18.029787 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:21:18.029787 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:21:18.029787 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:21:18.029787 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:21:18.029787 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:21:18.029787 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:21:18.029787 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:21:18.031486 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:21:18.031486 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:21:18.031486 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:21:18.031486 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:21:18.031486 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:21:18.031486 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:21:18.031486 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:21:18.031486 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:21:18.031486 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:21:18.031486 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:21:18.031486 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 19:21:18.031486 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:21:18.034414 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 96/194] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Jul 1 19:21:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:21:18.035445 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8db6f3-4b77-42c1-ac8b-937fc30bfff6 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:18.036617 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:18.064350 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe67a11-1232-4eb0-89bb-fdd43a87c010 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:18.109225 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e9aee1-5526-4604-abc2-dbc333a61892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:18.110499 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9aee1-5526-4604-abc2-dbc333a61892 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:18.110967 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9aee1-5526-4604-abc2-dbc333a61892 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:18.111610 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9aee1-5526-4604-abc2-dbc333a61892 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:18.159132 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8db6f3-4b77-42c1-ac8b-937fc30bfff6 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:18.190469 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:18.198862 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbf4f98-616b-4eb0-9359-794f7e216192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:18.199761 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf4f98-616b-4eb0-9359-794f7e216192 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:18.200211 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf4f98-616b-4eb0-9359-794f7e216192 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:18.200524 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf4f98-616b-4eb0-9359-794f7e216192 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:18.201389 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbf4f98-616b-4eb0-9359-794f7e216192 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:18.201827 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbf4f98-616b-4eb0-9359-794f7e216192 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:18.203335 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbf4f98-616b-4eb0-9359-794f7e216192 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:18.207765 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e9aee1-5526-4604-abc2-dbc333a61892 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:18.210256 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e9aee1-5526-4604-abc2-dbc333a61892 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:18.214158 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 97/195] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Jul 1 19:21:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:18.214651 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbf4f98-616b-4eb0-9359-794f7e216192 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:18.309915 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:18.338508 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 99/196] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Jul 1 19:21:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 19:21:18.339653 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbf4f98-616b-4eb0-9359-794f7e216192 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:18.339942 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e9aee1-5526-4604-abc2-dbc333a61892 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:18.386677 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c334ee4-4a2f-4041-938a-8efa45a1ffaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:18.387363 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c334ee4-4a2f-4041-938a-8efa45a1ffaf None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:18.387648 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c334ee4-4a2f-4041-938a-8efa45a1ffaf None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:18.387989 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c334ee4-4a2f-4041-938a-8efa45a1ffaf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:18.389171 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c334ee4-4a2f-4041-938a-8efa45a1ffaf None admin] RBAC: Adding query filter params (role.id=4cbf6ec846eb4b7c8cc52e9bfd6f076f, scope.project.id=9260fc0eba4449f190981e3ec5a011ad, user.id=076da96929604363947a23159f348388) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:18.389535 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c334ee4-4a2f-4041-938a-8efa45a1ffaf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:18.391238 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c334ee4-4a2f-4041-938a-8efa45a1ffaf None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:18.405265 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 98/197] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Jul 1 19:21:18 2022] GET /identity/v3/role_assignments?user.id=076da96929604363947a23159f348388&scope.project.id=9260fc0eba4449f190981e3ec5a011ad&role.id=4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:18.405265 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c334ee4-4a2f-4041-938a-8efa45a1ffaf None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:18.513035 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e9aee1-5526-4604-abc2-dbc333a61892 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:18.540287 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:18.582643 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7202527f-2821-4ced-8aaf-6283bbe74024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:18.583221 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7202527f-2821-4ced-8aaf-6283bbe74024 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:18.583504 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7202527f-2821-4ced-8aaf-6283bbe74024 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:18.583782 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7202527f-2821-4ced-8aaf-6283bbe74024 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:18.584743 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7202527f-2821-4ced-8aaf-6283bbe74024 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:18.585078 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7202527f-2821-4ced-8aaf-6283bbe74024 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:18.586657 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7202527f-2821-4ced-8aaf-6283bbe74024 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:18.596126 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 100/198] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Jul 1 19:21:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:18.596920 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7202527f-2821-4ced-8aaf-6283bbe74024 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:18.640096 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c334ee4-4a2f-4041-938a-8efa45a1ffaf None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:18.649836 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:18.679005 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa9307d-6a9b-416f-a474-a182d083b6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:18.679892 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9307d-6a9b-416f-a474-a182d083b6a3 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:18.680180 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9307d-6a9b-416f-a474-a182d083b6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:18.680462 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9307d-6a9b-416f-a474-a182d083b6a3 None admin] PATH_INFO: `/v3/users/ea3be7a3ccab4001ad64c40b19728c28` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:18.681912 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa9307d-6a9b-416f-a474-a182d083b6a3 None admin] RBAC: Authorizing `identity:get_user(user_id=ea3be7a3ccab4001ad64c40b19728c28)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:18.683605 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa9307d-6a9b-416f-a474-a182d083b6a3 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:18.684924 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 99/199] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Jul 1 19:21:18 2022] GET /identity/v3/users/ea3be7a3ccab4001ad64c40b19728c28 => generated 289 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:18.689962 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa9307d-6a9b-416f-a474-a182d083b6a3 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:18.721860 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7202527f-2821-4ced-8aaf-6283bbe74024 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:18.759736 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc1f5e7-0ea8-4b77-8baf-c58e904385a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:18.760992 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1f5e7-0ea8-4b77-8baf-c58e904385a0 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:18.761695 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1f5e7-0ea8-4b77-8baf-c58e904385a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:18.762260 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1f5e7-0ea8-4b77-8baf-c58e904385a0 None admin] PATH_INFO: `/v3/projects/b3f5af7a5da14e5c84bea28cc3aa5626` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:18.763704 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc1f5e7-0ea8-4b77-8baf-c58e904385a0 None admin] RBAC: Authorizing `identity:get_project(project_id=b3f5af7a5da14e5c84bea28cc3aa5626)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:18.765957 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc1f5e7-0ea8-4b77-8baf-c58e904385a0 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:18.767913 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 101/200] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Jul 1 19:21:18 2022] GET /identity/v3/projects/b3f5af7a5da14e5c84bea28cc3aa5626 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:18.768949 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc1f5e7-0ea8-4b77-8baf-c58e904385a0 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:18.814211 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa9307d-6a9b-416f-a474-a182d083b6a3 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:18.840190 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:18.854484 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dccc1d2-d0c7-4ed0-92a2-34baf9bc9ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:18.855375 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dccc1d2-d0c7-4ed0-92a2-34baf9bc9ea6 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:18.855660 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dccc1d2-d0c7-4ed0-92a2-34baf9bc9ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:18.855941 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dccc1d2-d0c7-4ed0-92a2-34baf9bc9ea6 None admin] PATH_INFO: `/v3/users/29bf1d71ba094d579e15c2ecc72505b6` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:18.857991 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dccc1d2-d0c7-4ed0-92a2-34baf9bc9ea6 None admin] RBAC: Authorizing `identity:get_user(user_id=29bf1d71ba094d579e15c2ecc72505b6)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:18.858943 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dccc1d2-d0c7-4ed0-92a2-34baf9bc9ea6 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:18.860916 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 100/201] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Jul 1 19:21:18 2022] GET /identity/v3/users/29bf1d71ba094d579e15c2ecc72505b6 => generated 283 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:18.861745 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dccc1d2-d0c7-4ed0-92a2-34baf9bc9ea6 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:18.891883 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc1f5e7-0ea8-4b77-8baf-c58e904385a0 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:18.900038 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:18.930267 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90befb31-e220-42de-af84-ad0a0906aa6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:18.931301 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90befb31-e220-42de-af84-ad0a0906aa6a None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:18.931781 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90befb31-e220-42de-af84-ad0a0906aa6a None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:18.932248 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90befb31-e220-42de-af84-ad0a0906aa6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:18.995760 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dccc1d2-d0c7-4ed0-92a2-34baf9bc9ea6 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:19.016921 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90befb31-e220-42de-af84-ad0a0906aa6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:19.018764 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90befb31-e220-42de-af84-ad0a0906aa6a None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:19.035218 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efed6e2-7d86-4c29-a5b9-eda6d1a24c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:19.035884 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efed6e2-7d86-4c29-a5b9-eda6d1a24c23 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:19.036175 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efed6e2-7d86-4c29-a5b9-eda6d1a24c23 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:19.036460 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efed6e2-7d86-4c29-a5b9-eda6d1a24c23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:19.037322 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efed6e2-7d86-4c29-a5b9-eda6d1a24c23 None admin] RBAC: Adding query filter params (role.id=6cb03785fb184ef587509b3174622f69, scope.project.id=b3f5af7a5da14e5c84bea28cc3aa5626, user.id=29bf1d71ba094d579e15c2ecc72505b6) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:19.037664 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efed6e2-7d86-4c29-a5b9-eda6d1a24c23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:19.039259 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efed6e2-7d86-4c29-a5b9-eda6d1a24c23 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:19.045613 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 101/202] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Jul 1 19:21:18 2022] GET /identity/v3/role_assignments?user.id=29bf1d71ba094d579e15c2ecc72505b6&scope.project.id=b3f5af7a5da14e5c84bea28cc3aa5626&role.id=6cb03785fb184ef587509b3174622f69 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:19.046457 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efed6e2-7d86-4c29-a5b9-eda6d1a24c23 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:19.132159 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:19.162168 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 102/203] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Jul 1 19:21:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 19:21:19.167859 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90befb31-e220-42de-af84-ad0a0906aa6a None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:19.177554 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:19.200825 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efed6e2-7d86-4c29-a5b9-eda6d1a24c23 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:19.257428 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee6aad6-4027-4892-9c29-d95acecf0865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:19.258113 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee6aad6-4027-4892-9c29-d95acecf0865 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:19.258403 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee6aad6-4027-4892-9c29-d95acecf0865 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:19.258686 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee6aad6-4027-4892-9c29-d95acecf0865 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:19.285940 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90befb31-e220-42de-af84-ad0a0906aa6a None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:19.323165 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf05f40-ed81-402a-86ef-d36f618bb88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:19.324399 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf05f40-ed81-402a-86ef-d36f618bb88c None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:19.324877 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf05f40-ed81-402a-86ef-d36f618bb88c None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:19.325507 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf05f40-ed81-402a-86ef-d36f618bb88c None admin] PATH_INFO: `/v3/projects/9260fc0eba4449f190981e3ec5a011ad` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:19.326989 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf05f40-ed81-402a-86ef-d36f618bb88c None admin] RBAC: Authorizing `identity:get_project(project_id=9260fc0eba4449f190981e3ec5a011ad)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:19.329273 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf05f40-ed81-402a-86ef-d36f618bb88c None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:19.331984 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 103/204] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Jul 1 19:21:19 2022] GET /identity/v3/projects/9260fc0eba4449f190981e3ec5a011ad => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:19.342537 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf05f40-ed81-402a-86ef-d36f618bb88c None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:19.370324 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee6aad6-4027-4892-9c29-d95acecf0865 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:19.371864 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee6aad6-4027-4892-9c29-d95acecf0865 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:19.432155 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:19.460104 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf05f40-ed81-402a-86ef-d36f618bb88c None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:19.476354 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:19.510064 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0732031f-8d3b-43bc-8874-d707ed3f4bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:19.511168 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732031f-8d3b-43bc-8874-d707ed3f4bde None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:19.511646 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732031f-8d3b-43bc-8874-d707ed3f4bde None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:19.512113 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732031f-8d3b-43bc-8874-d707ed3f4bde None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:19.513140 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0732031f-8d3b-43bc-8874-d707ed3f4bde None admin] RBAC: Adding query filter params (role.id=f4f5eb791e8749f18c9d57c113558e15, scope.project.id=9260fc0eba4449f190981e3ec5a011ad, user.id=ea3be7a3ccab4001ad64c40b19728c28) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:19.514112 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0732031f-8d3b-43bc-8874-d707ed3f4bde None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:19.516507 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0732031f-8d3b-43bc-8874-d707ed3f4bde None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:19.523842 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 104/205] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Jul 1 19:21:19 2022] GET /identity/v3/role_assignments?user.id=ea3be7a3ccab4001ad64c40b19728c28&scope.project.id=9260fc0eba4449f190981e3ec5a011ad&role.id=f4f5eb791e8749f18c9d57c113558e15 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:19.591793 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 102/206] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Jul 1 19:21:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 19:21:19.597706 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0732031f-8d3b-43bc-8874-d707ed3f4bde None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:19.741866 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0732031f-8d3b-43bc-8874-d707ed3f4bde None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:19.779404 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ff71f9-77aa-4427-b542-f97c46d29eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:19.780270 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff71f9-77aa-4427-b542-f97c46d29eaa None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:19.780587 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff71f9-77aa-4427-b542-f97c46d29eaa None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:19.780860 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff71f9-77aa-4427-b542-f97c46d29eaa None admin] PATH_INFO: `/v3/projects/b3f5af7a5da14e5c84bea28cc3aa5626` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:19.782145 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ff71f9-77aa-4427-b542-f97c46d29eaa None admin] RBAC: Authorizing `identity:get_project(project_id=b3f5af7a5da14e5c84bea28cc3aa5626)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:19.783597 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ff71f9-77aa-4427-b542-f97c46d29eaa None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:19.786378 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 105/207] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Jul 1 19:21:19 2022] GET /identity/v3/projects/b3f5af7a5da14e5c84bea28cc3aa5626 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:19.794357 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee6aad6-4027-4892-9c29-d95acecf0865 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:19.910418 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee6aad6-4027-4892-9c29-d95acecf0865 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:19.948400 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c962650-5087-44d0-96a0-c05776783cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:19.949063 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c962650-5087-44d0-96a0-c05776783cd8 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:19.949381 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c962650-5087-44d0-96a0-c05776783cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:19.949660 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c962650-5087-44d0-96a0-c05776783cd8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:19.950499 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c962650-5087-44d0-96a0-c05776783cd8 None admin] RBAC: Adding query filter params (role.id=dd71f7898e6a4d9f99d1554dd7d27033, scope.project.id=b3f5af7a5da14e5c84bea28cc3aa5626, user.id=29bf1d71ba094d579e15c2ecc72505b6) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:19.950810 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c962650-5087-44d0-96a0-c05776783cd8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:19.952300 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c962650-5087-44d0-96a0-c05776783cd8 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:19.958597 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 103/208] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Jul 1 19:21:19 2022] GET /identity/v3/role_assignments?user.id=29bf1d71ba094d579e15c2ecc72505b6&scope.project.id=b3f5af7a5da14e5c84bea28cc3aa5626&role.id=dd71f7898e6a4d9f99d1554dd7d27033 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:20.087454 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6998e98d-066e-4269-9e53-5ed0adc3f0b6 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:20.088083 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6998e98d-066e-4269-9e53-5ed0adc3f0b6 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:20.088593 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6998e98d-066e-4269-9e53-5ed0adc3f0b6 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:20.090353 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 106/209] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:21:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:21:20.096836 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80471916-2c69-4edf-80a9-15742152c1f2 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:20.097512 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80471916-2c69-4edf-80a9-15742152c1f2 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:20.097998 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80471916-2c69-4edf-80a9-15742152c1f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:20.118248 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-80471916-2c69-4edf-80a9-15742152c1f2 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:21:20.119816 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-80471916-2c69-4edf-80a9-15742152c1f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:21:20.134679 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:20.192682 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 104/210] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:21:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:21:20.218553 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6998e98d-066e-4269-9e53-5ed0adc3f0b6 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:20.227758 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:20.327025 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6998e98d-066e-4269-9e53-5ed0adc3f0b6 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:20.364798 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9171df17-2a03-4b4c-a49e-3085b4d73875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:20.365636 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9171df17-2a03-4b4c-a49e-3085b4d73875 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:20.365922 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9171df17-2a03-4b4c-a49e-3085b4d73875 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:20.366222 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9171df17-2a03-4b4c-a49e-3085b4d73875 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:20.367422 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9171df17-2a03-4b4c-a49e-3085b4d73875 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:20.368869 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9171df17-2a03-4b4c-a49e-3085b4d73875 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:20.370726 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 107/211] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:21:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:20.376368 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80471916-2c69-4edf-80a9-15742152c1f2 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:20.470978 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20eff7-6312-48dd-8601-95e563c43bc0 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:20.471332 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20eff7-6312-48dd-8601-95e563c43bc0 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:20.471611 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20eff7-6312-48dd-8601-95e563c43bc0 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:20.473751 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 108/212] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:21:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 19:21:20.478971 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0710a7e4-e0c1-4b8b-9f50-323c4a5e1e5a None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:20.479581 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0710a7e4-e0c1-4b8b-9f50-323c4a5e1e5a None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:20.480312 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0710a7e4-e0c1-4b8b-9f50-323c4a5e1e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:20.486543 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80471916-2c69-4edf-80a9-15742152c1f2 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:20.502119 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-0710a7e4-e0c1-4b8b-9f50-323c4a5e1e5a None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:21:20.504279 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-0710a7e4-e0c1-4b8b-9f50-323c4a5e1e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:21:20.524227 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe237006-cb6a-4b7c-9ec0-51cb455b8220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:20.525013 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe237006-cb6a-4b7c-9ec0-51cb455b8220 None admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:20.525392 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe237006-cb6a-4b7c-9ec0-51cb455b8220 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:20.525692 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe237006-cb6a-4b7c-9ec0-51cb455b8220 None admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:20.526424 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe237006-cb6a-4b7c-9ec0-51cb455b8220 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:20.528113 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe237006-cb6a-4b7c-9ec0-51cb455b8220 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:20.553108 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 105/213] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Jul 1 19:21:20 2022] POST /identity/v3/users => generated 297 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 19:21:20.594543 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 109/214] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:21:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:21:20.618860 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe237006-cb6a-4b7c-9ec0-51cb455b8220 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:20.623138 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:20.742030 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe237006-cb6a-4b7c-9ec0-51cb455b8220 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:20.779831 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2576e452-f8e6-4161-bee7-89486f486559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:20.781174 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2576e452-f8e6-4161-bee7-89486f486559 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:20.781483 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2576e452-f8e6-4161-bee7-89486f486559 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:20.781758 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2576e452-f8e6-4161-bee7-89486f486559 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:20.793501 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2576e452-f8e6-4161-bee7-89486f486559 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:21:20.801871 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-2576e452-f8e6-4161-bee7-89486f486559 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 01 19:21:20.801871 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:21:20.801871 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:21:20.801871 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:21:20.801871 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:21:20.801871 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:21:20.801871 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:21:20.801871 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:21:20.801871 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:21:20.801871 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:21:20.801871 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:21:20.801871 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:21:20.801871 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:21:20.801871 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:21:20.801871 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:21:20.801871 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:21:20.802758 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:21:20.802758 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:21:20.802758 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:21:20.802758 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:21:20.802758 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:21:20.802758 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:21:20.802758 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:21:20.802758 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:21:20.802758 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:21:20.802758 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:21:20.802758 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:21:20.802758 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:21:20.802758 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:21:20.802758 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:21:20.802758 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:21:20.802758 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:21:20.803939 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:21:20.803939 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:21:20.803939 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:21:20.803939 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:21:20.803939 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:21:20.803939 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:21:20.803939 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:21:20.803939 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:21:20.803939 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:21:20.803939 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:21:20.803939 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 01 19:21:20.803939 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:21:20.803939 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 106/215] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Jul 1 19:21:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:21:20.809351 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0710a7e4-e0c1-4b8b-9f50-323c4a5e1e5a None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:20.812660 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:20.935450 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0710a7e4-e0c1-4b8b-9f50-323c4a5e1e5a None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:20.977440 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22597144-abff-4902-bd56-17a2e10ffb83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:20.978625 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22597144-abff-4902-bd56-17a2e10ffb83 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:20.979117 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22597144-abff-4902-bd56-17a2e10ffb83 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:20.979585 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22597144-abff-4902-bd56-17a2e10ffb83 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:20.980364 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22597144-abff-4902-bd56-17a2e10ffb83 None admin] RBAC: Adding query filter params (name=member) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:20.980676 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22597144-abff-4902-bd56-17a2e10ffb83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:20.982099 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22597144-abff-4902-bd56-17a2e10ffb83 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:20.995669 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 110/216] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Jul 1 19:21:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:21.001135 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2576e452-f8e6-4161-bee7-89486f486559 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:21.085840 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:21.128166 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2576e452-f8e6-4161-bee7-89486f486559 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:21.168810 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be4a925-c22b-4a16-a2d0-cd3b910a7ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:21.169759 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4a925-c22b-4a16-a2d0-cd3b910a7ec1 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:21.170045 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4a925-c22b-4a16-a2d0-cd3b910a7ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:21.170320 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4a925-c22b-4a16-a2d0-cd3b910a7ec1 None admin] PATH_INFO: `/v3/users/a7df5393c9c94a078adbaff2032520d2` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:21.190093 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be4a925-c22b-4a16-a2d0-cd3b910a7ec1 None admin] RBAC: Authorizing `identity:get_user(user_id=a7df5393c9c94a078adbaff2032520d2)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:21.191560 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be4a925-c22b-4a16-a2d0-cd3b910a7ec1 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:21.193332 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 107/217] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Jul 1 19:21:21 2022] GET /identity/v3/users/a7df5393c9c94a078adbaff2032520d2 => generated 297 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:21.202885 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22597144-abff-4902-bd56-17a2e10ffb83 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:21.313047 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:21.360407 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22597144-abff-4902-bd56-17a2e10ffb83 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:21.411359 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f643e8f-7a80-486a-bbc2-8934c6aab3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:21.412019 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f643e8f-7a80-486a-bbc2-8934c6aab3e2 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:21.412386 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f643e8f-7a80-486a-bbc2-8934c6aab3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:21.412606 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f643e8f-7a80-486a-bbc2-8934c6aab3e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:21.492247 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f643e8f-7a80-486a-bbc2-8934c6aab3e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:21.497764 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f643e8f-7a80-486a-bbc2-8934c6aab3e2 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:21.511053 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35dc7b-af6d-4f81-b462-397e431cf0df None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:21.511356 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35dc7b-af6d-4f81-b462-397e431cf0df None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:21.511700 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35dc7b-af6d-4f81-b462-397e431cf0df None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:21.513395 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 108/218] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:21:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:21:21.533512 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc8e46-af6d-435c-85dc-65381ac6070d None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:21.533835 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc8e46-af6d-435c-85dc-65381ac6070d None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:21.534145 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc8e46-af6d-435c-85dc-65381ac6070d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:21.572695 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:21.585132 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-02fc8e46-af6d-435c-85dc-65381ac6070d None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:21:21.586826 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-02fc8e46-af6d-435c-85dc-65381ac6070d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:21:21.610915 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 111/219] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Jul 1 19:21:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 19:21:21.616309 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f643e8f-7a80-486a-bbc2-8934c6aab3e2 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:21.733583 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 109/220] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:21:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:21:21.763461 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc8e46-af6d-435c-85dc-65381ac6070d None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:21.791291 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f643e8f-7a80-486a-bbc2-8934c6aab3e2 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:21.857683 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf17f8a-3861-422b-9729-b03b4ae74fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:21.859099 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf17f8a-3861-422b-9729-b03b4ae74fa9 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:21.859387 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf17f8a-3861-422b-9729-b03b4ae74fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:21.859666 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf17f8a-3861-422b-9729-b03b4ae74fa9 None admin] PATH_INFO: `/v3/projects/b3f5af7a5da14e5c84bea28cc3aa5626` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:21.865685 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:21.870144 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf17f8a-3861-422b-9729-b03b4ae74fa9 None admin] RBAC: Authorizing `identity:get_project(project_id=b3f5af7a5da14e5c84bea28cc3aa5626)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:21.871660 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf17f8a-3861-422b-9729-b03b4ae74fa9 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:21.873522 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 112/221] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Jul 1 19:21:21 2022] GET /identity/v3/projects/b3f5af7a5da14e5c84bea28cc3aa5626 => generated 302 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:21.880785 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf17f8a-3861-422b-9729-b03b4ae74fa9 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:21.924611 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc8e46-af6d-435c-85dc-65381ac6070d None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:21.970248 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909a3022-2a14-441a-a89b-4fa3fdd6937e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:21.972127 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a3022-2a14-441a-a89b-4fa3fdd6937e None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:21.972474 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a3022-2a14-441a-a89b-4fa3fdd6937e None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:21.972816 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a3022-2a14-441a-a89b-4fa3fdd6937e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:21.977581 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:22.001601 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909a3022-2a14-441a-a89b-4fa3fdd6937e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:21:22.013384 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-909a3022-2a14-441a-a89b-4fa3fdd6937e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:21:22.013384 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:21:22.013384 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:21:22.013384 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:21:22.013384 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:21:22.013384 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:21:22.013384 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:21:22.013384 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:21:22.013384 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:21:22.013384 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:21:22.013384 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:21:22.013384 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:21:22.013384 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:21:22.013384 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:21:22.013384 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:21:22.013384 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:21:22.014320 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:21:22.014320 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:21:22.014320 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:21:22.014320 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:21:22.014320 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:21:22.014320 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:21:22.014320 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:21:22.014320 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:21:22.014320 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:21:22.014320 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:21:22.014320 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:21:22.014320 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:21:22.014320 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:21:22.014320 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:21:22.014320 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:21:22.014320 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:21:22.015175 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:21:22.015175 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:21:22.015175 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:21:22.015175 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:21:22.015175 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:21:22.015175 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:21:22.015175 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:21:22.015175 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:21:22.015175 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:21:22.015175 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:21:22.015175 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:21:22.015175 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:21:22.015175 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 110/222] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Jul 1 19:21:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:21:22.021788 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909a3022-2a14-441a-a89b-4fa3fdd6937e None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:22.138451 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf17f8a-3861-422b-9729-b03b4ae74fa9 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:22.182051 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909a3022-2a14-441a-a89b-4fa3fdd6937e None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:22.197194 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:22.206854 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4156ca-4766-4bd3-add1-aacb3796d190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:22.207859 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4156ca-4766-4bd3-add1-aacb3796d190 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:22.208348 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4156ca-4766-4bd3-add1-aacb3796d190 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:22.208826 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4156ca-4766-4bd3-add1-aacb3796d190 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:22.209942 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4156ca-4766-4bd3-add1-aacb3796d190 None admin] RBAC: Adding query filter params (role.id=4cbf6ec846eb4b7c8cc52e9bfd6f076f, scope.project.id=b3f5af7a5da14e5c84bea28cc3aa5626, user.id=a7df5393c9c94a078adbaff2032520d2) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:22.214641 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4156ca-4766-4bd3-add1-aacb3796d190 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:22.221020 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4156ca-4766-4bd3-add1-aacb3796d190 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:22.229847 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 113/223] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Jul 1 19:21:21 2022] GET /identity/v3/role_assignments?user.id=a7df5393c9c94a078adbaff2032520d2&scope.project.id=b3f5af7a5da14e5c84bea28cc3aa5626&role.id=4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 259 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:22.257142 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d84ed5-a4f4-47ab-a7a2-999d3733768c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:22.258366 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d84ed5-a4f4-47ab-a7a2-999d3733768c None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:22.258903 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d84ed5-a4f4-47ab-a7a2-999d3733768c None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:22.259453 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d84ed5-a4f4-47ab-a7a2-999d3733768c None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:22.260693 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d84ed5-a4f4-47ab-a7a2-999d3733768c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:22.261344 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d84ed5-a4f4-47ab-a7a2-999d3733768c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:22.263381 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d84ed5-a4f4-47ab-a7a2-999d3733768c None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:22.286180 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 111/224] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Jul 1 19:21:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:21:22.292186 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4156ca-4766-4bd3-add1-aacb3796d190 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:22.303964 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05d451-ed05-4d5e-a19e-4e6e2c056660 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:22.305834 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05d451-ed05-4d5e-a19e-4e6e2c056660 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:22.307332 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05d451-ed05-4d5e-a19e-4e6e2c056660 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:22.309053 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 112/225] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:21:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:21:22.318804 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b4cce-fe16-4708-bb1e-075018300284 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:22.319352 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b4cce-fe16-4708-bb1e-075018300284 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:22.319777 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b4cce-fe16-4708-bb1e-075018300284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:22.354891 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-a14b4cce-fe16-4708-bb1e-075018300284 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:21:22.356134 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-a14b4cce-fe16-4708-bb1e-075018300284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:21:22.481546 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4156ca-4766-4bd3-add1-aacb3796d190 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:22.482998 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 113/226] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:21:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:21:22.484534 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:22.507838 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14b4cce-fe16-4708-bb1e-075018300284 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:22.520339 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b65dc89-aedb-4482-acdf-e5946a9e10bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:22.521223 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b65dc89-aedb-4482-acdf-e5946a9e10bb None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:22.521537 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b65dc89-aedb-4482-acdf-e5946a9e10bb None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:22.522188 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b65dc89-aedb-4482-acdf-e5946a9e10bb None admin] PATH_INFO: `/v3/users/29bf1d71ba094d579e15c2ecc72505b6` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:22.523224 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b65dc89-aedb-4482-acdf-e5946a9e10bb None admin] RBAC: Authorizing `identity:get_user(user_id=29bf1d71ba094d579e15c2ecc72505b6)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:22.524682 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b65dc89-aedb-4482-acdf-e5946a9e10bb None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:22.526755 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 114/227] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Jul 1 19:21:22 2022] GET /identity/v3/users/29bf1d71ba094d579e15c2ecc72505b6 => generated 283 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:22.533878 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b65dc89-aedb-4482-acdf-e5946a9e10bb None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:22.690274 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b65dc89-aedb-4482-acdf-e5946a9e10bb None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:22.728342 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038dc497-5b8e-47d6-bfed-dcb405e9cf06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:22.729557 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038dc497-5b8e-47d6-bfed-dcb405e9cf06 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:22.729991 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038dc497-5b8e-47d6-bfed-dcb405e9cf06 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:22.730412 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038dc497-5b8e-47d6-bfed-dcb405e9cf06 None admin] PATH_INFO: `/v3/projects/b3f5af7a5da14e5c84bea28cc3aa5626` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:22.731800 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038dc497-5b8e-47d6-bfed-dcb405e9cf06 None admin] RBAC: Authorizing `identity:get_project(project_id=b3f5af7a5da14e5c84bea28cc3aa5626)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:22.733671 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038dc497-5b8e-47d6-bfed-dcb405e9cf06 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:22.735750 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 115/228] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Jul 1 19:21:22 2022] GET /identity/v3/projects/b3f5af7a5da14e5c84bea28cc3aa5626 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:21:22.739849 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14b4cce-fe16-4708-bb1e-075018300284 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:22.741304 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:22.743023 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038dc497-5b8e-47d6-bfed-dcb405e9cf06 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:22.789957 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9425626-1a16-4835-b511-564e51bd8b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:22.791174 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9425626-1a16-4835-b511-564e51bd8b88 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:22.791686 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9425626-1a16-4835-b511-564e51bd8b88 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:22.792158 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9425626-1a16-4835-b511-564e51bd8b88 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:22.801802 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:22.810526 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9425626-1a16-4835-b511-564e51bd8b88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:21:22.825227 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-a9425626-1a16-4835-b511-564e51bd8b88 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 19:21:22.825227 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:21:22.825227 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:21:22.825227 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:21:22.825227 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:21:22.825227 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:21:22.825227 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:21:22.825227 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:21:22.825227 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:21:22.825227 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:21:22.825227 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:21:22.825227 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:21:22.825227 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:21:22.825227 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:21:22.825227 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:21:22.825227 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:21:22.826170 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:21:22.826170 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:21:22.826170 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:21:22.826170 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:21:22.826170 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:21:22.826170 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:21:22.826170 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:21:22.826170 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:21:22.826170 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:21:22.826170 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:21:22.826170 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:21:22.826170 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:21:22.826170 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:21:22.826170 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:21:22.826170 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:21:22.826170 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:21:22.826964 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:21:22.826964 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:21:22.826964 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:21:22.826964 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:21:22.826964 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:21:22.826964 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:21:22.826964 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:21:22.826964 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:21:22.826964 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:21:22.826964 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:21:22.826964 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 19:21:22.826964 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:21:22.829274 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 114/229] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Jul 1 19:21:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:21:22.834989 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9425626-1a16-4835-b511-564e51bd8b88 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:22.907020 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038dc497-5b8e-47d6-bfed-dcb405e9cf06 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:22.977701 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5044aaf-3908-4dab-a2e7-7898f96bbf55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:22.978647 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5044aaf-3908-4dab-a2e7-7898f96bbf55 None admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:22.978935 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5044aaf-3908-4dab-a2e7-7898f96bbf55 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:22.979217 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5044aaf-3908-4dab-a2e7-7898f96bbf55 None admin] PATH_INFO: `/v3/projects/b3f5af7a5da14e5c84bea28cc3aa5626/users/29bf1d71ba094d579e15c2ecc72505b6/roles/6cb03785fb184ef587509b3174622f69` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:22.986503 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5044aaf-3908-4dab-a2e7-7898f96bbf55 None admin] RBAC: Authorizing `identity:create_grant(project_id=b3f5af7a5da14e5c84bea28cc3aa5626, user_id=29bf1d71ba094d579e15c2ecc72505b6, role_id=6cb03785fb184ef587509b3174622f69)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:22.987984 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5044aaf-3908-4dab-a2e7-7898f96bbf55 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:23.016521 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 116/230] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Jul 1 19:21:22 2022] PUT /identity/v3/projects/b3f5af7a5da14e5c84bea28cc3aa5626/users/29bf1d71ba094d579e15c2ecc72505b6/roles/6cb03785fb184ef587509b3174622f69 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:21:23.036048 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9425626-1a16-4835-b511-564e51bd8b88 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:23.075438 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5b3bb2-e150-4564-af89-d4bea7bbff35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:23.076130 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b3bb2-e150-4564-af89-d4bea7bbff35 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:23.076419 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b3bb2-e150-4564-af89-d4bea7bbff35 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:23.076699 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b3bb2-e150-4564-af89-d4bea7bbff35 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:23.078212 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5b3bb2-e150-4564-af89-d4bea7bbff35 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:23.078528 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5b3bb2-e150-4564-af89-d4bea7bbff35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:23.080054 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5b3bb2-e150-4564-af89-d4bea7bbff35 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:23.090822 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 115/231] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Jul 1 19:21:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:21:23.098511 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5044aaf-3908-4dab-a2e7-7898f96bbf55 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:23.232113 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:23.244100 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5044aaf-3908-4dab-a2e7-7898f96bbf55 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:23.283456 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baff9b72-b2ff-4d1e-8c22-11b1462c585b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:23.284347 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff9b72-b2ff-4d1e-8c22-11b1462c585b None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:23.284634 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff9b72-b2ff-4d1e-8c22-11b1462c585b None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:23.284916 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff9b72-b2ff-4d1e-8c22-11b1462c585b None admin] PATH_INFO: `/v3/users/29bf1d71ba094d579e15c2ecc72505b6` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:23.286218 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baff9b72-b2ff-4d1e-8c22-11b1462c585b None admin] RBAC: Authorizing `identity:get_user(user_id=29bf1d71ba094d579e15c2ecc72505b6)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:23.288019 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baff9b72-b2ff-4d1e-8c22-11b1462c585b None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:23.290029 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 117/232] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Jul 1 19:21:23 2022] GET /identity/v3/users/29bf1d71ba094d579e15c2ecc72505b6 => generated 283 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:23.296432 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5b3bb2-e150-4564-af89-d4bea7bbff35 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:23.329104 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:23.430679 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5b3bb2-e150-4564-af89-d4bea7bbff35 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:23.470123 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07a73d-d670-4794-81cf-e5349f93f821 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:23.470460 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07a73d-d670-4794-81cf-e5349f93f821 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:23.470715 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07a73d-d670-4794-81cf-e5349f93f821 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:23.472348 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 118/233] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:21:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:21:23.478827 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac21f32e-970e-4c4d-b163-e959971442d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:23.479249 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac44a7-1e77-44f0-80d6-2af8c4e0605b None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:23.479550 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac44a7-1e77-44f0-80d6-2af8c4e0605b None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:23.479833 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac44a7-1e77-44f0-80d6-2af8c4e0605b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:23.480623 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21f32e-970e-4c4d-b163-e959971442d8 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:23.481157 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21f32e-970e-4c4d-b163-e959971442d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:23.481662 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21f32e-970e-4c4d-b163-e959971442d8 None admin] PATH_INFO: `/v3/projects/b3f5af7a5da14e5c84bea28cc3aa5626` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:23.483124 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac21f32e-970e-4c4d-b163-e959971442d8 None admin] RBAC: Authorizing `identity:get_project(project_id=b3f5af7a5da14e5c84bea28cc3aa5626)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:23.485321 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac21f32e-970e-4c4d-b163-e959971442d8 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:23.487250 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 116/234] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Jul 1 19:21:23 2022] GET /identity/v3/projects/b3f5af7a5da14e5c84bea28cc3aa5626 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:21:23.493215 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac21f32e-970e-4c4d-b163-e959971442d8 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:23.507174 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-b7ac44a7-1e77-44f0-80d6-2af8c4e0605b None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:21:23.508825 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-b7ac44a7-1e77-44f0-80d6-2af8c4e0605b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:21:23.600617 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 119/235] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:21:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 19:21:23.602106 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801920e-2775-4eed-b110-6002b0c085cc None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:23.602408 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801920e-2775-4eed-b110-6002b0c085cc None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:23.602696 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801920e-2775-4eed-b110-6002b0c085cc None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:23.605324 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 120/236] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:21:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:21:23.611379 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a964e-f763-4331-acef-ea8a15308e07 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:23.614094 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a964e-f763-4331-acef-ea8a15308e07 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:23.614393 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a964e-f763-4331-acef-ea8a15308e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:23.649557 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:23.650390 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-694a964e-f763-4331-acef-ea8a15308e07 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:21:23.652272 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-694a964e-f763-4331-acef-ea8a15308e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:21:23.665269 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac21f32e-970e-4c4d-b163-e959971442d8 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:23.726683 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae66a3-b7b6-48df-bc9c-d58977f2684a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:23.728087 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae66a3-b7b6-48df-bc9c-d58977f2684a None admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:23.728440 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae66a3-b7b6-48df-bc9c-d58977f2684a None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:23.728790 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae66a3-b7b6-48df-bc9c-d58977f2684a None admin] PATH_INFO: `/v3/projects/b3f5af7a5da14e5c84bea28cc3aa5626/users/29bf1d71ba094d579e15c2ecc72505b6/roles/dd71f7898e6a4d9f99d1554dd7d27033` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:23.732091 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ae66a3-b7b6-48df-bc9c-d58977f2684a None admin] RBAC: Authorizing `identity:create_grant(project_id=b3f5af7a5da14e5c84bea28cc3aa5626, user_id=29bf1d71ba094d579e15c2ecc72505b6, role_id=dd71f7898e6a4d9f99d1554dd7d27033)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:23.735447 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ae66a3-b7b6-48df-bc9c-d58977f2684a None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:23.754629 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 121/237] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:21:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 19:21:23.756057 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694a964e-f763-4331-acef-ea8a15308e07 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:23.756488 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 117/238] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Jul 1 19:21:23 2022] PUT /identity/v3/projects/b3f5af7a5da14e5c84bea28cc3aa5626/users/29bf1d71ba094d579e15c2ecc72505b6/roles/dd71f7898e6a4d9f99d1554dd7d27033 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:21:23.797472 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:23.802080 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae66a3-b7b6-48df-bc9c-d58977f2684a None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:23.895534 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694a964e-f763-4331-acef-ea8a15308e07 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:23.939450 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17557f3b-a797-469a-8def-c11d89895ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:23.940563 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17557f3b-a797-469a-8def-c11d89895ada None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:23.940920 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17557f3b-a797-469a-8def-c11d89895ada None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:23.941283 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17557f3b-a797-469a-8def-c11d89895ada None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:23.955547 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17557f3b-a797-469a-8def-c11d89895ada None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:21:23.964857 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-17557f3b-a797-469a-8def-c11d89895ada None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 01 19:21:23.964857 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:21:23.964857 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:21:23.964857 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:21:23.964857 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:21:23.964857 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:21:23.964857 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:21:23.964857 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:21:23.964857 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:21:23.964857 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:21:23.964857 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:21:23.964857 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:21:23.964857 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:21:23.964857 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:21:23.964857 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:21:23.964857 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:21:23.965841 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:21:23.965841 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:21:23.965841 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:21:23.965841 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:21:23.965841 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:21:23.965841 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:21:23.965841 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:21:23.965841 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:21:23.965841 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:21:23.965841 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:21:23.965841 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:21:23.965841 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:21:23.965841 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:21:23.965841 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:21:23.965841 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:21:23.965841 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:21:23.966631 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:21:23.966631 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:21:23.966631 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:21:23.966631 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:21:23.966631 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:21:23.966631 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:21:23.966631 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:21:23.966631 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:21:23.966631 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:21:23.966631 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:21:23.966631 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 01 19:21:23.966631 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:21:23.966631 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 122/239] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Jul 1 19:21:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:21:23.973653 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17557f3b-a797-469a-8def-c11d89895ada None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:24.038725 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae66a3-b7b6-48df-bc9c-d58977f2684a None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:24.076058 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3b927e-c74f-4cf8-a60d-61d6582dcfcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:24.076945 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b927e-c74f-4cf8-a60d-61d6582dcfcb None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:24.077800 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b927e-c74f-4cf8-a60d-61d6582dcfcb None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:24.078244 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b927e-c74f-4cf8-a60d-61d6582dcfcb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:24.080356 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3b927e-c74f-4cf8-a60d-61d6582dcfcb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:24.081885 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3b927e-c74f-4cf8-a60d-61d6582dcfcb None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:24.083552 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 118/240] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:21:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:24.088898 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3b927e-c74f-4cf8-a60d-61d6582dcfcb None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:24.099825 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:24.120354 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17557f3b-a797-469a-8def-c11d89895ada None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:24.157149 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41300795-5d2f-4bb6-85d6-d91d871f8478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:24.157827 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:24.157967 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41300795-5d2f-4bb6-85d6-d91d871f8478 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:24.158131 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41300795-5d2f-4bb6-85d6-d91d871f8478 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:24.158398 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41300795-5d2f-4bb6-85d6-d91d871f8478 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:24.159215 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41300795-5d2f-4bb6-85d6-d91d871f8478 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:24.159530 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41300795-5d2f-4bb6-85d6-d91d871f8478 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:24.160914 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41300795-5d2f-4bb6-85d6-d91d871f8478 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:24.171471 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 123/241] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Jul 1 19:21:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:21:24.182434 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41300795-5d2f-4bb6-85d6-d91d871f8478 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:24.218489 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3b927e-c74f-4cf8-a60d-61d6582dcfcb None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:24.291551 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d36d71-b556-4a61-a2ea-0da2f770706b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:24.292143 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d36d71-b556-4a61-a2ea-0da2f770706b None admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:24.292427 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d36d71-b556-4a61-a2ea-0da2f770706b None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:24.292700 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d36d71-b556-4a61-a2ea-0da2f770706b None admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:24.293442 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d36d71-b556-4a61-a2ea-0da2f770706b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:24.294896 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d36d71-b556-4a61-a2ea-0da2f770706b None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:24.336243 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 119/242] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Jul 1 19:21:24 2022] POST /identity/v3/users => generated 293 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:21:24.351334 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41300795-5d2f-4bb6-85d6-d91d871f8478 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:24.391923 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a3c8de-cfcb-4eec-8f06-843994174ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:24.392881 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a3c8de-cfcb-4eec-8f06-843994174ac4 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:24.393174 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a3c8de-cfcb-4eec-8f06-843994174ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:24.393548 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a3c8de-cfcb-4eec-8f06-843994174ac4 None admin] PATH_INFO: `/v3/users/2d70a137809647cf9b34ee5638dbb944` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:24.410377 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a3c8de-cfcb-4eec-8f06-843994174ac4 None admin] RBAC: Authorizing `identity:get_user(user_id=2d70a137809647cf9b34ee5638dbb944)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:24.411929 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a3c8de-cfcb-4eec-8f06-843994174ac4 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:24.413860 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 124/243] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Jul 1 19:21:24 2022] GET /identity/v3/users/2d70a137809647cf9b34ee5638dbb944 => generated 297 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:24.419661 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d36d71-b556-4a61-a2ea-0da2f770706b None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:24.541219 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:24.573629 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d36d71-b556-4a61-a2ea-0da2f770706b None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:24.616941 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9231f375-e971-4a59-94bc-3e01fc874959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:24.617642 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231f375-e971-4a59-94bc-3e01fc874959 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:24.617982 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231f375-e971-4a59-94bc-3e01fc874959 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:24.618248 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231f375-e971-4a59-94bc-3e01fc874959 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:24.696562 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9231f375-e971-4a59-94bc-3e01fc874959 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:24.698131 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9231f375-e971-4a59-94bc-3e01fc874959 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:24.780191 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:24.791754 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d99c1-9484-4f9b-8729-ff380aa9fd24 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:24.792720 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d99c1-9484-4f9b-8729-ff380aa9fd24 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:24.793208 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d99c1-9484-4f9b-8729-ff380aa9fd24 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:24.794863 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 125/244] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:21:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:21:24.801162 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad0eb00-9606-4365-9ccc-982f522e81b8 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:24.801764 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad0eb00-9606-4365-9ccc-982f522e81b8 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:24.802242 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad0eb00-9606-4365-9ccc-982f522e81b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:24.806459 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 120/245] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Jul 1 19:21:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 19:21:24.808297 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:24.812291 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9231f375-e971-4a59-94bc-3e01fc874959 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:24.822710 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-8ad0eb00-9606-4365-9ccc-982f522e81b8 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:21:24.824262 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-8ad0eb00-9606-4365-9ccc-982f522e81b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:21:24.898055 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 126/246] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:21:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:21:24.921212 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9231f375-e971-4a59-94bc-3e01fc874959 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:24.923577 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad0eb00-9606-4365-9ccc-982f522e81b8 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:24.959410 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a21c45-0833-4783-8e08-af9917f28927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:24.960340 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a21c45-0833-4783-8e08-af9917f28927 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:24.960557 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a21c45-0833-4783-8e08-af9917f28927 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:24.960839 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a21c45-0833-4783-8e08-af9917f28927 None admin] PATH_INFO: `/v3/projects/b3f5af7a5da14e5c84bea28cc3aa5626` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:24.962080 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a21c45-0833-4783-8e08-af9917f28927 None admin] RBAC: Authorizing `identity:get_project(project_id=b3f5af7a5da14e5c84bea28cc3aa5626)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:24.963542 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a21c45-0833-4783-8e08-af9917f28927 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:24.965357 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 121/247] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Jul 1 19:21:24 2022] GET /identity/v3/projects/b3f5af7a5da14e5c84bea28cc3aa5626 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:21:24.972344 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a21c45-0833-4783-8e08-af9917f28927 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:25.022308 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:25.050256 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad0eb00-9606-4365-9ccc-982f522e81b8 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:25.082404 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a21c45-0833-4783-8e08-af9917f28927 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:25.084227 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:25.090725 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f5c4c0-6824-4561-a7a6-91a446db032b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:25.092216 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f5c4c0-6824-4561-a7a6-91a446db032b None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:25.092744 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f5c4c0-6824-4561-a7a6-91a446db032b None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:25.093759 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f5c4c0-6824-4561-a7a6-91a446db032b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:25.105401 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f5c4c0-6824-4561-a7a6-91a446db032b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:21:25.113517 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-b2f5c4c0-6824-4561-a7a6-91a446db032b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 01 19:21:25.113517 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:21:25.113517 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:21:25.113517 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:21:25.113517 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:21:25.113517 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:21:25.113517 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:21:25.113517 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:21:25.113517 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:21:25.113517 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:21:25.113517 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:21:25.113517 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:21:25.113517 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:21:25.113517 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:21:25.113517 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:21:25.113517 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:21:25.114409 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:21:25.114409 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:21:25.114409 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:21:25.114409 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:21:25.114409 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:21:25.114409 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:21:25.114409 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:21:25.114409 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:21:25.114409 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:21:25.114409 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:21:25.114409 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:21:25.114409 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:21:25.114409 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:21:25.114409 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:21:25.114409 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:21:25.114409 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:21:25.115228 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:21:25.115228 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:21:25.115228 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:21:25.115228 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:21:25.115228 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:21:25.115228 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:21:25.115228 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:21:25.115228 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:21:25.115228 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:21:25.115228 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:21:25.115228 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 01 19:21:25.115228 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:21:25.117726 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 127/248] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Jul 1 19:21:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:21:25.124849 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f5c4c0-6824-4561-a7a6-91a446db032b None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:25.125086 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887330e5-eeef-4cb1-8f69-464b9dcf13e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:25.125729 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887330e5-eeef-4cb1-8f69-464b9dcf13e8 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:25.126058 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887330e5-eeef-4cb1-8f69-464b9dcf13e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:25.126335 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887330e5-eeef-4cb1-8f69-464b9dcf13e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:25.127269 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887330e5-eeef-4cb1-8f69-464b9dcf13e8 None admin] RBAC: Adding query filter params (role.id=f4f5eb791e8749f18c9d57c113558e15, scope.project.id=b3f5af7a5da14e5c84bea28cc3aa5626, user.id=2d70a137809647cf9b34ee5638dbb944) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:25.127586 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887330e5-eeef-4cb1-8f69-464b9dcf13e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:25.129164 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887330e5-eeef-4cb1-8f69-464b9dcf13e8 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:25.135595 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 122/249] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Jul 1 19:21:24 2022] GET /identity/v3/role_assignments?user.id=2d70a137809647cf9b34ee5638dbb944&scope.project.id=b3f5af7a5da14e5c84bea28cc3aa5626&role.id=f4f5eb791e8749f18c9d57c113558e15 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:21:25.244195 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f5c4c0-6824-4561-a7a6-91a446db032b None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:25.283267 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3d9c32-b8d2-4913-8168-e688c6be9501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:25.284347 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d9c32-b8d2-4913-8168-e688c6be9501 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:25.284870 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d9c32-b8d2-4913-8168-e688c6be9501 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:25.285386 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d9c32-b8d2-4913-8168-e688c6be9501 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:25.286364 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3d9c32-b8d2-4913-8168-e688c6be9501 None admin] RBAC: Adding query filter params (name=member) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:25.286909 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3d9c32-b8d2-4913-8168-e688c6be9501 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:25.289174 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3d9c32-b8d2-4913-8168-e688c6be9501 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:25.299594 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 128/250] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Jul 1 19:21:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:21:25.306167 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887330e5-eeef-4cb1-8f69-464b9dcf13e8 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:25.423759 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887330e5-eeef-4cb1-8f69-464b9dcf13e8 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:25.435537 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:25.467448 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adbef40-0f80-4c40-a6c1-7b6ed31984d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:25.468452 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adbef40-0f80-4c40-a6c1-7b6ed31984d1 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:25.468738 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adbef40-0f80-4c40-a6c1-7b6ed31984d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:25.469012 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adbef40-0f80-4c40-a6c1-7b6ed31984d1 None admin] PATH_INFO: `/v3/users/a7df5393c9c94a078adbaff2032520d2` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:25.470340 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adbef40-0f80-4c40-a6c1-7b6ed31984d1 None admin] RBAC: Authorizing `identity:get_user(user_id=a7df5393c9c94a078adbaff2032520d2)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:25.471894 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adbef40-0f80-4c40-a6c1-7b6ed31984d1 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:25.473968 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 123/251] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Jul 1 19:21:25 2022] GET /identity/v3/users/a7df5393c9c94a078adbaff2032520d2 => generated 297 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:25.479324 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3d9c32-b8d2-4913-8168-e688c6be9501 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:25.557454 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:25.613813 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3d9c32-b8d2-4913-8168-e688c6be9501 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:25.655077 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f6d4c-43b0-4486-91fb-68750c8e1205 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:25.655433 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f6d4c-43b0-4486-91fb-68750c8e1205 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:25.655700 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f6d4c-43b0-4486-91fb-68750c8e1205 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:25.657219 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 124/252] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:21:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 19:21:25.665131 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7384ce46-0c13-4c42-a5f8-f2499de202b1 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:25.665446 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7384ce46-0c13-4c42-a5f8-f2499de202b1 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:25.665727 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7384ce46-0c13-4c42-a5f8-f2499de202b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:25.670721 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc41680e-3c37-458b-b765-b3a7483323f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:25.672130 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc41680e-3c37-458b-b765-b3a7483323f3 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:25.672417 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc41680e-3c37-458b-b765-b3a7483323f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:25.672695 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc41680e-3c37-458b-b765-b3a7483323f3 None admin] PATH_INFO: `/v3/projects/b3f5af7a5da14e5c84bea28cc3aa5626` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:25.674995 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc41680e-3c37-458b-b765-b3a7483323f3 None admin] RBAC: Authorizing `identity:get_project(project_id=b3f5af7a5da14e5c84bea28cc3aa5626)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:25.676412 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc41680e-3c37-458b-b765-b3a7483323f3 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:25.678259 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 129/253] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Jul 1 19:21:25 2022] GET /identity/v3/projects/b3f5af7a5da14e5c84bea28cc3aa5626 => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:25.684386 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc41680e-3c37-458b-b765-b3a7483323f3 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:25.698315 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-7384ce46-0c13-4c42-a5f8-f2499de202b1 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:21:25.699545 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-7384ce46-0c13-4c42-a5f8-f2499de202b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:21:25.793223 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc41680e-3c37-458b-b765-b3a7483323f3 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:25.825607 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:25.832034 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 125/254] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:21:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:21:25.850556 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0bc436-6c36-4645-9f49-953a7cd4528b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:25.851463 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0bc436-6c36-4645-9f49-953a7cd4528b None admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:25.851749 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0bc436-6c36-4645-9f49-953a7cd4528b None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:25.852025 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0bc436-6c36-4645-9f49-953a7cd4528b None admin] PATH_INFO: `/v3/projects/b3f5af7a5da14e5c84bea28cc3aa5626/users/a7df5393c9c94a078adbaff2032520d2/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:25.859175 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0bc436-6c36-4645-9f49-953a7cd4528b None admin] RBAC: Authorizing `identity:create_grant(project_id=b3f5af7a5da14e5c84bea28cc3aa5626, user_id=a7df5393c9c94a078adbaff2032520d2, role_id=4cbf6ec846eb4b7c8cc52e9bfd6f076f)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:25.860638 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0bc436-6c36-4645-9f49-953a7cd4528b None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:25.878190 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7384ce46-0c13-4c42-a5f8-f2499de202b1 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:25.879120 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 130/255] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Jul 1 19:21:25 2022] PUT /identity/v3/projects/b3f5af7a5da14e5c84bea28cc3aa5626/users/a7df5393c9c94a078adbaff2032520d2/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 19:21:26.017394 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7384ce46-0c13-4c42-a5f8-f2499de202b1 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:26.032510 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:26.068860 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14b8985-243b-4d4d-998c-6e52dce20fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:26.069707 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14b8985-243b-4d4d-998c-6e52dce20fa9 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:26.069996 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14b8985-243b-4d4d-998c-6e52dce20fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:26.070274 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14b8985-243b-4d4d-998c-6e52dce20fa9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:26.087140 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14b8985-243b-4d4d-998c-6e52dce20fa9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:21:26.095365 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-e14b8985-243b-4d4d-998c-6e52dce20fa9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:21:26.095365 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:21:26.095365 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:21:26.095365 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:21:26.095365 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:21:26.095365 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:21:26.095365 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:21:26.095365 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:21:26.095365 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:21:26.095365 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:21:26.095365 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:21:26.095365 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:21:26.095365 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:21:26.095365 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:21:26.095365 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:21:26.095365 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:21:26.096229 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:21:26.096229 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:21:26.096229 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:21:26.096229 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:21:26.096229 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:21:26.096229 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:21:26.096229 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:21:26.096229 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:21:26.096229 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:21:26.096229 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:21:26.096229 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:21:26.096229 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:21:26.096229 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:21:26.096229 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:21:26.096229 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:21:26.096229 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:21:26.097678 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:21:26.097678 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:21:26.097678 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:21:26.097678 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:21:26.097678 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:21:26.097678 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:21:26.097678 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:21:26.097678 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:21:26.097678 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:21:26.097678 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:21:26.097678 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:21:26.097678 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:21:26.097678 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 126/256] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Jul 1 19:21:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:21:26.105641 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0bc436-6c36-4645-9f49-953a7cd4528b None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:26.320358 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0bc436-6c36-4645-9f49-953a7cd4528b None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:26.374596 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a462cb9-c5eb-496a-b439-dbf5f97d8170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:26.375638 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a462cb9-c5eb-496a-b439-dbf5f97d8170 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:26.376098 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a462cb9-c5eb-496a-b439-dbf5f97d8170 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:26.376541 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a462cb9-c5eb-496a-b439-dbf5f97d8170 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:26.377825 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a462cb9-c5eb-496a-b439-dbf5f97d8170 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:26.378335 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a462cb9-c5eb-496a-b439-dbf5f97d8170 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:26.380738 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a462cb9-c5eb-496a-b439-dbf5f97d8170 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:26.394878 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 131/257] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Jul 1 19:21:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:26.402701 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14b8985-243b-4d4d-998c-6e52dce20fa9 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:26.545548 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14b8985-243b-4d4d-998c-6e52dce20fa9 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:26.589663 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a125606f-92fd-41c0-826f-e701ba3580e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:26.590460 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a125606f-92fd-41c0-826f-e701ba3580e2 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:26.590748 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a125606f-92fd-41c0-826f-e701ba3580e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:26.591033 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a125606f-92fd-41c0-826f-e701ba3580e2 None admin] PATH_INFO: `/v3/users/29bf1d71ba094d579e15c2ecc72505b6` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:26.592263 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a125606f-92fd-41c0-826f-e701ba3580e2 None admin] RBAC: Authorizing `identity:get_user(user_id=29bf1d71ba094d579e15c2ecc72505b6)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:26.593848 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a125606f-92fd-41c0-826f-e701ba3580e2 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:26.596670 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 127/258] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Jul 1 19:21:26 2022] GET /identity/v3/users/29bf1d71ba094d579e15c2ecc72505b6 => generated 283 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:26.603292 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a462cb9-c5eb-496a-b439-dbf5f97d8170 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:26.721631 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:26.727331 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a3698-995a-42b9-959b-2879af99ae0e None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:26.727629 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a3698-995a-42b9-959b-2879af99ae0e None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:26.727915 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a3698-995a-42b9-959b-2879af99ae0e None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:26.730716 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 128/259] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:21:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:21:26.738635 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b61cb3-8ad0-42dd-b76c-58ad30c967c4 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:26.738931 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b61cb3-8ad0-42dd-b76c-58ad30c967c4 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:26.739221 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b61cb3-8ad0-42dd-b76c-58ad30c967c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:26.776158 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-f6b61cb3-8ad0-42dd-b76c-58ad30c967c4 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:21:26.777437 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-f6b61cb3-8ad0-42dd-b76c-58ad30c967c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:21:26.788116 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a462cb9-c5eb-496a-b439-dbf5f97d8170 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:26.846800 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:26.852583 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f2c37-4241-405d-9a47-37af5891efc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:26.853382 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f2c37-4241-405d-9a47-37af5891efc6 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:26.853775 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f2c37-4241-405d-9a47-37af5891efc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:26.854157 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f2c37-4241-405d-9a47-37af5891efc6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:26.941721 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 129/260] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:21:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:21:26.966212 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10f2c37-4241-405d-9a47-37af5891efc6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:26.968226 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10f2c37-4241-405d-9a47-37af5891efc6 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:26.988396 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b61cb3-8ad0-42dd-b76c-58ad30c967c4 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:27.044882 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:27.153413 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 132/261] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Jul 1 19:21:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 19:21:27.159740 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f2c37-4241-405d-9a47-37af5891efc6 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:27.238397 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b61cb3-8ad0-42dd-b76c-58ad30c967c4 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:27.336244 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f2c37-4241-405d-9a47-37af5891efc6 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:27.357996 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71e81fa-12fc-44a5-b92c-97037f535be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:27.358846 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e81fa-12fc-44a5-b92c-97037f535be6 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:27.359138 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e81fa-12fc-44a5-b92c-97037f535be6 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:27.359424 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e81fa-12fc-44a5-b92c-97037f535be6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:27.395272 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71e81fa-12fc-44a5-b92c-97037f535be6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:21:27.396259 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfcd025-211c-4c39-9b8b-6d95423cc3c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:27.397536 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfcd025-211c-4c39-9b8b-6d95423cc3c0 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:27.398016 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfcd025-211c-4c39-9b8b-6d95423cc3c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:27.398491 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfcd025-211c-4c39-9b8b-6d95423cc3c0 None admin] PATH_INFO: `/v3/projects/b3f5af7a5da14e5c84bea28cc3aa5626` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:27.399935 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfcd025-211c-4c39-9b8b-6d95423cc3c0 None admin] RBAC: Authorizing `identity:get_project(project_id=b3f5af7a5da14e5c84bea28cc3aa5626)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:27.401620 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfcd025-211c-4c39-9b8b-6d95423cc3c0 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:27.403581 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 133/262] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Jul 1 19:21:27 2022] GET /identity/v3/projects/b3f5af7a5da14e5c84bea28cc3aa5626 => generated 302 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:27.409461 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfcd025-211c-4c39-9b8b-6d95423cc3c0 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:27.410192 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-d71e81fa-12fc-44a5-b92c-97037f535be6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 19:21:27.410192 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:21:27.410192 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:21:27.410192 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:21:27.410192 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:21:27.410192 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:21:27.410192 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:21:27.410192 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:21:27.410192 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:21:27.410192 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:21:27.410192 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:21:27.410192 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:21:27.410192 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:21:27.410192 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:21:27.410192 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:21:27.410192 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:21:27.411067 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:21:27.411067 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:21:27.411067 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:21:27.411067 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:21:27.411067 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:21:27.411067 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:21:27.411067 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:21:27.411067 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:21:27.411067 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:21:27.411067 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:21:27.411067 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:21:27.411067 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:21:27.411067 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:21:27.411067 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:21:27.411067 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:21:27.411067 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:21:27.411849 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:21:27.411849 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:21:27.411849 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:21:27.411849 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:21:27.411849 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:21:27.411849 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:21:27.411849 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:21:27.411849 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:21:27.411849 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:21:27.411849 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:21:27.411849 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 19:21:27.411849 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:21:27.411849 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 130/263] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Jul 1 19:21:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 424 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:21:27.417297 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71e81fa-12fc-44a5-b92c-97037f535be6 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:27.451751 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:27.489622 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:27.583141 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfcd025-211c-4c39-9b8b-6d95423cc3c0 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:27.645154 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71e81fa-12fc-44a5-b92c-97037f535be6 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:27.655985 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b7c70c-467d-429f-b5b9-bac2678199bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:27.656601 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7c70c-467d-429f-b5b9-bac2678199bf None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:27.656885 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7c70c-467d-429f-b5b9-bac2678199bf None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:27.657164 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7c70c-467d-429f-b5b9-bac2678199bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:27.658031 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b7c70c-467d-429f-b5b9-bac2678199bf None admin] RBAC: Adding query filter params (role.id=6cb03785fb184ef587509b3174622f69, scope.project.id=b3f5af7a5da14e5c84bea28cc3aa5626, user.id=29bf1d71ba094d579e15c2ecc72505b6) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:27.658346 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b7c70c-467d-429f-b5b9-bac2678199bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:27.659805 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b7c70c-467d-429f-b5b9-bac2678199bf None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:27.668367 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 134/264] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Jul 1 19:21:27 2022] GET /identity/v3/role_assignments?user.id=29bf1d71ba094d579e15c2ecc72505b6&scope.project.id=b3f5af7a5da14e5c84bea28cc3aa5626&role.id=6cb03785fb184ef587509b3174622f69 => generated 608 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:21:27.710622 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f22bf5-c601-40c1-87c2-5f97267ed8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:27.711320 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f22bf5-c601-40c1-87c2-5f97267ed8d7 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:27.711607 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f22bf5-c601-40c1-87c2-5f97267ed8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:27.711883 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f22bf5-c601-40c1-87c2-5f97267ed8d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:27.712639 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f22bf5-c601-40c1-87c2-5f97267ed8d7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:27.712945 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f22bf5-c601-40c1-87c2-5f97267ed8d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:27.714387 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f22bf5-c601-40c1-87c2-5f97267ed8d7 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:27.729166 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 131/265] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Jul 1 19:21:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:27.735977 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b7c70c-467d-429f-b5b9-bac2678199bf None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:27.798886 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ed4e7-37a3-46ed-afae-481276aee706 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:27.799237 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ed4e7-37a3-46ed-afae-481276aee706 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:27.799473 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ed4e7-37a3-46ed-afae-481276aee706 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:27.800853 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 132/266] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:21:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:21:27.818922 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8af0b-7f0a-4ef5-ba05-343e72919ff5 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:27.819254 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8af0b-7f0a-4ef5-ba05-343e72919ff5 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:27.819485 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8af0b-7f0a-4ef5-ba05-343e72919ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:27.844992 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:27.853641 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-b8e8af0b-7f0a-4ef5-ba05-343e72919ff5 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:21:27.854829 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-b8e8af0b-7f0a-4ef5-ba05-343e72919ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:21:27.881005 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b7c70c-467d-429f-b5b9-bac2678199bf None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:27.932902 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a48a7e9-a597-4ebd-a597-269f18b1dfa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:27.933944 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a48a7e9-a597-4ebd-a597-269f18b1dfa0 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:27.934296 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a48a7e9-a597-4ebd-a597-269f18b1dfa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:27.934637 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a48a7e9-a597-4ebd-a597-269f18b1dfa0 None admin] PATH_INFO: `/v3/users/29bf1d71ba094d579e15c2ecc72505b6` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:27.936483 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a48a7e9-a597-4ebd-a597-269f18b1dfa0 None admin] RBAC: Authorizing `identity:get_user(user_id=29bf1d71ba094d579e15c2ecc72505b6)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:27.938454 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a48a7e9-a597-4ebd-a597-269f18b1dfa0 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:27.941121 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 135/267] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Jul 1 19:21:27 2022] GET /identity/v3/users/29bf1d71ba094d579e15c2ecc72505b6 => generated 283 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:27.948376 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a48a7e9-a597-4ebd-a597-269f18b1dfa0 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:28.048074 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 133/268] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:21:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:21:28.093733 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e8af0b-7f0a-4ef5-ba05-343e72919ff5 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:28.126894 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:28.129199 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a48a7e9-a597-4ebd-a597-269f18b1dfa0 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:28.200934 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0500d4-980b-45fa-9b33-5313850c862c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:28.201536 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0500d4-980b-45fa-9b33-5313850c862c None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:28.201824 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0500d4-980b-45fa-9b33-5313850c862c None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:28.202140 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0500d4-980b-45fa-9b33-5313850c862c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:28.237494 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:28.288329 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e8af0b-7f0a-4ef5-ba05-343e72919ff5 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:28.342252 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75536df8-3b5d-4526-bfd0-5b41e0c6b4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:28.343098 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75536df8-3b5d-4526-bfd0-5b41e0c6b4ea None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:28.343415 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75536df8-3b5d-4526-bfd0-5b41e0c6b4ea None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:28.345858 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75536df8-3b5d-4526-bfd0-5b41e0c6b4ea None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:28.354981 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0500d4-980b-45fa-9b33-5313850c862c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:28.356109 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75536df8-3b5d-4526-bfd0-5b41e0c6b4ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:21:28.357478 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0500d4-980b-45fa-9b33-5313850c862c None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:28.364552 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-75536df8-3b5d-4526-bfd0-5b41e0c6b4ea None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 01 19:21:28.364552 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:21:28.364552 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:21:28.364552 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:21:28.364552 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:21:28.364552 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:21:28.364552 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:21:28.364552 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:21:28.364552 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:21:28.364552 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:21:28.364552 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:21:28.364552 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:21:28.364552 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:21:28.364552 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:21:28.364552 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:21:28.364552 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:21:28.365831 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:21:28.365831 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:21:28.365831 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:21:28.365831 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:21:28.365831 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:21:28.365831 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:21:28.365831 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:21:28.365831 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:21:28.365831 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:21:28.365831 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:21:28.365831 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:21:28.365831 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:21:28.365831 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:21:28.365831 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:21:28.365831 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:21:28.365831 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:21:28.366813 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:21:28.366813 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:21:28.366813 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:21:28.366813 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:21:28.366813 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:21:28.366813 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:21:28.366813 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:21:28.366813 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:21:28.366813 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:21:28.366813 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:21:28.366813 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 01 19:21:28.366813 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:21:28.368792 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 134/269] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Jul 1 19:21:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:21:28.375956 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75536df8-3b5d-4526-bfd0-5b41e0c6b4ea None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:28.549654 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:28.568237 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 136/270] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Jul 1 19:21:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 621 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 01 19:21:28.570096 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed668bff-25e7-4eae-8692-67d71e198929 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:28.570391 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed668bff-25e7-4eae-8692-67d71e198929 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:28.570684 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed668bff-25e7-4eae-8692-67d71e198929 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:28.572305 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 137/271] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:21:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:21:28.577381 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed668bff-25e7-4eae-8692-67d71e198929 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:28.585555 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75536df8-3b5d-4526-bfd0-5b41e0c6b4ea None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:28.630462 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f616d51-723b-4406-b25b-13656c09eba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:28.631755 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f616d51-723b-4406-b25b-13656c09eba0 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:28.632191 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f616d51-723b-4406-b25b-13656c09eba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:28.632619 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f616d51-723b-4406-b25b-13656c09eba0 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:28.633548 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f616d51-723b-4406-b25b-13656c09eba0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:28.634007 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f616d51-723b-4406-b25b-13656c09eba0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:28.635679 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f616d51-723b-4406-b25b-13656c09eba0 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:28.642904 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:28.646591 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 135/272] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Jul 1 19:21:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:28.648103 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76897f71-d85d-4788-982b-75abdfd8de85 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:28.648645 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76897f71-d85d-4788-982b-75abdfd8de85 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:28.649124 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76897f71-d85d-4788-982b-75abdfd8de85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:28.666750 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-76897f71-d85d-4788-982b-75abdfd8de85 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:21:28.668287 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-76897f71-d85d-4788-982b-75abdfd8de85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:21:28.718222 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed668bff-25e7-4eae-8692-67d71e198929 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:28.742818 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 136/273] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:21:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:21:28.743954 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76897f71-d85d-4788-982b-75abdfd8de85 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:28.766447 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58730e3c-78b9-495d-9258-607b56c3acbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:28.767371 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58730e3c-78b9-495d-9258-607b56c3acbc None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:28.767659 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58730e3c-78b9-495d-9258-607b56c3acbc None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:28.767996 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58730e3c-78b9-495d-9258-607b56c3acbc None admin] PATH_INFO: `/v3/projects/b3f5af7a5da14e5c84bea28cc3aa5626` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:28.770165 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58730e3c-78b9-495d-9258-607b56c3acbc None admin] RBAC: Authorizing `identity:get_project(project_id=b3f5af7a5da14e5c84bea28cc3aa5626)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:28.772377 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58730e3c-78b9-495d-9258-607b56c3acbc None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:28.775520 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 138/274] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Jul 1 19:21:28 2022] GET /identity/v3/projects/b3f5af7a5da14e5c84bea28cc3aa5626 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:28.777084 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15334fdd-e260-480d-9ce8-eb5fa8fe35cf None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:28.778044 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15334fdd-e260-480d-9ce8-eb5fa8fe35cf None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:28.778658 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15334fdd-e260-480d-9ce8-eb5fa8fe35cf None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:28.780349 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 139/275] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:21:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:21:28.781307 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15334fdd-e260-480d-9ce8-eb5fa8fe35cf None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:28.829563 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:28.870156 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76897f71-d85d-4788-982b-75abdfd8de85 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:28.898312 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15334fdd-e260-480d-9ce8-eb5fa8fe35cf None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:28.912652 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:28.916498 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d26657-4272-47f3-a4a9-575d8a2f4fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:28.917416 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d26657-4272-47f3-a4a9-575d8a2f4fe9 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:28.917699 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d26657-4272-47f3-a4a9-575d8a2f4fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:28.917977 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d26657-4272-47f3-a4a9-575d8a2f4fe9 None admin] PATH_INFO: `/v3/users/2d70a137809647cf9b34ee5638dbb944` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:28.919247 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d26657-4272-47f3-a4a9-575d8a2f4fe9 None admin] RBAC: Authorizing `identity:get_user(user_id=2d70a137809647cf9b34ee5638dbb944)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:28.920707 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d26657-4272-47f3-a4a9-575d8a2f4fe9 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:28.927329 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 137/276] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Jul 1 19:21:28 2022] GET /identity/v3/users/2d70a137809647cf9b34ee5638dbb944 => generated 297 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:28.927329 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d26657-4272-47f3-a4a9-575d8a2f4fe9 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:28.941514 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c112c71-13c4-424a-9fc5-c2898a4e174c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:28.942403 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c112c71-13c4-424a-9fc5-c2898a4e174c None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:28.942699 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c112c71-13c4-424a-9fc5-c2898a4e174c None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:28.942981 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c112c71-13c4-424a-9fc5-c2898a4e174c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:28.953702 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c112c71-13c4-424a-9fc5-c2898a4e174c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:21:28.961467 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-0c112c71-13c4-424a-9fc5-c2898a4e174c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 01 19:21:28.961467 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:21:28.961467 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:21:28.961467 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:21:28.961467 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:21:28.961467 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:21:28.961467 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:21:28.961467 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:21:28.961467 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:21:28.961467 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:21:28.961467 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:21:28.961467 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:21:28.961467 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:21:28.961467 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:21:28.961467 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:21:28.961467 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:21:28.962320 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:21:28.962320 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:21:28.962320 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:21:28.962320 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:21:28.962320 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:21:28.962320 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:21:28.962320 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:21:28.962320 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:21:28.962320 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:21:28.962320 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:21:28.962320 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:21:28.962320 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:21:28.962320 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:21:28.962320 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:21:28.962320 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:21:28.962320 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:21:28.963135 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:21:28.963135 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:21:28.963135 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:21:28.963135 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:21:28.963135 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:21:28.963135 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:21:28.963135 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:21:28.963135 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:21:28.963135 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:21:28.963135 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:21:28.963135 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 01 19:21:28.963135 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:21:28.963135 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 140/277] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Jul 1 19:21:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:21:28.964179 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9f182-1158-463a-aaaa-fee005abfbfa None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:28.964472 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9f182-1158-463a-aaaa-fee005abfbfa None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:28.964763 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9f182-1158-463a-aaaa-fee005abfbfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:28.982926 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-e0e9f182-1158-463a-aaaa-fee005abfbfa None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:21:28.985111 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-e0e9f182-1158-463a-aaaa-fee005abfbfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:21:29.045015 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d26657-4272-47f3-a4a9-575d8a2f4fe9 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:29.059541 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 141/278] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:21:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:21:29.060388 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e9f182-1158-463a-aaaa-fee005abfbfa None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:29.090957 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412d28b5-b0bd-4c1d-87b5-d88f4e0d46cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:29.091534 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412d28b5-b0bd-4c1d-87b5-d88f4e0d46cf None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:29.091906 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412d28b5-b0bd-4c1d-87b5-d88f4e0d46cf None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:29.092181 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412d28b5-b0bd-4c1d-87b5-d88f4e0d46cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:29.093577 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412d28b5-b0bd-4c1d-87b5-d88f4e0d46cf None admin] RBAC: Adding query filter params (role.id=dd71f7898e6a4d9f99d1554dd7d27033, scope.project.id=b3f5af7a5da14e5c84bea28cc3aa5626, user.id=29bf1d71ba094d579e15c2ecc72505b6) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:29.093888 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412d28b5-b0bd-4c1d-87b5-d88f4e0d46cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:29.095333 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412d28b5-b0bd-4c1d-87b5-d88f4e0d46cf None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:29.101643 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 138/279] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Jul 1 19:21:28 2022] GET /identity/v3/role_assignments?user.id=29bf1d71ba094d579e15c2ecc72505b6&scope.project.id=b3f5af7a5da14e5c84bea28cc3aa5626&role.id=dd71f7898e6a4d9f99d1554dd7d27033 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:29.102272 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412d28b5-b0bd-4c1d-87b5-d88f4e0d46cf None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:29.104835 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:29.185735 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e9f182-1158-463a-aaaa-fee005abfbfa None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:29.187553 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:29.226851 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797cb140-b96b-4963-9194-d5c328981e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:29.227962 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797cb140-b96b-4963-9194-d5c328981e04 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:29.228255 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797cb140-b96b-4963-9194-d5c328981e04 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:29.228552 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412d28b5-b0bd-4c1d-87b5-d88f4e0d46cf None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:29.228654 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797cb140-b96b-4963-9194-d5c328981e04 None admin] PATH_INFO: `/v3/projects/b3f5af7a5da14e5c84bea28cc3aa5626` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:29.230101 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797cb140-b96b-4963-9194-d5c328981e04 None admin] RBAC: Authorizing `identity:get_project(project_id=b3f5af7a5da14e5c84bea28cc3aa5626)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:29.232010 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797cb140-b96b-4963-9194-d5c328981e04 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:29.237272 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 142/280] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Jul 1 19:21:29 2022] GET /identity/v3/projects/b3f5af7a5da14e5c84bea28cc3aa5626 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:29.237272 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680750d8-afa3-4326-92b6-cc2161bcf67b None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:29.237272 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680750d8-afa3-4326-92b6-cc2161bcf67b None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:29.237272 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680750d8-afa3-4326-92b6-cc2161bcf67b None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:29.238251 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 143/281] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:21:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:21:29.242930 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680750d8-afa3-4326-92b6-cc2161bcf67b None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:29.285523 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8784f25-8eca-4312-8b07-c8e38860013c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:29.287130 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8784f25-8eca-4312-8b07-c8e38860013c None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:29.287130 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8784f25-8eca-4312-8b07-c8e38860013c None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:29.287130 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8784f25-8eca-4312-8b07-c8e38860013c None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:29.288333 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8784f25-8eca-4312-8b07-c8e38860013c None admin] RBAC: Adding query filter params (name=member) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:29.289453 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8784f25-8eca-4312-8b07-c8e38860013c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:29.290861 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8784f25-8eca-4312-8b07-c8e38860013c None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:29.301543 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 139/282] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Jul 1 19:21:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:29.302460 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8784f25-8eca-4312-8b07-c8e38860013c None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:29.375868 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680750d8-afa3-4326-92b6-cc2161bcf67b None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:29.381976 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:29.412409 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b98561c-4e43-4cd0-a982-913a1cc4324d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:29.413256 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98561c-4e43-4cd0-a982-913a1cc4324d None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:29.413605 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98561c-4e43-4cd0-a982-913a1cc4324d None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:29.413880 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98561c-4e43-4cd0-a982-913a1cc4324d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:29.415089 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b98561c-4e43-4cd0-a982-913a1cc4324d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:29.416518 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b98561c-4e43-4cd0-a982-913a1cc4324d None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:29.418161 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 144/283] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:21:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:29.419298 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f0cec-cd7c-4595-b6ce-b27e6f296838 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:29.419586 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f0cec-cd7c-4595-b6ce-b27e6f296838 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:29.419860 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f0cec-cd7c-4595-b6ce-b27e6f296838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:29.423890 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8784f25-8eca-4312-8b07-c8e38860013c None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:29.438075 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-865f0cec-cd7c-4595-b6ce-b27e6f296838 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:21:29.439289 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-865f0cec-cd7c-4595-b6ce-b27e6f296838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:21:29.458449 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ab22e6-7ce2-432a-bc7e-4380dbaa5cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:29.459339 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab22e6-7ce2-432a-bc7e-4380dbaa5cbf None admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:29.459624 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab22e6-7ce2-432a-bc7e-4380dbaa5cbf None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:29.459905 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab22e6-7ce2-432a-bc7e-4380dbaa5cbf None admin] PATH_INFO: `/v3/projects/b3f5af7a5da14e5c84bea28cc3aa5626/users/2d70a137809647cf9b34ee5638dbb944/roles/f4f5eb791e8749f18c9d57c113558e15` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:29.461890 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ab22e6-7ce2-432a-bc7e-4380dbaa5cbf None admin] RBAC: Authorizing `identity:create_grant(project_id=b3f5af7a5da14e5c84bea28cc3aa5626, user_id=2d70a137809647cf9b34ee5638dbb944, role_id=f4f5eb791e8749f18c9d57c113558e15)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:29.463357 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ab22e6-7ce2-432a-bc7e-4380dbaa5cbf None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:29.472780 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:29.476047 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 140/284] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Jul 1 19:21:29 2022] PUT /identity/v3/projects/b3f5af7a5da14e5c84bea28cc3aa5626/users/2d70a137809647cf9b34ee5638dbb944/roles/f4f5eb791e8749f18c9d57c113558e15 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:21:29.476873 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ab22e6-7ce2-432a-bc7e-4380dbaa5cbf None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:29.537262 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 145/285] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:21:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:21:29.537262 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865f0cec-cd7c-4595-b6ce-b27e6f296838 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:29.637565 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ab22e6-7ce2-432a-bc7e-4380dbaa5cbf None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:29.668309 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:29.669063 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865f0cec-cd7c-4595-b6ce-b27e6f296838 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:29.682465 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb029e9-519d-4ee9-ae3f-c56603cb3552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:29.683340 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb029e9-519d-4ee9-ae3f-c56603cb3552 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:29.683621 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb029e9-519d-4ee9-ae3f-c56603cb3552 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:29.683896 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb029e9-519d-4ee9-ae3f-c56603cb3552 None admin] PATH_INFO: `/v3/users/28d74c815e2e4a42aa4c365c6cd615c2` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:29.701901 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb029e9-519d-4ee9-ae3f-c56603cb3552 None admin] RBAC: Authorizing `identity:get_user(user_id=28d74c815e2e4a42aa4c365c6cd615c2)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:29.703962 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb029e9-519d-4ee9-ae3f-c56603cb3552 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:29.709276 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 141/286] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Jul 1 19:21:29 2022] GET /identity/v3/users/28d74c815e2e4a42aa4c365c6cd615c2 => generated 293 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:29.709276 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb029e9-519d-4ee9-ae3f-c56603cb3552 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:29.714571 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab5590-170f-4c0b-8c14-7e7b65a246f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:29.715392 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab5590-170f-4c0b-8c14-7e7b65a246f8 None admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:29.715681 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab5590-170f-4c0b-8c14-7e7b65a246f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:29.715961 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab5590-170f-4c0b-8c14-7e7b65a246f8 None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:29.716683 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbab5590-170f-4c0b-8c14-7e7b65a246f8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:29.718716 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbab5590-170f-4c0b-8c14-7e7b65a246f8 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:29.740568 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 146/287] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Jul 1 19:21:29 2022] POST /identity/v3/users => generated 293 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:21:29.741290 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab5590-170f-4c0b-8c14-7e7b65a246f8 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:29.793617 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:29.870273 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb029e9-519d-4ee9-ae3f-c56603cb3552 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:29.889019 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab5590-170f-4c0b-8c14-7e7b65a246f8 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:29.928102 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b8cb3d-0fac-4412-9e1e-0df9a00f55ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:29.929156 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b8cb3d-0fac-4412-9e1e-0df9a00f55ed None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:29.929500 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b8cb3d-0fac-4412-9e1e-0df9a00f55ed None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:29.929775 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b8cb3d-0fac-4412-9e1e-0df9a00f55ed None admin] PATH_INFO: `/v3/roles/member` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:29.936143 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac7129f-2fa9-4f91-aa90-ff34b4dfd233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:29.937210 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7129f-2fa9-4f91-aa90-ff34b4dfd233 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:29.937654 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7129f-2fa9-4f91-aa90-ff34b4dfd233 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:29.938189 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7129f-2fa9-4f91-aa90-ff34b4dfd233 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:29.939997 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac7129f-2fa9-4f91-aa90-ff34b4dfd233 None admin] RBAC: Adding query filter params (role.id=4cbf6ec846eb4b7c8cc52e9bfd6f076f, user.id=28d74c815e2e4a42aa4c365c6cd615c2, scope.system=all) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:29.940380 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac7129f-2fa9-4f91-aa90-ff34b4dfd233 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:29.942225 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac7129f-2fa9-4f91-aa90-ff34b4dfd233 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:29.945569 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b8cb3d-0fac-4412-9e1e-0df9a00f55ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:21:29.949127 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 147/288] 10.222.0.26 () {56 vars in 1308 bytes} [Fri Jul 1 19:21:29 2022] GET /identity/v3/role_assignments?user.id=28d74c815e2e4a42aa4c365c6cd615c2&scope.system=all&role.id=4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:29.958555 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-51b8cb3d-0fac-4412-9e1e-0df9a00f55ed None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 01 19:21:29.958555 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:21:29.958555 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:21:29.958555 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:21:29.958555 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:21:29.958555 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:21:29.958555 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:21:29.958555 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:21:29.958555 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:21:29.958555 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:21:29.958555 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:21:29.958555 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:21:29.958555 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:21:29.958555 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:21:29.958555 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:21:29.958555 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:21:29.960358 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:21:29.960358 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:21:29.960358 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:21:29.960358 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:21:29.960358 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:21:29.960358 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:21:29.960358 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:21:29.960358 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:21:29.960358 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:21:29.960358 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:21:29.960358 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:21:29.960358 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:21:29.960358 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:21:29.960358 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:21:29.960358 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:21:29.960358 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:21:29.961675 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:21:29.961675 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:21:29.961675 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:21:29.961675 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:21:29.961675 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:21:29.961675 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:21:29.961675 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:21:29.961675 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:21:29.961675 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:21:29.961675 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:21:29.961675 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 01 19:21:29.961675 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:21:29.961675 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 142/289] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Jul 1 19:21:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:21:29.970507 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac7129f-2fa9-4f91-aa90-ff34b4dfd233 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:30.078346 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:30.093905 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac7129f-2fa9-4f91-aa90-ff34b4dfd233 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:30.135621 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a7db9e-0fbd-4c08-9858-7f69b74bd378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:30.136304 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7db9e-0fbd-4c08-9858-7f69b74bd378 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:30.136589 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7db9e-0fbd-4c08-9858-7f69b74bd378 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:30.136873 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7db9e-0fbd-4c08-9858-7f69b74bd378 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:30.137685 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a7db9e-0fbd-4c08-9858-7f69b74bd378 None admin] RBAC: Adding query filter params (name=member) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:30.138002 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a7db9e-0fbd-4c08-9858-7f69b74bd378 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:30.140042 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a7db9e-0fbd-4c08-9858-7f69b74bd378 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:30.149560 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 148/290] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Jul 1 19:21:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:30.155167 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b8cb3d-0fac-4412-9e1e-0df9a00f55ed None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:30.207894 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:30.314806 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b8cb3d-0fac-4412-9e1e-0df9a00f55ed None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:30.378467 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1e5318-b25e-47af-9619-49f7f1bc7205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:30.379827 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e5318-b25e-47af-9619-49f7f1bc7205 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:30.380276 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e5318-b25e-47af-9619-49f7f1bc7205 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:30.380888 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e5318-b25e-47af-9619-49f7f1bc7205 None admin] PATH_INFO: `/v3/users/a7df5393c9c94a078adbaff2032520d2` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:30.382858 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1e5318-b25e-47af-9619-49f7f1bc7205 None admin] RBAC: Authorizing `identity:get_user(user_id=a7df5393c9c94a078adbaff2032520d2)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:30.385372 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1e5318-b25e-47af-9619-49f7f1bc7205 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:30.388295 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 143/291] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Jul 1 19:21:30 2022] GET /identity/v3/users/a7df5393c9c94a078adbaff2032520d2 => generated 297 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:30.397215 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a7db9e-0fbd-4c08-9858-7f69b74bd378 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:30.549966 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a7db9e-0fbd-4c08-9858-7f69b74bd378 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:30.603838 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430f4004-e93f-45ca-a7bc-4df653fcddda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:30.604505 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f4004-e93f-45ca-a7bc-4df653fcddda None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:30.604792 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f4004-e93f-45ca-a7bc-4df653fcddda None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:30.605073 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f4004-e93f-45ca-a7bc-4df653fcddda None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:30.633646 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:30.707081 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430f4004-e93f-45ca-a7bc-4df653fcddda None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:30.708471 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430f4004-e93f-45ca-a7bc-4df653fcddda None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:30.850826 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 149/292] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Jul 1 19:21:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 19:21:30.856600 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1e5318-b25e-47af-9619-49f7f1bc7205 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:31.034489 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1e5318-b25e-47af-9619-49f7f1bc7205 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:31.055050 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:31.086068 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e0dca4-682a-4d22-8b70-61f3e6e805ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:31.086938 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e0dca4-682a-4d22-8b70-61f3e6e805ba None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:31.087224 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e0dca4-682a-4d22-8b70-61f3e6e805ba None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:31.087503 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e0dca4-682a-4d22-8b70-61f3e6e805ba None admin] PATH_INFO: `/v3/projects/b3f5af7a5da14e5c84bea28cc3aa5626` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:31.089999 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e0dca4-682a-4d22-8b70-61f3e6e805ba None admin] RBAC: Authorizing `identity:get_project(project_id=b3f5af7a5da14e5c84bea28cc3aa5626)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:31.091476 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e0dca4-682a-4d22-8b70-61f3e6e805ba None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:31.093259 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 144/293] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Jul 1 19:21:30 2022] GET /identity/v3/projects/b3f5af7a5da14e5c84bea28cc3aa5626 => generated 302 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:31.099186 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430f4004-e93f-45ca-a7bc-4df653fcddda None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:31.152052 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:31.211059 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430f4004-e93f-45ca-a7bc-4df653fcddda None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:31.252930 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e659ad55-9b5e-46a6-b719-bfa17f4d8f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:31.253637 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659ad55-9b5e-46a6-b719-bfa17f4d8f70 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:31.253918 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659ad55-9b5e-46a6-b719-bfa17f4d8f70 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:31.254204 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659ad55-9b5e-46a6-b719-bfa17f4d8f70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:31.255058 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e659ad55-9b5e-46a6-b719-bfa17f4d8f70 None admin] RBAC: Adding query filter params (role.id=4cbf6ec846eb4b7c8cc52e9bfd6f076f, scope.project.id=b3f5af7a5da14e5c84bea28cc3aa5626, user.id=a7df5393c9c94a078adbaff2032520d2) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:31.255373 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e659ad55-9b5e-46a6-b719-bfa17f4d8f70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:31.256885 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e659ad55-9b5e-46a6-b719-bfa17f4d8f70 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:31.264200 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 150/294] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Jul 1 19:21:31 2022] GET /identity/v3/role_assignments?user.id=a7df5393c9c94a078adbaff2032520d2&scope.project.id=b3f5af7a5da14e5c84bea28cc3aa5626&role.id=4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:31.836303 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c5438-b14e-44f6-b898-10eb4e94a9b6 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:31.836869 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c5438-b14e-44f6-b898-10eb4e94a9b6 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:31.836869 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c5438-b14e-44f6-b898-10eb4e94a9b6 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:31.838532 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 145/295] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:21:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:21:31.844508 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a66a4e-6cd8-422c-8748-71306e35257d None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:31.844808 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a66a4e-6cd8-422c-8748-71306e35257d None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:31.845087 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a66a4e-6cd8-422c-8748-71306e35257d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:31.866185 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-d7a66a4e-6cd8-422c-8748-71306e35257d None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:21:31.867393 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-d7a66a4e-6cd8-422c-8748-71306e35257d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:21:31.945981 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 151/296] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:21:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:21:31.974730 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74c5438-b14e-44f6-b898-10eb4e94a9b6 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:32.089783 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74c5438-b14e-44f6-b898-10eb4e94a9b6 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:32.125984 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c22a075-7eff-443e-8cdf-cd5520d3d821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:32.126787 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c22a075-7eff-443e-8cdf-cd5520d3d821 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:32.127080 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c22a075-7eff-443e-8cdf-cd5520d3d821 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:32.127359 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c22a075-7eff-443e-8cdf-cd5520d3d821 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:32.138210 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c22a075-7eff-443e-8cdf-cd5520d3d821 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:21:32.146556 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-0c22a075-7eff-443e-8cdf-cd5520d3d821 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 01 19:21:32.146556 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:21:32.146556 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:21:32.146556 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:21:32.146556 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:21:32.146556 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:21:32.146556 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:21:32.146556 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:21:32.146556 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:21:32.146556 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:21:32.146556 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:21:32.146556 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:21:32.146556 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:21:32.146556 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:21:32.146556 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:21:32.146556 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:21:32.147505 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:21:32.147505 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:21:32.147505 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:21:32.147505 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:21:32.147505 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:21:32.147505 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:21:32.147505 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:21:32.147505 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:21:32.147505 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:21:32.147505 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:21:32.147505 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:21:32.147505 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:21:32.147505 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:21:32.147505 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:21:32.147505 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:21:32.147505 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:21:32.148281 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:21:32.148281 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:21:32.148281 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:21:32.148281 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:21:32.148281 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:21:32.148281 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:21:32.148281 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:21:32.148281 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:21:32.148281 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:21:32.148281 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:21:32.148281 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 01 19:21:32.148281 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:21:32.148281 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 146/297] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Jul 1 19:21:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:21:32.153738 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a66a4e-6cd8-422c-8748-71306e35257d None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:32.208891 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:32.271956 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a66a4e-6cd8-422c-8748-71306e35257d None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:32.308543 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2346b2bb-cd40-4450-852f-4177fd2835f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:32.309218 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2346b2bb-cd40-4450-852f-4177fd2835f4 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:32.309526 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2346b2bb-cd40-4450-852f-4177fd2835f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:32.309805 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2346b2bb-cd40-4450-852f-4177fd2835f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:32.310563 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2346b2bb-cd40-4450-852f-4177fd2835f4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:32.310873 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2346b2bb-cd40-4450-852f-4177fd2835f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:32.312380 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2346b2bb-cd40-4450-852f-4177fd2835f4 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:32.321432 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 152/298] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Jul 1 19:21:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:32.327465 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c22a075-7eff-443e-8cdf-cd5520d3d821 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:32.370550 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:32.379709 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae91f048-0a66-46da-86fa-09062d824c52 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:32.380299 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae91f048-0a66-46da-86fa-09062d824c52 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:32.380779 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae91f048-0a66-46da-86fa-09062d824c52 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:32.382718 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 153/299] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:21:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:21:32.387933 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923600f0-532e-4947-8bf4-c68385fe9dde None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:32.388464 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923600f0-532e-4947-8bf4-c68385fe9dde None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:32.388939 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923600f0-532e-4947-8bf4-c68385fe9dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:32.413773 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-923600f0-532e-4947-8bf4-c68385fe9dde None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:21:32.415406 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-923600f0-532e-4947-8bf4-c68385fe9dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:21:32.439989 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c22a075-7eff-443e-8cdf-cd5520d3d821 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:32.479351 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e256511d-c637-4292-8dd7-d9e35ffd4407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:32.480185 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e256511d-c637-4292-8dd7-d9e35ffd4407 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:32.480440 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e256511d-c637-4292-8dd7-d9e35ffd4407 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:32.480717 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e256511d-c637-4292-8dd7-d9e35ffd4407 None admin] PATH_INFO: `/v3/users/2d70a137809647cf9b34ee5638dbb944` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:32.481997 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e256511d-c637-4292-8dd7-d9e35ffd4407 None admin] RBAC: Authorizing `identity:get_user(user_id=2d70a137809647cf9b34ee5638dbb944)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:32.483646 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e256511d-c637-4292-8dd7-d9e35ffd4407 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:32.490901 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 147/300] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Jul 1 19:21:32 2022] GET /identity/v3/users/2d70a137809647cf9b34ee5638dbb944 => generated 297 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:32.490901 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f21623-be3b-448b-9ef7-f46d7f93167b None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:32.490901 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f21623-be3b-448b-9ef7-f46d7f93167b None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:32.490901 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f21623-be3b-448b-9ef7-f46d7f93167b None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:32.490901 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 148/301] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:21:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:21:32.491396 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 154/302] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:21:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:21:32.491629 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f21623-be3b-448b-9ef7-f46d7f93167b None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:32.504848 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497f190-2932-4cb7-866f-bcf171e0f173 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:32.505187 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497f190-2932-4cb7-866f-bcf171e0f173 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:32.505539 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497f190-2932-4cb7-866f-bcf171e0f173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:32.524649 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-7497f190-2932-4cb7-866f-bcf171e0f173 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:21:32.526150 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-7497f190-2932-4cb7-866f-bcf171e0f173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:21:32.560858 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:32.617267 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 155/303] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:21:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:21:32.617267 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7497f190-2932-4cb7-866f-bcf171e0f173 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:32.619533 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f21623-be3b-448b-9ef7-f46d7f93167b None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:32.632440 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:32.662937 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67194aa2-c145-498f-9510-8175e7cd46a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:32.663594 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67194aa2-c145-498f-9510-8175e7cd46a8 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:32.663882 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67194aa2-c145-498f-9510-8175e7cd46a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:32.664159 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67194aa2-c145-498f-9510-8175e7cd46a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:32.731234 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7497f190-2932-4cb7-866f-bcf171e0f173 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:32.732442 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67194aa2-c145-498f-9510-8175e7cd46a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:32.733989 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67194aa2-c145-498f-9510-8175e7cd46a8 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:32.766084 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb7070f-b33d-4073-9e65-9a475d50f404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:32.766878 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7070f-b33d-4073-9e65-9a475d50f404 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:32.767162 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7070f-b33d-4073-9e65-9a475d50f404 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:32.767442 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7070f-b33d-4073-9e65-9a475d50f404 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:32.777516 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb7070f-b33d-4073-9e65-9a475d50f404 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:21:32.785113 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-7bb7070f-b33d-4073-9e65-9a475d50f404 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 01 19:21:32.785113 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:21:32.785113 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:21:32.785113 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:21:32.785113 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:21:32.785113 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:21:32.785113 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:21:32.785113 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:21:32.785113 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:21:32.785113 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:21:32.785113 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:21:32.785113 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:21:32.785113 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:21:32.785113 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:21:32.785113 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:21:32.785113 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:21:32.786043 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:21:32.786043 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:21:32.786043 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:21:32.786043 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:21:32.786043 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:21:32.786043 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:21:32.786043 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:21:32.786043 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:21:32.786043 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:21:32.786043 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:21:32.786043 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:21:32.786043 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:21:32.786043 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:21:32.786043 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:21:32.786043 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:21:32.786043 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:21:32.786828 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:21:32.786828 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:21:32.786828 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:21:32.786828 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:21:32.786828 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:21:32.786828 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:21:32.786828 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:21:32.786828 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:21:32.786828 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:21:32.786828 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:21:32.786828 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 01 19:21:32.786828 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:21:32.786828 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 156/304] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Jul 1 19:21:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:21:32.787503 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb7070f-b33d-4073-9e65-9a475d50f404 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:32.818036 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:32.845186 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 149/305] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Jul 1 19:21:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 01 19:21:32.846607 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e6e9f-0073-4106-8d68-c4106e36693a None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:32.846897 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e6e9f-0073-4106-8d68-c4106e36693a None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:32.847172 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e6e9f-0073-4106-8d68-c4106e36693a None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:32.848452 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 150/306] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:21:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:21:32.849140 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e6e9f-0073-4106-8d68-c4106e36693a None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:32.858075 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:32.904322 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb7070f-b33d-4073-9e65-9a475d50f404 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:32.941416 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f103174-1dc6-4887-ac67-f600527a9048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:32.942205 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f103174-1dc6-4887-ac67-f600527a9048 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:32.942480 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f103174-1dc6-4887-ac67-f600527a9048 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:32.942750 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f103174-1dc6-4887-ac67-f600527a9048 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:32.953539 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f103174-1dc6-4887-ac67-f600527a9048 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:21:32.959347 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e6e9f-0073-4106-8d68-c4106e36693a None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:32.961120 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-1f103174-1dc6-4887-ac67-f600527a9048 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 01 19:21:32.961120 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:21:32.961120 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:21:32.961120 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:21:32.961120 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:21:32.961120 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:21:32.961120 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:21:32.961120 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:21:32.961120 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:21:32.961120 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:21:32.961120 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:21:32.961120 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:21:32.961120 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:21:32.961120 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:21:32.961120 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:21:32.961120 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:21:32.962137 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:21:32.962137 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:21:32.962137 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:21:32.962137 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:21:32.962137 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:21:32.962137 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:21:32.962137 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:21:32.962137 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:21:32.962137 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:21:32.962137 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:21:32.962137 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:21:32.962137 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:21:32.962137 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:21:32.962137 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:21:32.962137 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:21:32.962137 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:21:32.968669 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:21:32.968669 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:21:32.968669 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:21:32.968669 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:21:32.968669 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:21:32.968669 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:21:32.968669 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:21:32.968669 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:21:32.968669 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:21:32.968669 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:21:32.968669 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 01 19:21:32.968669 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:21:32.968669 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 157/307] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Jul 1 19:21:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:21:32.968669 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f103174-1dc6-4887-ac67-f600527a9048 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:32.996785 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7f33db-f46e-4d79-af2d-46f5803d0fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:32.997431 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f33db-f46e-4d79-af2d-46f5803d0fb0 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:32.997714 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f33db-f46e-4d79-af2d-46f5803d0fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:32.997987 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f33db-f46e-4d79-af2d-46f5803d0fb0 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:32.998725 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7f33db-f46e-4d79-af2d-46f5803d0fb0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:32.999544 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7f33db-f46e-4d79-af2d-46f5803d0fb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:33.000912 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7f33db-f46e-4d79-af2d-46f5803d0fb0 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:33.009463 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 151/308] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Jul 1 19:21:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:33.014183 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8fee6a-7a6f-4933-a5b1-1b7f3f8e6709 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:33.014183 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8fee6a-7a6f-4933-a5b1-1b7f3f8e6709 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:33.014183 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8fee6a-7a6f-4933-a5b1-1b7f3f8e6709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:33.028004 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-4a8fee6a-7a6f-4933-a5b1-1b7f3f8e6709 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:21:33.029185 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-4a8fee6a-7a6f-4933-a5b1-1b7f3f8e6709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:21:33.057170 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:33.074682 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f103174-1dc6-4887-ac67-f600527a9048 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:33.090895 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:33.096608 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 152/309] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:21:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:21:33.097384 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8fee6a-7a6f-4933-a5b1-1b7f3f8e6709 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:33.122758 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dde923-0beb-427b-b775-0553d282f1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:33.123563 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dde923-0beb-427b-b775-0553d282f1e2 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:33.123924 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dde923-0beb-427b-b775-0553d282f1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:33.124672 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dde923-0beb-427b-b775-0553d282f1e2 None admin] PATH_INFO: `/v3/projects/b3f5af7a5da14e5c84bea28cc3aa5626` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:33.125889 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dde923-0beb-427b-b775-0553d282f1e2 None admin] RBAC: Authorizing `identity:get_project(project_id=b3f5af7a5da14e5c84bea28cc3aa5626)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:33.127337 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dde923-0beb-427b-b775-0553d282f1e2 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:33.129189 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 158/310] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Jul 1 19:21:32 2022] GET /identity/v3/projects/b3f5af7a5da14e5c84bea28cc3aa5626 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:33.129802 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dde923-0beb-427b-b775-0553d282f1e2 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:33.207484 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8fee6a-7a6f-4933-a5b1-1b7f3f8e6709 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:33.236740 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dde923-0beb-427b-b775-0553d282f1e2 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:33.242932 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e90eea6-d4e9-408a-88d8-873e981b2c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:33.243717 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90eea6-d4e9-408a-88d8-873e981b2c53 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:33.244026 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90eea6-d4e9-408a-88d8-873e981b2c53 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:33.244426 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90eea6-d4e9-408a-88d8-873e981b2c53 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:33.245263 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e90eea6-d4e9-408a-88d8-873e981b2c53 None admin] RBAC: Adding query filter params (name=member) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:33.245604 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e90eea6-d4e9-408a-88d8-873e981b2c53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:33.247159 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e90eea6-d4e9-408a-88d8-873e981b2c53 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:33.256007 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 153/311] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Jul 1 19:21:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:33.258562 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e90eea6-d4e9-408a-88d8-873e981b2c53 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:33.271565 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea7d243-9cec-4f9d-9697-ba559d4f12d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:33.272435 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea7d243-9cec-4f9d-9697-ba559d4f12d5 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:33.272719 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea7d243-9cec-4f9d-9697-ba559d4f12d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:33.272997 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea7d243-9cec-4f9d-9697-ba559d4f12d5 None admin] PATH_INFO: `/v3/users/25b40e4ff7834e09a00e703d90cdf3ee` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:33.286585 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea7d243-9cec-4f9d-9697-ba559d4f12d5 None admin] RBAC: Authorizing `identity:get_user(user_id=25b40e4ff7834e09a00e703d90cdf3ee)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:33.288043 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea7d243-9cec-4f9d-9697-ba559d4f12d5 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:33.289768 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 159/312] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Jul 1 19:21:33 2022] GET /identity/v3/users/25b40e4ff7834e09a00e703d90cdf3ee => generated 293 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:33.290620 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea7d243-9cec-4f9d-9697-ba559d4f12d5 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:33.307016 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:33.325130 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:33.369707 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e90eea6-d4e9-408a-88d8-873e981b2c53 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:33.395869 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea7d243-9cec-4f9d-9697-ba559d4f12d5 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:33.404231 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dd3ef8-d9b6-4825-9d3d-9d78dc89f7d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:33.405531 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd3ef8-d9b6-4825-9d3d-9d78dc89f7d0 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:33.405816 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd3ef8-d9b6-4825-9d3d-9d78dc89f7d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:33.406088 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd3ef8-d9b6-4825-9d3d-9d78dc89f7d0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:33.407266 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dd3ef8-d9b6-4825-9d3d-9d78dc89f7d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:33.408711 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dd3ef8-d9b6-4825-9d3d-9d78dc89f7d0 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:33.410510 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 154/313] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:21:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:33.411096 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dd3ef8-d9b6-4825-9d3d-9d78dc89f7d0 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:33.434578 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a1c5a-c4c1-43b7-88c5-e4eb54b02386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:33.435231 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a1c5a-c4c1-43b7-88c5-e4eb54b02386 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:33.435518 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a1c5a-c4c1-43b7-88c5-e4eb54b02386 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:33.435797 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a1c5a-c4c1-43b7-88c5-e4eb54b02386 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:33.436655 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09a1c5a-c4c1-43b7-88c5-e4eb54b02386 None admin] RBAC: Adding query filter params (role.id=f4f5eb791e8749f18c9d57c113558e15, scope.project.id=b3f5af7a5da14e5c84bea28cc3aa5626, user.id=2d70a137809647cf9b34ee5638dbb944) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:33.436971 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09a1c5a-c4c1-43b7-88c5-e4eb54b02386 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:33.438452 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09a1c5a-c4c1-43b7-88c5-e4eb54b02386 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:33.444750 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 160/314] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Jul 1 19:21:33 2022] GET /identity/v3/role_assignments?user.id=2d70a137809647cf9b34ee5638dbb944&scope.project.id=b3f5af7a5da14e5c84bea28cc3aa5626&role.id=f4f5eb791e8749f18c9d57c113558e15 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:33.445695 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a1c5a-c4c1-43b7-88c5-e4eb54b02386 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:33.567414 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dd3ef8-d9b6-4825-9d3d-9d78dc89f7d0 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:33.567710 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:33.606065 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a1c5a-c4c1-43b7-88c5-e4eb54b02386 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:33.613020 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:33.628737 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f204d5dd-409d-4c7d-99bc-704fef57b191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:33.629658 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204d5dd-409d-4c7d-99bc-704fef57b191 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:33.629942 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204d5dd-409d-4c7d-99bc-704fef57b191 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:33.630217 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204d5dd-409d-4c7d-99bc-704fef57b191 None admin] PATH_INFO: `/v3/users/28d74c815e2e4a42aa4c365c6cd615c2` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:33.631435 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f204d5dd-409d-4c7d-99bc-704fef57b191 None admin] RBAC: Authorizing `identity:get_user(user_id=28d74c815e2e4a42aa4c365c6cd615c2)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:33.633153 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f204d5dd-409d-4c7d-99bc-704fef57b191 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:33.635925 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 155/315] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Jul 1 19:21:33 2022] GET /identity/v3/users/28d74c815e2e4a42aa4c365c6cd615c2 => generated 293 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:33.635925 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f204d5dd-409d-4c7d-99bc-704fef57b191 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:33.661049 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266ce00d-8d57-46c4-9a1e-28ba6d37b565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:33.661793 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ce00d-8d57-46c4-9a1e-28ba6d37b565 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:33.662033 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ce00d-8d57-46c4-9a1e-28ba6d37b565 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:33.662315 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ce00d-8d57-46c4-9a1e-28ba6d37b565 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:33.663152 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266ce00d-8d57-46c4-9a1e-28ba6d37b565 None admin] RBAC: Adding query filter params (role.id=f4f5eb791e8749f18c9d57c113558e15, user.id=25b40e4ff7834e09a00e703d90cdf3ee, scope.system=all) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:33.663468 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266ce00d-8d57-46c4-9a1e-28ba6d37b565 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:33.664898 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266ce00d-8d57-46c4-9a1e-28ba6d37b565 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:33.670656 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 161/316] 10.222.0.26 () {56 vars in 1308 bytes} [Fri Jul 1 19:21:33 2022] GET /identity/v3/role_assignments?user.id=25b40e4ff7834e09a00e703d90cdf3ee&scope.system=all&role.id=f4f5eb791e8749f18c9d57c113558e15 => generated 226 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:33.672212 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266ce00d-8d57-46c4-9a1e-28ba6d37b565 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:33.773930 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f204d5dd-409d-4c7d-99bc-704fef57b191 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:33.796100 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266ce00d-8d57-46c4-9a1e-28ba6d37b565 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:33.817687 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a728b19-9c39-4add-a7e4-028598917561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:33.818571 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a728b19-9c39-4add-a7e4-028598917561 None admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:33.818974 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a728b19-9c39-4add-a7e4-028598917561 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:33.819272 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a728b19-9c39-4add-a7e4-028598917561 None admin] PATH_INFO: `/v3/groups` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:33.820094 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a728b19-9c39-4add-a7e4-028598917561 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:33.822015 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a728b19-9c39-4add-a7e4-028598917561 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:33.835292 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b7765-f8f9-47fc-8668-547a7aeaa8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:33.836118 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b7765-f8f9-47fc-8668-547a7aeaa8f2 None admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:33.836392 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b7765-f8f9-47fc-8668-547a7aeaa8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:33.836671 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b7765-f8f9-47fc-8668-547a7aeaa8f2 None admin] PATH_INFO: `/v3/system/users/28d74c815e2e4a42aa4c365c6cd615c2/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:33.838305 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427b7765-f8f9-47fc-8668-547a7aeaa8f2 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=28d74c815e2e4a42aa4c365c6cd615c2, role_id=4cbf6ec846eb4b7c8cc52e9bfd6f076f)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:33.839723 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427b7765-f8f9-47fc-8668-547a7aeaa8f2 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:33.841746 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 156/317] 10.222.0.26 () {60 vars in 1134 bytes} [Fri Jul 1 19:21:33 2022] POST /identity/v3/groups => generated 229 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:21:33.857937 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 162/318] 10.222.0.26 () {58 vars in 1334 bytes} [Fri Jul 1 19:21:33 2022] PUT /identity/v3/system/users/28d74c815e2e4a42aa4c365c6cd615c2/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:21:35.715069 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d68dd22-743e-4772-98ad-353cc17ab0a6 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:35.715631 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d68dd22-743e-4772-98ad-353cc17ab0a6 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:35.715631 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d68dd22-743e-4772-98ad-353cc17ab0a6 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:35.717173 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 157/319] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:21:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:21:35.722152 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aba6ed-a5c1-49ea-8a65-3ad60d79cd47 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:35.722594 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aba6ed-a5c1-49ea-8a65-3ad60d79cd47 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:35.722748 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aba6ed-a5c1-49ea-8a65-3ad60d79cd47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:35.728704 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:35.740552 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-13aba6ed-a5c1-49ea-8a65-3ad60d79cd47 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:21:35.742001 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-13aba6ed-a5c1-49ea-8a65-3ad60d79cd47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:21:35.821191 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 163/320] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:21:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:21:35.844475 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d68dd22-743e-4772-98ad-353cc17ab0a6 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:35.906128 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:35.909129 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad63b98-6005-4a69-a7c2-74654f7d0466 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:35.909516 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad63b98-6005-4a69-a7c2-74654f7d0466 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:35.909839 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad63b98-6005-4a69-a7c2-74654f7d0466 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:35.911517 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 164/321] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:21:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:21:35.916963 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf60b57-3eec-47d7-b94f-9817d9bfa8dc None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:35.917588 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf60b57-3eec-47d7-b94f-9817d9bfa8dc None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:35.917887 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf60b57-3eec-47d7-b94f-9817d9bfa8dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:35.943296 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-ebf60b57-3eec-47d7-b94f-9817d9bfa8dc None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:21:35.944840 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-ebf60b57-3eec-47d7-b94f-9817d9bfa8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:21:35.960702 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d68dd22-743e-4772-98ad-353cc17ab0a6 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:36.000597 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76dbb4c-1dae-4747-8faa-bc34c0b00620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:36.001724 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76dbb4c-1dae-4747-8faa-bc34c0b00620 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:36.002006 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76dbb4c-1dae-4747-8faa-bc34c0b00620 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:36.002296 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76dbb4c-1dae-4747-8faa-bc34c0b00620 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:36.012665 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76dbb4c-1dae-4747-8faa-bc34c0b00620 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:21:36.019790 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 165/322] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:21:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 19:21:36.020730 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-b76dbb4c-1dae-4747-8faa-bc34c0b00620 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 01 19:21:36.020730 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:21:36.020730 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:21:36.020730 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:21:36.020730 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:21:36.020730 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:21:36.020730 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:21:36.020730 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:21:36.020730 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:21:36.020730 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:21:36.020730 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:21:36.020730 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:21:36.020730 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:21:36.020730 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:21:36.020730 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:21:36.020730 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:21:36.021821 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:21:36.021821 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:21:36.021821 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:21:36.021821 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:21:36.021821 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:21:36.021821 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:21:36.021821 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:21:36.021821 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:21:36.021821 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:21:36.021821 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:21:36.021821 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:21:36.021821 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:21:36.021821 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:21:36.021821 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:21:36.021821 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:21:36.021821 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:21:36.022895 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:21:36.022895 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:21:36.022895 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:21:36.022895 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:21:36.022895 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:21:36.022895 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:21:36.022895 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:21:36.022895 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:21:36.022895 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:21:36.022895 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:21:36.022895 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 01 19:21:36.022895 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:21:36.023626 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc5c48-fe08-4855-9bc2-deecd5cb7890 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:36.023626 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc5c48-fe08-4855-9bc2-deecd5cb7890 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:36.023626 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc5c48-fe08-4855-9bc2-deecd5cb7890 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:36.023795 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 158/323] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Jul 1 19:21:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:21:36.023870 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 166/324] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:21:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:21:36.028537 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818852a-5603-431f-8a14-4543d4221fa0 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:36.028817 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818852a-5603-431f-8a14-4543d4221fa0 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:36.029099 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818852a-5603-431f-8a14-4543d4221fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:36.029993 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cc5c48-fe08-4855-9bc2-deecd5cb7890 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:36.046104 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-9818852a-5603-431f-8a14-4543d4221fa0 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:21:36.047311 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-9818852a-5603-431f-8a14-4543d4221fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:21:36.102129 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:36.120080 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 159/325] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:21:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:21:36.121183 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9818852a-5603-431f-8a14-4543d4221fa0 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:36.150990 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cc5c48-fe08-4855-9bc2-deecd5cb7890 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:36.171824 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:36.185994 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ada7e0-549e-4541-9a1b-4fd5755304c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:36.187302 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ada7e0-549e-4541-9a1b-4fd5755304c4 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:36.187586 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ada7e0-549e-4541-9a1b-4fd5755304c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:36.187854 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ada7e0-549e-4541-9a1b-4fd5755304c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:36.188592 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ada7e0-549e-4541-9a1b-4fd5755304c4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:36.188891 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ada7e0-549e-4541-9a1b-4fd5755304c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:36.190285 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ada7e0-549e-4541-9a1b-4fd5755304c4 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:36.198533 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 167/326] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Jul 1 19:21:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:21:36.199162 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ada7e0-549e-4541-9a1b-4fd5755304c4 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:36.228900 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9818852a-5603-431f-8a14-4543d4221fa0 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:36.269845 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e690677-d5e0-4f4b-b42b-36b14e6d24d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:36.270641 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e690677-d5e0-4f4b-b42b-36b14e6d24d6 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:36.270920 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e690677-d5e0-4f4b-b42b-36b14e6d24d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:36.271197 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e690677-d5e0-4f4b-b42b-36b14e6d24d6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:36.281714 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e690677-d5e0-4f4b-b42b-36b14e6d24d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:21:36.289470 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-8e690677-d5e0-4f4b-b42b-36b14e6d24d6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 01 19:21:36.289470 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:21:36.289470 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:21:36.289470 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:21:36.289470 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:21:36.289470 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:21:36.289470 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:21:36.289470 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:21:36.289470 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:21:36.289470 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:21:36.289470 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:21:36.289470 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:21:36.289470 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:21:36.289470 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:21:36.289470 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:21:36.289470 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:21:36.290532 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:21:36.290532 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:21:36.290532 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:21:36.290532 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:21:36.290532 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:21:36.290532 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:21:36.290532 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:21:36.290532 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:21:36.290532 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:21:36.290532 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:21:36.290532 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:21:36.290532 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:21:36.290532 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:21:36.290532 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:21:36.290532 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:21:36.290532 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:21:36.291370 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:21:36.291370 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:21:36.291370 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:21:36.291370 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:21:36.291370 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:21:36.291370 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:21:36.291370 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:21:36.291370 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:21:36.291370 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:21:36.291370 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:21:36.291370 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 01 19:21:36.291370 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:21:36.291370 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 160/327] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Jul 1 19:21:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:21:36.292007 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e690677-d5e0-4f4b-b42b-36b14e6d24d6 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:36.305131 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ada7e0-549e-4541-9a1b-4fd5755304c4 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:36.331439 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:36.340394 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9c9522-3d63-458b-bf75-1432b1fa63e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:36.341187 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c9522-3d63-458b-bf75-1432b1fa63e2 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:36.341510 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c9522-3d63-458b-bf75-1432b1fa63e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:36.341795 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c9522-3d63-458b-bf75-1432b1fa63e2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:36.342976 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9c9522-3d63-458b-bf75-1432b1fa63e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:36.344435 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9c9522-3d63-458b-bf75-1432b1fa63e2 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:36.346095 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 168/328] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:21:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:36.346859 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9c9522-3d63-458b-bf75-1432b1fa63e2 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:36.404556 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e690677-d5e0-4f4b-b42b-36b14e6d24d6 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:36.413393 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:36.442619 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f0166-fc52-42b7-b66d-47a9734bcd11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:36.443493 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f0166-fc52-42b7-b66d-47a9734bcd11 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:36.443693 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f0166-fc52-42b7-b66d-47a9734bcd11 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:36.443971 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f0166-fc52-42b7-b66d-47a9734bcd11 None admin] PATH_INFO: `/v3/users/25b40e4ff7834e09a00e703d90cdf3ee` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:36.445186 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455f0166-fc52-42b7-b66d-47a9734bcd11 None admin] RBAC: Authorizing `identity:get_user(user_id=25b40e4ff7834e09a00e703d90cdf3ee)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:36.446679 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455f0166-fc52-42b7-b66d-47a9734bcd11 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:36.448304 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 161/329] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Jul 1 19:21:36 2022] GET /identity/v3/users/25b40e4ff7834e09a00e703d90cdf3ee => generated 293 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:36.454201 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9c9522-3d63-458b-bf75-1432b1fa63e2 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:36.454310 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f0166-fc52-42b7-b66d-47a9734bcd11 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:36.483952 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9d56a3-aa43-4f64-9b76-beaf8b8bed39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:36.484617 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d56a3-aa43-4f64-9b76-beaf8b8bed39 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:36.484902 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d56a3-aa43-4f64-9b76-beaf8b8bed39 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:36.485173 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d56a3-aa43-4f64-9b76-beaf8b8bed39 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:36.485975 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9d56a3-aa43-4f64-9b76-beaf8b8bed39 None admin] RBAC: Adding query filter params (name=member) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:36.486278 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9d56a3-aa43-4f64-9b76-beaf8b8bed39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:36.487652 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9d56a3-aa43-4f64-9b76-beaf8b8bed39 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:36.495919 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 169/330] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Jul 1 19:21:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:36.496699 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9d56a3-aa43-4f64-9b76-beaf8b8bed39 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:36.556431 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:36.559720 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f0166-fc52-42b7-b66d-47a9734bcd11 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:36.594010 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81decb87-25d1-49ae-b69d-68074d1b468c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:36.594683 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81decb87-25d1-49ae-b69d-68074d1b468c None admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:36.595002 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81decb87-25d1-49ae-b69d-68074d1b468c None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:36.595281 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81decb87-25d1-49ae-b69d-68074d1b468c None admin] PATH_INFO: `/v3/groups` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:36.595974 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81decb87-25d1-49ae-b69d-68074d1b468c None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:36.597457 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81decb87-25d1-49ae-b69d-68074d1b468c None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:36.602399 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9d56a3-aa43-4f64-9b76-beaf8b8bed39 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:36.612077 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 162/331] 10.222.0.26 () {60 vars in 1134 bytes} [Fri Jul 1 19:21:36 2022] POST /identity/v3/groups => generated 226 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:21:36.612808 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81decb87-25d1-49ae-b69d-68074d1b468c None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:36.643134 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de38132-1805-42bd-bd6b-ca34140e67ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:36.644111 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de38132-1805-42bd-bd6b-ca34140e67ce None admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:36.644589 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de38132-1805-42bd-bd6b-ca34140e67ce None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:36.644835 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de38132-1805-42bd-bd6b-ca34140e67ce None admin] PATH_INFO: `/v3/system/users/25b40e4ff7834e09a00e703d90cdf3ee/roles/f4f5eb791e8749f18c9d57c113558e15` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:36.646422 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de38132-1805-42bd-bd6b-ca34140e67ce None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=25b40e4ff7834e09a00e703d90cdf3ee, role_id=f4f5eb791e8749f18c9d57c113558e15)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:36.648105 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de38132-1805-42bd-bd6b-ca34140e67ce None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:36.656874 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 170/332] 10.222.0.26 () {58 vars in 1334 bytes} [Fri Jul 1 19:21:36 2022] PUT /identity/v3/system/users/25b40e4ff7834e09a00e703d90cdf3ee/roles/f4f5eb791e8749f18c9d57c113558e15 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:21:36.660811 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:36.749964 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81decb87-25d1-49ae-b69d-68074d1b468c None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:36.792510 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a5381-7e5d-4a77-b81a-bf3321190019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:36.793452 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a5381-7e5d-4a77-b81a-bf3321190019 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:36.793743 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a5381-7e5d-4a77-b81a-bf3321190019 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:36.794025 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a5381-7e5d-4a77-b81a-bf3321190019 None admin] PATH_INFO: `/v3/users/28d74c815e2e4a42aa4c365c6cd615c2` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:36.795353 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3a5381-7e5d-4a77-b81a-bf3321190019 None admin] RBAC: Authorizing `identity:get_user(user_id=28d74c815e2e4a42aa4c365c6cd615c2)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:36.796867 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3a5381-7e5d-4a77-b81a-bf3321190019 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:36.798614 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 163/333] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Jul 1 19:21:36 2022] GET /identity/v3/users/28d74c815e2e4a42aa4c365c6cd615c2 => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:36.804956 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de38132-1805-42bd-bd6b-ca34140e67ce None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:36.914729 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de38132-1805-42bd-bd6b-ca34140e67ce None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:36.937437 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:36.955413 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b008ac8c-b76d-46e5-8edc-c22e8d12246a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:36.956078 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b008ac8c-b76d-46e5-8edc-c22e8d12246a None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:36.956367 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b008ac8c-b76d-46e5-8edc-c22e8d12246a None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:36.956649 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b008ac8c-b76d-46e5-8edc-c22e8d12246a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:36.957529 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b008ac8c-b76d-46e5-8edc-c22e8d12246a None admin] RBAC: Adding query filter params (role.id=4cbf6ec846eb4b7c8cc52e9bfd6f076f, user.id=28d74c815e2e4a42aa4c365c6cd615c2, scope.system=all) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:36.957847 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b008ac8c-b76d-46e5-8edc-c22e8d12246a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:36.959294 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b008ac8c-b76d-46e5-8edc-c22e8d12246a None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:36.973720 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 171/334] 10.222.0.26 () {56 vars in 1308 bytes} [Fri Jul 1 19:21:36 2022] GET /identity/v3/role_assignments?user.id=28d74c815e2e4a42aa4c365c6cd615c2&scope.system=all&role.id=4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 510 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:21:39.089780 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6e805-673a-407c-a72d-92fe355d1631 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:39.090820 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6e805-673a-407c-a72d-92fe355d1631 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:39.091332 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6e805-673a-407c-a72d-92fe355d1631 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:39.094071 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 164/335] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:21:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:21:39.105386 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9f237-6819-495d-8166-cb145d0300ec None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:39.106358 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9f237-6819-495d-8166-cb145d0300ec None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:39.106891 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9f237-6819-495d-8166-cb145d0300ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:39.130266 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-75d9f237-6819-495d-8166-cb145d0300ec None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:21:39.131885 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-75d9f237-6819-495d-8166-cb145d0300ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:21:39.210210 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 172/336] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:21:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:21:39.262841 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe6e805-673a-407c-a72d-92fe355d1631 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:39.395756 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe6e805-673a-407c-a72d-92fe355d1631 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:39.401269 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:39.444233 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b66ead3-5eba-416a-b2f1-4a5ad9a34333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:39.445512 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66ead3-5eba-416a-b2f1-4a5ad9a34333 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:39.446023 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66ead3-5eba-416a-b2f1-4a5ad9a34333 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:39.446521 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66ead3-5eba-416a-b2f1-4a5ad9a34333 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:39.460651 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b66ead3-5eba-416a-b2f1-4a5ad9a34333 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:21:39.469408 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-2b66ead3-5eba-416a-b2f1-4a5ad9a34333 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 01 19:21:39.469408 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:21:39.469408 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:21:39.469408 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:21:39.469408 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:21:39.469408 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:21:39.469408 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:21:39.469408 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:21:39.469408 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:21:39.469408 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:21:39.469408 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:21:39.469408 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:21:39.469408 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:21:39.469408 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:21:39.469408 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:21:39.469408 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:21:39.470308 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:21:39.470308 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:21:39.470308 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:21:39.470308 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:21:39.470308 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:21:39.470308 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:21:39.470308 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:21:39.470308 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:21:39.470308 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:21:39.470308 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:21:39.470308 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:21:39.470308 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:21:39.470308 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:21:39.470308 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:21:39.470308 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:21:39.470308 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:21:39.471186 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:21:39.471186 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:21:39.471186 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:21:39.471186 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:21:39.471186 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:21:39.471186 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:21:39.471186 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:21:39.471186 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:21:39.471186 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:21:39.471186 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:21:39.471186 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 01 19:21:39.471186 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:21:39.477344 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 165/337] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Jul 1 19:21:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:21:39.480117 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d9f237-6819-495d-8166-cb145d0300ec None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:39.489400 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18a825-d2da-4ed9-8549-a5c75d305dc8 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:39.492011 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18a825-d2da-4ed9-8549-a5c75d305dc8 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:39.493714 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18a825-d2da-4ed9-8549-a5c75d305dc8 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:39.498575 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 166/338] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:21:39 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:21:39.506922 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98475e2e-e2c7-4a7f-ac0b-df46c4fc187e None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:39.507499 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98475e2e-e2c7-4a7f-ac0b-df46c4fc187e None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:39.507995 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98475e2e-e2c7-4a7f-ac0b-df46c4fc187e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:39.539413 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-98475e2e-e2c7-4a7f-ac0b-df46c4fc187e None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:21:39.540951 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-98475e2e-e2c7-4a7f-ac0b-df46c4fc187e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:21:39.598711 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d9f237-6819-495d-8166-cb145d0300ec None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:39.609626 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:39.643568 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbaa472-1d79-486d-868c-e706bb755100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:39.644420 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbaa472-1d79-486d-868c-e706bb755100 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:39.644847 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbaa472-1d79-486d-868c-e706bb755100 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:39.645308 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbaa472-1d79-486d-868c-e706bb755100 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:39.646252 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbaa472-1d79-486d-868c-e706bb755100 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:39.646722 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbaa472-1d79-486d-868c-e706bb755100 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:39.648225 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbaa472-1d79-486d-868c-e706bb755100 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:39.658178 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 173/339] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Jul 1 19:21:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:39.664349 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbaa472-1d79-486d-868c-e706bb755100 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:39.689845 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 167/340] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:21:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:21:39.748118 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98475e2e-e2c7-4a7f-ac0b-df46c4fc187e None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:39.947374 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbaa472-1d79-486d-868c-e706bb755100 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:39.973601 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:39.993015 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98475e2e-e2c7-4a7f-ac0b-df46c4fc187e None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:40.014904 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7579348c-e98d-4469-adba-f179f11ba5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:40.016094 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579348c-e98d-4469-adba-f179f11ba5d8 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:40.016565 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579348c-e98d-4469-adba-f179f11ba5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:40.017048 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579348c-e98d-4469-adba-f179f11ba5d8 None admin] PATH_INFO: `/v3/users/25b40e4ff7834e09a00e703d90cdf3ee` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:40.018744 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7579348c-e98d-4469-adba-f179f11ba5d8 None admin] RBAC: Authorizing `identity:get_user(user_id=25b40e4ff7834e09a00e703d90cdf3ee)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:40.029261 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7579348c-e98d-4469-adba-f179f11ba5d8 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:40.032321 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 174/341] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Jul 1 19:21:39 2022] GET /identity/v3/users/25b40e4ff7834e09a00e703d90cdf3ee => generated 293 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:40.034128 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8cdc8-e523-4717-b830-22f825e3debd None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:40.034654 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8cdc8-e523-4717-b830-22f825e3debd None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:40.035234 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8cdc8-e523-4717-b830-22f825e3debd None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:40.036927 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 175/342] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:21:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:21:40.043328 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2d6932-8c05-44b1-8a5d-af8cf8048785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:40.043854 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b679a6c-0157-4fbb-b647-a48d89e9d6ec None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:40.044359 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d6932-8c05-44b1-8a5d-af8cf8048785 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:40.044491 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b679a6c-0157-4fbb-b647-a48d89e9d6ec None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:40.044824 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d6932-8c05-44b1-8a5d-af8cf8048785 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:40.045090 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b679a6c-0157-4fbb-b647-a48d89e9d6ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:40.045319 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d6932-8c05-44b1-8a5d-af8cf8048785 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:40.071884 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2d6932-8c05-44b1-8a5d-af8cf8048785 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:21:40.081330 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-3b679a6c-0157-4fbb-b647-a48d89e9d6ec None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:21:40.082552 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-3b679a6c-0157-4fbb-b647-a48d89e9d6ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:21:40.085939 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-9d2d6932-8c05-44b1-8a5d-af8cf8048785 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 01 19:21:40.085939 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:21:40.085939 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:21:40.085939 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:21:40.085939 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:21:40.085939 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:21:40.085939 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:21:40.085939 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:21:40.085939 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:21:40.085939 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:21:40.085939 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:21:40.085939 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:21:40.085939 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:21:40.085939 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:21:40.085939 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:21:40.085939 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:21:40.087071 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:21:40.087071 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:21:40.087071 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:21:40.087071 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:21:40.087071 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:21:40.087071 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:21:40.087071 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:21:40.087071 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:21:40.087071 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:21:40.087071 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:21:40.087071 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:21:40.087071 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:21:40.087071 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:21:40.087071 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:21:40.087071 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:21:40.087071 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:21:40.087850 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:21:40.087850 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:21:40.087850 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:21:40.087850 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:21:40.087850 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:21:40.087850 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:21:40.087850 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:21:40.087850 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:21:40.087850 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:21:40.087850 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:21:40.087850 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 01 19:21:40.087850 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:21:40.088495 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 168/343] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Jul 1 19:21:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:21:40.089263 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2d6932-8c05-44b1-8a5d-af8cf8048785 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:40.120751 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:40.165592 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 176/344] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:21:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 19:21:40.167100 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e052c649-2722-425b-922d-b5a8a4dafeca None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:40.167422 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e052c649-2722-425b-922d-b5a8a4dafeca None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:40.167752 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e052c649-2722-425b-922d-b5a8a4dafeca None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:40.169445 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 177/345] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:21:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:21:40.170323 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e052c649-2722-425b-922d-b5a8a4dafeca None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:40.215590 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2d6932-8c05-44b1-8a5d-af8cf8048785 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:40.259234 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4d30cf-bb09-4d7a-b4d8-46aa89ee4e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:40.260284 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d30cf-bb09-4d7a-b4d8-46aa89ee4e10 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:40.260765 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d30cf-bb09-4d7a-b4d8-46aa89ee4e10 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:40.261270 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d30cf-bb09-4d7a-b4d8-46aa89ee4e10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:40.262382 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4d30cf-bb09-4d7a-b4d8-46aa89ee4e10 None admin] RBAC: Adding query filter params (role.id=f4f5eb791e8749f18c9d57c113558e15, user.id=25b40e4ff7834e09a00e703d90cdf3ee, scope.system=all) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:40.262944 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4d30cf-bb09-4d7a-b4d8-46aa89ee4e10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:40.264647 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4d30cf-bb09-4d7a-b4d8-46aa89ee4e10 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:40.289649 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 169/346] 10.222.0.26 () {56 vars in 1308 bytes} [Fri Jul 1 19:21:40 2022] GET /identity/v3/role_assignments?user.id=25b40e4ff7834e09a00e703d90cdf3ee&scope.system=all&role.id=f4f5eb791e8749f18c9d57c113558e15 => generated 510 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:40.291482 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e70d7ca-7655-43d0-a177-01d186b5fb56 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:40.291969 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e70d7ca-7655-43d0-a177-01d186b5fb56 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:40.292437 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e70d7ca-7655-43d0-a177-01d186b5fb56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:40.303461 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e052c649-2722-425b-922d-b5a8a4dafeca None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:40.323342 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-6e70d7ca-7655-43d0-a177-01d186b5fb56 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:21:40.325082 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-6e70d7ca-7655-43d0-a177-01d186b5fb56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:21:40.334597 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:40.357286 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eaa079-2587-4196-82d1-e7841693e691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:40.357286 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eaa079-2587-4196-82d1-e7841693e691 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:40.357286 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eaa079-2587-4196-82d1-e7841693e691 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:40.357286 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eaa079-2587-4196-82d1-e7841693e691 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:40.358628 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eaa079-2587-4196-82d1-e7841693e691 None admin] RBAC: Adding query filter params (name=member) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:40.359037 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eaa079-2587-4196-82d1-e7841693e691 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:40.360698 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eaa079-2587-4196-82d1-e7841693e691 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:40.372654 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 178/347] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Jul 1 19:21:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:40.373864 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eaa079-2587-4196-82d1-e7841693e691 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:40.434173 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:40.449613 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 170/348] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:21:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:21:40.451253 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a0931-3b57-4488-baa9-7eef066d6678 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:40.451737 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a0931-3b57-4488-baa9-7eef066d6678 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:40.452185 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a0931-3b57-4488-baa9-7eef066d6678 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:40.454280 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 171/349] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:21:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:21:40.455157 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637a0931-3b57-4488-baa9-7eef066d6678 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:40.570888 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eaa079-2587-4196-82d1-e7841693e691 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:40.613923 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4d50fa-2dca-421a-a5b7-1fa11599d348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:40.614399 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637a0931-3b57-4488-baa9-7eef066d6678 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:40.614742 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d50fa-2dca-421a-a5b7-1fa11599d348 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:40.615015 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d50fa-2dca-421a-a5b7-1fa11599d348 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:40.615350 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d50fa-2dca-421a-a5b7-1fa11599d348 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:40.632700 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4d50fa-2dca-421a-a5b7-1fa11599d348 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:21:40.642390 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-3e4d50fa-2dca-421a-a5b7-1fa11599d348 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 19:21:40.642390 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:21:40.642390 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:21:40.642390 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:21:40.642390 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:21:40.642390 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:21:40.642390 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:21:40.642390 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:21:40.642390 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:21:40.642390 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:21:40.642390 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:21:40.642390 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:21:40.642390 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:21:40.642390 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:21:40.642390 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:21:40.642390 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:21:40.643292 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:21:40.643292 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:21:40.643292 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:21:40.643292 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:21:40.643292 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:21:40.643292 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:21:40.643292 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:21:40.643292 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:21:40.643292 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:21:40.643292 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:21:40.643292 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:21:40.643292 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:21:40.643292 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:21:40.643292 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:21:40.643292 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:21:40.643292 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:21:40.644087 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:21:40.644087 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:21:40.644087 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:21:40.644087 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:21:40.644087 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:21:40.644087 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:21:40.644087 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:21:40.644087 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:21:40.644087 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:21:40.644087 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:21:40.644087 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 19:21:40.644087 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:21:40.644087 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 179/350] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Jul 1 19:21:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:21:40.645677 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a091dfe-7301-4907-b8f0-7a2645493af0 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:40.645677 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a091dfe-7301-4907-b8f0-7a2645493af0 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:40.645832 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a091dfe-7301-4907-b8f0-7a2645493af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:40.666980 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-5a091dfe-7301-4907-b8f0-7a2645493af0 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:21:40.668597 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-5a091dfe-7301-4907-b8f0-7a2645493af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:21:40.671599 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9efc13-7f1a-4f46-9cfd-42c9f07a4fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:40.673451 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9efc13-7f1a-4f46-9cfd-42c9f07a4fa8 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:40.673806 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9efc13-7f1a-4f46-9cfd-42c9f07a4fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:40.674094 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9efc13-7f1a-4f46-9cfd-42c9f07a4fa8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:40.688540 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:40.758462 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 180/351] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:21:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:21:40.759447 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a091dfe-7301-4907-b8f0-7a2645493af0 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:40.778723 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9efc13-7f1a-4f46-9cfd-42c9f07a4fa8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:40.781762 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9efc13-7f1a-4f46-9cfd-42c9f07a4fa8 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:40.798884 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:40.919587 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 172/352] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Jul 1 19:21:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 19:21:40.920471 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9efc13-7f1a-4f46-9cfd-42c9f07a4fa8 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:40.926408 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a091dfe-7301-4907-b8f0-7a2645493af0 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:40.974529 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:40.977600 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d426058-3b8b-4da3-ad2b-0a90cca11622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:40.978503 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d426058-3b8b-4da3-ad2b-0a90cca11622 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:40.978755 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d426058-3b8b-4da3-ad2b-0a90cca11622 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:40.979378 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d426058-3b8b-4da3-ad2b-0a90cca11622 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:40.992440 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d426058-3b8b-4da3-ad2b-0a90cca11622 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:21:41.001527 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-9d426058-3b8b-4da3-ad2b-0a90cca11622 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 01 19:21:41.001527 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:21:41.001527 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:21:41.001527 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:21:41.001527 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:21:41.001527 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:21:41.001527 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:21:41.001527 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:21:41.001527 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:21:41.001527 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:21:41.001527 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:21:41.001527 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:21:41.001527 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:21:41.001527 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:21:41.001527 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:21:41.001527 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:21:41.002541 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:21:41.002541 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:21:41.002541 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:21:41.002541 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:21:41.002541 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:21:41.002541 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:21:41.002541 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:21:41.002541 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:21:41.002541 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:21:41.002541 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:21:41.002541 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:21:41.002541 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:21:41.002541 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:21:41.002541 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:21:41.002541 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:21:41.002541 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:21:41.003386 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:21:41.003386 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:21:41.003386 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:21:41.003386 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:21:41.003386 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:21:41.003386 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:21:41.003386 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:21:41.003386 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:21:41.003386 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:21:41.003386 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:21:41.003386 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 01 19:21:41.003386 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:21:41.003386 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 181/353] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Jul 1 19:21:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:21:41.004822 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d426058-3b8b-4da3-ad2b-0a90cca11622 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:41.065055 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9efc13-7f1a-4f46-9cfd-42c9f07a4fa8 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:41.109905 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd13a332-9de8-4605-ba03-ee301b44726d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:41.110589 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13a332-9de8-4605-ba03-ee301b44726d None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:41.110878 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13a332-9de8-4605-ba03-ee301b44726d None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:41.112954 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13a332-9de8-4605-ba03-ee301b44726d None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:41.112954 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd13a332-9de8-4605-ba03-ee301b44726d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:41.112954 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd13a332-9de8-4605-ba03-ee301b44726d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:41.113661 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd13a332-9de8-4605-ba03-ee301b44726d None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:41.125976 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 173/354] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Jul 1 19:21:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:41.129973 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd13a332-9de8-4605-ba03-ee301b44726d None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:41.130450 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:41.161882 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d426058-3b8b-4da3-ad2b-0a90cca11622 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:41.213125 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5d6cbb-fef1-4db1-9d5f-efaf14f4aa93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:41.213935 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5d6cbb-fef1-4db1-9d5f-efaf14f4aa93 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:41.214220 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5d6cbb-fef1-4db1-9d5f-efaf14f4aa93 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:41.214499 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5d6cbb-fef1-4db1-9d5f-efaf14f4aa93 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:41.228636 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5d6cbb-fef1-4db1-9d5f-efaf14f4aa93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:21:41.238514 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-cf5d6cbb-fef1-4db1-9d5f-efaf14f4aa93 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 19:21:41.238514 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:21:41.238514 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:21:41.238514 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:21:41.238514 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:21:41.238514 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:21:41.238514 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:21:41.238514 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:21:41.238514 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:21:41.238514 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:21:41.238514 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:21:41.238514 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:21:41.238514 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:21:41.238514 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:21:41.238514 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:21:41.238514 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:21:41.239816 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:21:41.239816 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:21:41.239816 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:21:41.239816 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:21:41.239816 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:21:41.239816 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:21:41.239816 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:21:41.239816 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:21:41.239816 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:21:41.239816 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:21:41.239816 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:21:41.239816 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:21:41.239816 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:21:41.239816 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:21:41.239816 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:21:41.239816 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:21:41.240778 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:21:41.240778 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:21:41.240778 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:21:41.240778 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:21:41.240778 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:21:41.240778 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:21:41.240778 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:21:41.240778 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:21:41.240778 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:21:41.240778 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:21:41.240778 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 19:21:41.240778 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:21:41.240778 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 182/355] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Jul 1 19:21:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:21:41.240778 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5d6cbb-fef1-4db1-9d5f-efaf14f4aa93 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:41.286150 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd13a332-9de8-4605-ba03-ee301b44726d None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:41.294768 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:41.334131 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8bc59b-b21c-40b8-84f0-a01e93dd986a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:41.334922 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8bc59b-b21c-40b8-84f0-a01e93dd986a None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:41.335294 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8bc59b-b21c-40b8-84f0-a01e93dd986a None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:41.335466 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8bc59b-b21c-40b8-84f0-a01e93dd986a None admin] PATH_INFO: `/v3/projects/9260fc0eba4449f190981e3ec5a011ad` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:41.336706 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8bc59b-b21c-40b8-84f0-a01e93dd986a None admin] RBAC: Authorizing `identity:get_project(project_id=9260fc0eba4449f190981e3ec5a011ad)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:41.338207 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8bc59b-b21c-40b8-84f0-a01e93dd986a None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:41.340182 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 174/356] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Jul 1 19:21:41 2022] GET /identity/v3/projects/9260fc0eba4449f190981e3ec5a011ad => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:41.340669 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8bc59b-b21c-40b8-84f0-a01e93dd986a None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:41.381873 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5d6cbb-fef1-4db1-9d5f-efaf14f4aa93 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:41.426507 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919ee28c-c7da-4933-8caf-5e5d550d1000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:41.427472 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ee28c-c7da-4933-8caf-5e5d550d1000 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:41.427899 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ee28c-c7da-4933-8caf-5e5d550d1000 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:41.428090 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ee28c-c7da-4933-8caf-5e5d550d1000 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:41.429102 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919ee28c-c7da-4933-8caf-5e5d550d1000 None admin] RBAC: Adding query filter params (name=member) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:41.429502 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919ee28c-c7da-4933-8caf-5e5d550d1000 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:41.430855 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919ee28c-c7da-4933-8caf-5e5d550d1000 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:41.443039 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 183/357] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Jul 1 19:21:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:41.443914 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919ee28c-c7da-4933-8caf-5e5d550d1000 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:41.447345 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:41.479568 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8bc59b-b21c-40b8-84f0-a01e93dd986a None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:41.527707 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826e4be2-4ba7-47cb-aa19-bbf07a80f24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:41.528365 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e4be2-4ba7-47cb-aa19-bbf07a80f24f None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:41.528652 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e4be2-4ba7-47cb-aa19-bbf07a80f24f None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:41.528931 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e4be2-4ba7-47cb-aa19-bbf07a80f24f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:41.572096 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919ee28c-c7da-4933-8caf-5e5d550d1000 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:41.575520 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:41.612623 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478849c1-6405-4620-ba21-f68482aa68e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:41.613330 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478849c1-6405-4620-ba21-f68482aa68e2 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:41.613622 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478849c1-6405-4620-ba21-f68482aa68e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:41.613905 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478849c1-6405-4620-ba21-f68482aa68e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:41.614660 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478849c1-6405-4620-ba21-f68482aa68e2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:41.614975 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478849c1-6405-4620-ba21-f68482aa68e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:41.616457 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478849c1-6405-4620-ba21-f68482aa68e2 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:41.618805 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826e4be2-4ba7-47cb-aa19-bbf07a80f24f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:41.620519 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826e4be2-4ba7-47cb-aa19-bbf07a80f24f None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:41.628031 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 184/358] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Jul 1 19:21:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:41.628736 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478849c1-6405-4620-ba21-f68482aa68e2 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:41.711456 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:41.747531 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 175/359] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Jul 1 19:21:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 19:21:41.749187 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82248452-a9d3-4bc0-bb1c-344d4772fef4 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:41.749650 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82248452-a9d3-4bc0-bb1c-344d4772fef4 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:41.749942 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82248452-a9d3-4bc0-bb1c-344d4772fef4 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:41.751478 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 176/360] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:21:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:21:41.753589 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82248452-a9d3-4bc0-bb1c-344d4772fef4 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:41.761790 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478849c1-6405-4620-ba21-f68482aa68e2 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:41.802070 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac1c082-f096-475c-8d1d-cd4dee63ee6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:41.803087 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac1c082-f096-475c-8d1d-cd4dee63ee6a None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:41.803380 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac1c082-f096-475c-8d1d-cd4dee63ee6a None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:41.803919 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac1c082-f096-475c-8d1d-cd4dee63ee6a None admin] PATH_INFO: `/v3/groups/c35827b60ff544918b6872031644fbd1` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:41.810546 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac1c082-f096-475c-8d1d-cd4dee63ee6a None admin] RBAC: Authorizing `identity:get_group(group_id=c35827b60ff544918b6872031644fbd1)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:41.812444 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac1c082-f096-475c-8d1d-cd4dee63ee6a None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:41.816046 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 185/361] 10.222.0.26 () {56 vars in 1180 bytes} [Fri Jul 1 19:21:41 2022] GET /identity/v3/groups/c35827b60ff544918b6872031644fbd1 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:41.816046 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac1c082-f096-475c-8d1d-cd4dee63ee6a None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:41.852807 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:41.890808 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82248452-a9d3-4bc0-bb1c-344d4772fef4 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:41.938354 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd414609-f986-4f31-b21e-12c85df01940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:41.939276 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd414609-f986-4f31-b21e-12c85df01940 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:41.939555 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd414609-f986-4f31-b21e-12c85df01940 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:41.940139 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd414609-f986-4f31-b21e-12c85df01940 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:41.942811 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac1c082-f096-475c-8d1d-cd4dee63ee6a None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:41.973208 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:41.984306 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b860522-f2ab-4af2-af63-043aa9bab8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:41.984963 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b860522-f2ab-4af2-af63-043aa9bab8d6 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:41.985280 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b860522-f2ab-4af2-af63-043aa9bab8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:41.985561 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b860522-f2ab-4af2-af63-043aa9bab8d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:42.028119 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd414609-f986-4f31-b21e-12c85df01940 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:42.030696 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd414609-f986-4f31-b21e-12c85df01940 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:42.070460 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b860522-f2ab-4af2-af63-043aa9bab8d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:42.071777 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b860522-f2ab-4af2-af63-043aa9bab8d6 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:42.117392 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:42.158463 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 177/362] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Jul 1 19:21:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 19:21:42.160071 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99ccf2-1b34-46cf-9fea-7cc873ddccbe None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:42.160545 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99ccf2-1b34-46cf-9fea-7cc873ddccbe None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:42.160826 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99ccf2-1b34-46cf-9fea-7cc873ddccbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:42.180271 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-3b99ccf2-1b34-46cf-9fea-7cc873ddccbe None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:21:42.181818 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-3b99ccf2-1b34-46cf-9fea-7cc873ddccbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:21:42.198498 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 186/363] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Jul 1 19:21:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 19:21:42.199373 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b860522-f2ab-4af2-af63-043aa9bab8d6 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:42.234048 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:42.261828 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 178/364] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:21:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:21:42.262911 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b99ccf2-1b34-46cf-9fea-7cc873ddccbe None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:42.336845 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b860522-f2ab-4af2-af63-043aa9bab8d6 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:42.382078 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c479dc-43bc-4e9b-913b-15fd4e731ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:42.382945 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c479dc-43bc-4e9b-913b-15fd4e731ae8 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:42.383219 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c479dc-43bc-4e9b-913b-15fd4e731ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:42.383494 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c479dc-43bc-4e9b-913b-15fd4e731ae8 None admin] PATH_INFO: `/v3/projects/9260fc0eba4449f190981e3ec5a011ad` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:42.384700 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c479dc-43bc-4e9b-913b-15fd4e731ae8 None admin] RBAC: Authorizing `identity:get_project(project_id=9260fc0eba4449f190981e3ec5a011ad)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:42.386177 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c479dc-43bc-4e9b-913b-15fd4e731ae8 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:42.388063 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 187/365] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Jul 1 19:21:42 2022] GET /identity/v3/projects/9260fc0eba4449f190981e3ec5a011ad => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:42.388725 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c479dc-43bc-4e9b-913b-15fd4e731ae8 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:42.389359 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:42.395716 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b99ccf2-1b34-46cf-9fea-7cc873ddccbe None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:42.441875 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b56e3e0-3b4c-4e89-970c-791d9023c03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:42.442545 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56e3e0-3b4c-4e89-970c-791d9023c03a None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:42.442835 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56e3e0-3b4c-4e89-970c-791d9023c03a None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:42.443115 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56e3e0-3b4c-4e89-970c-791d9023c03a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:42.443965 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b56e3e0-3b4c-4e89-970c-791d9023c03a None admin] RBAC: Adding query filter params (group.id=c35827b60ff544918b6872031644fbd1, role.id=4cbf6ec846eb4b7c8cc52e9bfd6f076f, scope.project.id=9260fc0eba4449f190981e3ec5a011ad) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:42.444282 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b56e3e0-3b4c-4e89-970c-791d9023c03a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:42.446055 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b56e3e0-3b4c-4e89-970c-791d9023c03a None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:42.451744 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 179/366] 10.222.0.26 () {56 vars in 1376 bytes} [Fri Jul 1 19:21:42 2022] GET /identity/v3/role_assignments?group.id=c35827b60ff544918b6872031644fbd1&scope.project.id=9260fc0eba4449f190981e3ec5a011ad&role.id=4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:42.453490 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b56e3e0-3b4c-4e89-970c-791d9023c03a None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:42.528238 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:42.536354 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c479dc-43bc-4e9b-913b-15fd4e731ae8 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:42.579777 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dac115-15a9-4daa-adef-826fae17b6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:42.580716 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dac115-15a9-4daa-adef-826fae17b6d1 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:42.581281 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dac115-15a9-4daa-adef-826fae17b6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:42.581281 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dac115-15a9-4daa-adef-826fae17b6d1 None admin] PATH_INFO: `/v3/projects/b3f5af7a5da14e5c84bea28cc3aa5626` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:42.582559 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dac115-15a9-4daa-adef-826fae17b6d1 None admin] RBAC: Authorizing `identity:get_project(project_id=b3f5af7a5da14e5c84bea28cc3aa5626)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:42.584069 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dac115-15a9-4daa-adef-826fae17b6d1 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:42.591622 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 188/367] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Jul 1 19:21:42 2022] GET /identity/v3/projects/b3f5af7a5da14e5c84bea28cc3aa5626 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:42.591622 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dac115-15a9-4daa-adef-826fae17b6d1 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:42.617499 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b56e3e0-3b4c-4e89-970c-791d9023c03a None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:42.668333 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0024df-f434-48f7-a95b-2bc8577ef5ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:42.669202 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0024df-f434-48f7-a95b-2bc8577ef5ce None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:42.669517 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0024df-f434-48f7-a95b-2bc8577ef5ce None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:42.669794 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0024df-f434-48f7-a95b-2bc8577ef5ce None admin] PATH_INFO: `/v3/projects/b3f5af7a5da14e5c84bea28cc3aa5626` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:42.671009 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0024df-f434-48f7-a95b-2bc8577ef5ce None admin] RBAC: Authorizing `identity:get_project(project_id=b3f5af7a5da14e5c84bea28cc3aa5626)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:42.672467 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0024df-f434-48f7-a95b-2bc8577ef5ce None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:42.677352 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 180/368] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Jul 1 19:21:42 2022] GET /identity/v3/projects/b3f5af7a5da14e5c84bea28cc3aa5626 => generated 302 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:42.677352 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0024df-f434-48f7-a95b-2bc8577ef5ce None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:42.714548 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:42.731666 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dac115-15a9-4daa-adef-826fae17b6d1 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:42.771410 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aba6397-1930-44ce-b910-0de559127fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:42.772221 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba6397-1930-44ce-b910-0de559127fc0 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:42.772763 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba6397-1930-44ce-b910-0de559127fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:42.772870 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba6397-1930-44ce-b910-0de559127fc0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:42.784228 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aba6397-1930-44ce-b910-0de559127fc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:21:42.792374 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-0aba6397-1930-44ce-b910-0de559127fc0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:21:42.792374 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:21:42.792374 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:21:42.792374 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:21:42.792374 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:21:42.792374 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:21:42.792374 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:21:42.792374 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:21:42.792374 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:21:42.792374 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:21:42.792374 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:21:42.792374 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:21:42.792374 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:21:42.792374 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:21:42.792374 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:21:42.792374 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:21:42.793971 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:21:42.793971 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:21:42.793971 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:21:42.793971 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:21:42.793971 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:21:42.793971 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:21:42.793971 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:21:42.793971 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:21:42.793971 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:21:42.793971 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:21:42.793971 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:21:42.793971 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:21:42.793971 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:21:42.793971 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:21:42.793971 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:21:42.793971 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:21:42.795032 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:21:42.795032 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:21:42.795032 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:21:42.795032 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:21:42.795032 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:21:42.795032 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:21:42.795032 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:21:42.795032 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:21:42.795032 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:21:42.795032 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:21:42.795032 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:21:42.795032 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:21:42.795032 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 189/369] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Jul 1 19:21:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:21:42.795032 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aba6397-1930-44ce-b910-0de559127fc0 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:42.802722 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0024df-f434-48f7-a95b-2bc8577ef5ce None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:42.832997 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:42.842740 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5883f5b-c7b5-4700-9ad5-f79775fa1876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:42.843528 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5883f5b-c7b5-4700-9ad5-f79775fa1876 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:42.843815 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5883f5b-c7b5-4700-9ad5-f79775fa1876 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:42.844092 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5883f5b-c7b5-4700-9ad5-f79775fa1876 None admin] PATH_INFO: `/v3/groups/c35827b60ff544918b6872031644fbd1` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:42.845336 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5883f5b-c7b5-4700-9ad5-f79775fa1876 None admin] RBAC: Authorizing `identity:get_group(group_id=c35827b60ff544918b6872031644fbd1)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:42.846803 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5883f5b-c7b5-4700-9ad5-f79775fa1876 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:42.853455 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 181/370] 10.222.0.26 () {56 vars in 1180 bytes} [Fri Jul 1 19:21:42 2022] GET /identity/v3/groups/c35827b60ff544918b6872031644fbd1 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:42.854071 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5883f5b-c7b5-4700-9ad5-f79775fa1876 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:42.922705 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aba6397-1930-44ce-b910-0de559127fc0 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:42.957384 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af806d5-edde-44db-bf59-c5d4cfefd6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:42.958751 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af806d5-edde-44db-bf59-c5d4cfefd6aa None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:42.958751 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af806d5-edde-44db-bf59-c5d4cfefd6aa None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:42.958751 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af806d5-edde-44db-bf59-c5d4cfefd6aa None admin] PATH_INFO: `/v3/groups/c35827b60ff544918b6872031644fbd1` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:42.959959 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af806d5-edde-44db-bf59-c5d4cfefd6aa None admin] RBAC: Authorizing `identity:get_group(group_id=c35827b60ff544918b6872031644fbd1)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:42.961433 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af806d5-edde-44db-bf59-c5d4cfefd6aa None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:42.967705 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 190/371] 10.222.0.26 () {56 vars in 1180 bytes} [Fri Jul 1 19:21:42 2022] GET /identity/v3/groups/c35827b60ff544918b6872031644fbd1 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:42.967705 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af806d5-edde-44db-bf59-c5d4cfefd6aa None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:42.974344 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:42.977565 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5883f5b-c7b5-4700-9ad5-f79775fa1876 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:43.019829 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd61516-cf0f-4fd3-809f-f07431974388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:43.020687 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd61516-cf0f-4fd3-809f-f07431974388 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:43.020973 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd61516-cf0f-4fd3-809f-f07431974388 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:43.021417 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd61516-cf0f-4fd3-809f-f07431974388 None admin] PATH_INFO: `/v3/groups/c35827b60ff544918b6872031644fbd1` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:43.022454 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd61516-cf0f-4fd3-809f-f07431974388 None admin] RBAC: Authorizing `identity:get_group(group_id=c35827b60ff544918b6872031644fbd1)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:43.023970 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd61516-cf0f-4fd3-809f-f07431974388 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:43.026284 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 182/372] 10.222.0.26 () {56 vars in 1180 bytes} [Fri Jul 1 19:21:42 2022] GET /identity/v3/groups/c35827b60ff544918b6872031644fbd1 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:43.026865 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd61516-cf0f-4fd3-809f-f07431974388 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:43.074002 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:43.084413 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af806d5-edde-44db-bf59-c5d4cfefd6aa None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:43.121127 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b3403-6251-427f-b55c-e976662c44f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:43.121811 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b3403-6251-427f-b55c-e976662c44f4 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:43.122090 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b3403-6251-427f-b55c-e976662c44f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:43.122372 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b3403-6251-427f-b55c-e976662c44f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:43.123112 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146b3403-6251-427f-b55c-e976662c44f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:43.123422 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146b3403-6251-427f-b55c-e976662c44f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:43.126164 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146b3403-6251-427f-b55c-e976662c44f4 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:43.139580 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 191/373] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Jul 1 19:21:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:43.139580 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b3403-6251-427f-b55c-e976662c44f4 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:43.139913 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd61516-cf0f-4fd3-809f-f07431974388 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:43.177040 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb18dc6-558b-46d3-aa02-f9e02776b5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:43.177728 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb18dc6-558b-46d3-aa02-f9e02776b5a9 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:43.178014 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb18dc6-558b-46d3-aa02-f9e02776b5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:43.178290 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb18dc6-558b-46d3-aa02-f9e02776b5a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:43.179378 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb18dc6-558b-46d3-aa02-f9e02776b5a9 None admin] RBAC: Adding query filter params (group.id=c35827b60ff544918b6872031644fbd1, role.id=dd71f7898e6a4d9f99d1554dd7d27033, scope.project.id=9260fc0eba4449f190981e3ec5a011ad) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:43.179692 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb18dc6-558b-46d3-aa02-f9e02776b5a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:43.181147 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb18dc6-558b-46d3-aa02-f9e02776b5a9 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:43.187307 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 183/374] 10.222.0.26 () {56 vars in 1376 bytes} [Fri Jul 1 19:21:43 2022] GET /identity/v3/role_assignments?group.id=c35827b60ff544918b6872031644fbd1&scope.project.id=9260fc0eba4449f190981e3ec5a011ad&role.id=dd71f7898e6a4d9f99d1554dd7d27033 => generated 260 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:43.187923 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb18dc6-558b-46d3-aa02-f9e02776b5a9 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:43.227625 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:43.272866 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b3403-6251-427f-b55c-e976662c44f4 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:43.320791 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb18dc6-558b-46d3-aa02-f9e02776b5a9 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:43.327371 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c298e8-84ac-424c-9ec9-f74e6d178c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:43.328567 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c298e8-84ac-424c-9ec9-f74e6d178c51 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:43.329131 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c298e8-84ac-424c-9ec9-f74e6d178c51 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:43.329772 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c298e8-84ac-424c-9ec9-f74e6d178c51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:43.331342 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c298e8-84ac-424c-9ec9-f74e6d178c51 None admin] RBAC: Adding query filter params (group.id=c35827b60ff544918b6872031644fbd1, role.id=4cbf6ec846eb4b7c8cc52e9bfd6f076f, scope.project.id=b3f5af7a5da14e5c84bea28cc3aa5626) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:43.331987 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c298e8-84ac-424c-9ec9-f74e6d178c51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:43.334645 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c298e8-84ac-424c-9ec9-f74e6d178c51 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:43.345517 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 192/375] 10.222.0.26 () {56 vars in 1376 bytes} [Fri Jul 1 19:21:43 2022] GET /identity/v3/role_assignments?group.id=c35827b60ff544918b6872031644fbd1&scope.project.id=b3f5af7a5da14e5c84bea28cc3aa5626&role.id=4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 260 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:43.347220 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c298e8-84ac-424c-9ec9-f74e6d178c51 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:43.362687 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f6d71-0c0d-4b08-a095-2916372f6a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:43.364001 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f6d71-0c0d-4b08-a095-2916372f6a71 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:43.364284 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f6d71-0c0d-4b08-a095-2916372f6a71 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:43.364562 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f6d71-0c0d-4b08-a095-2916372f6a71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:43.365570 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96f6d71-0c0d-4b08-a095-2916372f6a71 None admin] RBAC: Adding query filter params (group.id=c35827b60ff544918b6872031644fbd1, role.id=dd71f7898e6a4d9f99d1554dd7d27033, scope.project.id=b3f5af7a5da14e5c84bea28cc3aa5626) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:43.365887 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96f6d71-0c0d-4b08-a095-2916372f6a71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:43.367998 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96f6d71-0c0d-4b08-a095-2916372f6a71 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:43.375427 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 184/376] 10.222.0.26 () {56 vars in 1376 bytes} [Fri Jul 1 19:21:43 2022] GET /identity/v3/role_assignments?group.id=c35827b60ff544918b6872031644fbd1&scope.project.id=b3f5af7a5da14e5c84bea28cc3aa5626&role.id=dd71f7898e6a4d9f99d1554dd7d27033 => generated 260 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:43.401713 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:43.534186 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c298e8-84ac-424c-9ec9-f74e6d178c51 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:43.593989 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c6d07a-eeac-417e-9ad8-c80122cd37a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:43.594980 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c6d07a-eeac-417e-9ad8-c80122cd37a5 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:43.595415 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c6d07a-eeac-417e-9ad8-c80122cd37a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:43.595856 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c6d07a-eeac-417e-9ad8-c80122cd37a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:43.708879 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c6d07a-eeac-417e-9ad8-c80122cd37a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:43.711284 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c6d07a-eeac-417e-9ad8-c80122cd37a5 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:43.753655 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:43.870543 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 193/377] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Jul 1 19:21:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 19:21:43.876688 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f6d71-0c0d-4b08-a095-2916372f6a71 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:43.986350 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:43.992137 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f6d71-0c0d-4b08-a095-2916372f6a71 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:44.028712 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98aafb5-add7-4a4f-adb7-6b713c8da9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:44.029612 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98aafb5-add7-4a4f-adb7-6b713c8da9ed None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:44.029928 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98aafb5-add7-4a4f-adb7-6b713c8da9ed None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:44.030204 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98aafb5-add7-4a4f-adb7-6b713c8da9ed None admin] PATH_INFO: `/v3/projects/82f5068f09304c36812a397a31aad7a3` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:44.031417 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98aafb5-add7-4a4f-adb7-6b713c8da9ed None admin] RBAC: Authorizing `identity:get_project(project_id=82f5068f09304c36812a397a31aad7a3)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:44.032860 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98aafb5-add7-4a4f-adb7-6b713c8da9ed None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:44.034911 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 185/378] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Jul 1 19:21:43 2022] GET /identity/v3/projects/82f5068f09304c36812a397a31aad7a3 => generated 344 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:44.040820 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c6d07a-eeac-417e-9ad8-c80122cd37a5 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:44.184555 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c6d07a-eeac-417e-9ad8-c80122cd37a5 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:44.208254 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:44.241088 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b28dd-3da9-4d3d-9354-95d75c92ec3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:44.241905 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b28dd-3da9-4d3d-9354-95d75c92ec3c None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:44.242194 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b28dd-3da9-4d3d-9354-95d75c92ec3c None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:44.242473 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b28dd-3da9-4d3d-9354-95d75c92ec3c None admin] PATH_INFO: `/v3/groups/ec7df40dd0a0438b8d0f5bbc5c2df889` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:44.251158 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0b28dd-3da9-4d3d-9354-95d75c92ec3c None admin] RBAC: Authorizing `identity:get_group(group_id=ec7df40dd0a0438b8d0f5bbc5c2df889)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:44.252694 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0b28dd-3da9-4d3d-9354-95d75c92ec3c None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:44.254731 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 194/379] 10.222.0.26 () {56 vars in 1180 bytes} [Fri Jul 1 19:21:44 2022] GET /identity/v3/groups/ec7df40dd0a0438b8d0f5bbc5c2df889 => generated 229 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:44.260748 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98aafb5-add7-4a4f-adb7-6b713c8da9ed None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:44.427600 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98aafb5-add7-4a4f-adb7-6b713c8da9ed None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:44.480279 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42d191a-87c9-451c-b7f4-d7bcbd36e348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:44.480921 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d191a-87c9-451c-b7f4-d7bcbd36e348 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:44.481209 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d191a-87c9-451c-b7f4-d7bcbd36e348 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:44.481515 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d191a-87c9-451c-b7f4-d7bcbd36e348 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:44.482354 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42d191a-87c9-451c-b7f4-d7bcbd36e348 None admin] RBAC: Adding query filter params (group.id=ec7df40dd0a0438b8d0f5bbc5c2df889, role.id=6cb03785fb184ef587509b3174622f69, scope.project.id=82f5068f09304c36812a397a31aad7a3) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:44.482669 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42d191a-87c9-451c-b7f4-d7bcbd36e348 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:44.484647 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42d191a-87c9-451c-b7f4-d7bcbd36e348 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:44.493893 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 186/380] 10.222.0.26 () {56 vars in 1376 bytes} [Fri Jul 1 19:21:44 2022] GET /identity/v3/role_assignments?group.id=ec7df40dd0a0438b8d0f5bbc5c2df889&scope.project.id=82f5068f09304c36812a397a31aad7a3&role.id=6cb03785fb184ef587509b3174622f69 => generated 260 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:44.773409 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a895d2a-b73d-4bb9-a4a9-fd2a582bc00a None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:44.773943 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a895d2a-b73d-4bb9-a4a9-fd2a582bc00a None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:44.773943 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a895d2a-b73d-4bb9-a4a9-fd2a582bc00a None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:44.775405 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 195/381] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:21:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:21:44.781482 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e855d5a-4126-47a4-b5cb-2d7c278e7eb4 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:44.781776 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e855d5a-4126-47a4-b5cb-2d7c278e7eb4 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:44.782088 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e855d5a-4126-47a4-b5cb-2d7c278e7eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:44.809502 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-0e855d5a-4126-47a4-b5cb-2d7c278e7eb4 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:21:44.810828 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-0e855d5a-4126-47a4-b5cb-2d7c278e7eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:21:44.848399 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:44.904915 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 187/382] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:21:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:21:44.932724 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a895d2a-b73d-4bb9-a4a9-fd2a582bc00a None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:45.101839 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a895d2a-b73d-4bb9-a4a9-fd2a582bc00a None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:45.162618 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876636cf-059e-4bed-8d84-ee6fec4da6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:45.163961 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876636cf-059e-4bed-8d84-ee6fec4da6d7 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:45.164467 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876636cf-059e-4bed-8d84-ee6fec4da6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:45.164964 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876636cf-059e-4bed-8d84-ee6fec4da6d7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:45.184104 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876636cf-059e-4bed-8d84-ee6fec4da6d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:21:45.199853 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-876636cf-059e-4bed-8d84-ee6fec4da6d7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 01 19:21:45.199853 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:21:45.199853 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:21:45.199853 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:21:45.199853 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:21:45.199853 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:21:45.199853 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:21:45.199853 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:21:45.199853 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:21:45.199853 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:21:45.199853 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:21:45.199853 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:21:45.199853 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:21:45.199853 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:21:45.199853 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:21:45.199853 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:21:45.200814 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:21:45.200814 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:21:45.200814 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:21:45.200814 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:21:45.200814 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:21:45.200814 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:21:45.200814 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:21:45.200814 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:21:45.200814 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:21:45.200814 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:21:45.200814 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:21:45.200814 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:21:45.200814 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:21:45.200814 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:21:45.200814 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:21:45.200814 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:21:45.201722 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:21:45.201722 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:21:45.201722 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:21:45.201722 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:21:45.201722 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:21:45.201722 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:21:45.201722 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:21:45.201722 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:21:45.201722 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:21:45.201722 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:21:45.201722 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 01 19:21:45.201722 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:21:45.202996 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 196/383] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Jul 1 19:21:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:21:45.211162 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e855d5a-4126-47a4-b5cb-2d7c278e7eb4 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:45.436617 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e855d5a-4126-47a4-b5cb-2d7c278e7eb4 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:45.495871 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17243629-30ff-420e-89f1-2027a31665fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:45.496953 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17243629-30ff-420e-89f1-2027a31665fb None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:45.497492 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17243629-30ff-420e-89f1-2027a31665fb None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:45.497994 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17243629-30ff-420e-89f1-2027a31665fb None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:45.499448 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17243629-30ff-420e-89f1-2027a31665fb None admin] RBAC: Adding query filter params (name=member) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:45.500008 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17243629-30ff-420e-89f1-2027a31665fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:45.502627 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17243629-30ff-420e-89f1-2027a31665fb None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:45.517396 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 188/384] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Jul 1 19:21:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:45.526321 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876636cf-059e-4bed-8d84-ee6fec4da6d7 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:45.603490 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:45.706442 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876636cf-059e-4bed-8d84-ee6fec4da6d7 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:45.767366 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f1c428-8ef9-4093-abc1-d9df7d9d6bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:45.768874 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1c428-8ef9-4093-abc1-d9df7d9d6bdd None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:45.769415 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1c428-8ef9-4093-abc1-d9df7d9d6bdd None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:45.769928 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1c428-8ef9-4093-abc1-d9df7d9d6bdd None admin] PATH_INFO: `/v3/groups/c35827b60ff544918b6872031644fbd1` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:45.772004 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f1c428-8ef9-4093-abc1-d9df7d9d6bdd None admin] RBAC: Authorizing `identity:get_group(group_id=c35827b60ff544918b6872031644fbd1)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:45.774777 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f1c428-8ef9-4093-abc1-d9df7d9d6bdd None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:45.777984 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 197/385] 10.222.0.26 () {56 vars in 1180 bytes} [Fri Jul 1 19:21:45 2022] GET /identity/v3/groups/c35827b60ff544918b6872031644fbd1 => generated 226 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:45.787135 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17243629-30ff-420e-89f1-2027a31665fb None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:45.825074 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65030052-8558-4b05-b678-5affb25ab367 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:45.825607 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65030052-8558-4b05-b678-5affb25ab367 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:45.826159 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65030052-8558-4b05-b678-5affb25ab367 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:45.829514 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 198/386] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:21:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:21:45.837229 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e1bc4-d421-4fb6-b6ad-1ed6a0cca55b None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:45.837659 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e1bc4-d421-4fb6-b6ad-1ed6a0cca55b None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:45.837883 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e1bc4-d421-4fb6-b6ad-1ed6a0cca55b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:45.843220 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:45.876648 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-f22e1bc4-d421-4fb6-b6ad-1ed6a0cca55b None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:21:45.878023 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-f22e1bc4-d421-4fb6-b6ad-1ed6a0cca55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:21:46.004562 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17243629-30ff-420e-89f1-2027a31665fb None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:46.055428 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 199/387] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:21:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:21:46.055921 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a1f8f-c6b6-4c5f-95f6-8b70bff8d405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:46.056890 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a1f8f-c6b6-4c5f-95f6-8b70bff8d405 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:46.057253 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a1f8f-c6b6-4c5f-95f6-8b70bff8d405 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:46.057589 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a1f8f-c6b6-4c5f-95f6-8b70bff8d405 None admin] PATH_INFO: `/v3/projects/9260fc0eba4449f190981e3ec5a011ad` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:46.058933 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18a1f8f-c6b6-4c5f-95f6-8b70bff8d405 None admin] RBAC: Authorizing `identity:get_project(project_id=9260fc0eba4449f190981e3ec5a011ad)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:46.060546 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18a1f8f-c6b6-4c5f-95f6-8b70bff8d405 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:46.062597 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 189/388] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Jul 1 19:21:45 2022] GET /identity/v3/projects/9260fc0eba4449f190981e3ec5a011ad => generated 298 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:46.068136 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22e1bc4-d421-4fb6-b6ad-1ed6a0cca55b None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:46.102168 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a1f8f-c6b6-4c5f-95f6-8b70bff8d405 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:46.137605 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:46.204257 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22e1bc4-d421-4fb6-b6ad-1ed6a0cca55b None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:46.234320 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:46.250278 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3bbfab-0378-4b81-8493-7654b1d7748f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:46.250598 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a1f8f-c6b6-4c5f-95f6-8b70bff8d405 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:46.251741 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3bbfab-0378-4b81-8493-7654b1d7748f None admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:46.252584 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3bbfab-0378-4b81-8493-7654b1d7748f None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:46.254100 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3bbfab-0378-4b81-8493-7654b1d7748f None admin] PATH_INFO: `/v3/projects/9260fc0eba4449f190981e3ec5a011ad/groups/c35827b60ff544918b6872031644fbd1/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:46.256550 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3bbfab-0378-4b81-8493-7654b1d7748f None admin] RBAC: Authorizing `identity:create_grant(project_id=9260fc0eba4449f190981e3ec5a011ad, group_id=c35827b60ff544918b6872031644fbd1, role_id=4cbf6ec846eb4b7c8cc52e9bfd6f076f)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:46.258314 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3bbfab-0378-4b81-8493-7654b1d7748f None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:46.285260 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 200/389] 10.222.0.26 () {58 vars in 1442 bytes} [Fri Jul 1 19:21:46 2022] PUT /identity/v3/projects/9260fc0eba4449f190981e3ec5a011ad/groups/c35827b60ff544918b6872031644fbd1/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 19:21:46.285260 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593acce-c6c9-43ac-a758-52af8c8ecb48 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:46.285260 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593acce-c6c9-43ac-a758-52af8c8ecb48 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:46.285260 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593acce-c6c9-43ac-a758-52af8c8ecb48 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:46.285260 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 201/390] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:21:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:21:46.292900 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e1f1f0-a1dc-4bba-860b-fa3c8b1e99ee None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:46.293264 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e1f1f0-a1dc-4bba-860b-fa3c8b1e99ee None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:46.294746 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e1f1f0-a1dc-4bba-860b-fa3c8b1e99ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:46.309428 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1e4baf-b0ac-4a08-9c7b-68e3a7098b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:46.310193 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e4baf-b0ac-4a08-9c7b-68e3a7098b76 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:46.310476 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e4baf-b0ac-4a08-9c7b-68e3a7098b76 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:46.310746 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e4baf-b0ac-4a08-9c7b-68e3a7098b76 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:46.336063 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-21e1f1f0-a1dc-4bba-860b-fa3c8b1e99ee None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:21:46.338757 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-21e1f1f0-a1dc-4bba-860b-fa3c8b1e99ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:21:46.346671 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1e4baf-b0ac-4a08-9c7b-68e3a7098b76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:21:46.365468 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-0d1e4baf-b0ac-4a08-9c7b-68e3a7098b76 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 01 19:21:46.365468 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:21:46.365468 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:21:46.365468 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:21:46.365468 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:21:46.365468 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:21:46.365468 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:21:46.365468 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:21:46.365468 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:21:46.365468 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:21:46.365468 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:21:46.365468 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:21:46.365468 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:21:46.365468 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:21:46.365468 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:21:46.365468 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:21:46.366428 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:21:46.366428 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:21:46.366428 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:21:46.366428 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:21:46.366428 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:21:46.366428 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:21:46.366428 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:21:46.366428 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:21:46.366428 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:21:46.366428 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:21:46.366428 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:21:46.366428 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:21:46.366428 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:21:46.366428 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:21:46.366428 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:21:46.366428 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:21:46.367251 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:21:46.367251 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:21:46.367251 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:21:46.367251 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:21:46.367251 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:21:46.367251 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:21:46.367251 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:21:46.367251 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:21:46.367251 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:21:46.367251 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:21:46.367251 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 01 19:21:46.367251 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:21:46.370308 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 190/391] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Jul 1 19:21:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:21:46.375112 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1e4baf-b0ac-4a08-9c7b-68e3a7098b76 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:46.475827 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 202/392] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:21:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 19:21:46.477170 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b65c7-dc52-4798-a4a3-6df0af766a38 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:46.477557 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b65c7-dc52-4798-a4a3-6df0af766a38 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:46.477837 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b65c7-dc52-4798-a4a3-6df0af766a38 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:46.479474 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 203/393] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:21:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:21:46.485373 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166df798-ec95-4600-a124-94e7f46c74ab None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:46.485712 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166df798-ec95-4600-a124-94e7f46c74ab None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:46.485996 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166df798-ec95-4600-a124-94e7f46c74ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:46.506376 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-166df798-ec95-4600-a124-94e7f46c74ab None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:21:46.507960 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-166df798-ec95-4600-a124-94e7f46c74ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:21:46.523052 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1e4baf-b0ac-4a08-9c7b-68e3a7098b76 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:46.550428 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:46.569349 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2262c347-83ac-41ce-b144-cb285a56e7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:46.570746 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262c347-83ac-41ce-b144-cb285a56e7db None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:46.571226 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262c347-83ac-41ce-b144-cb285a56e7db None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:46.572013 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262c347-83ac-41ce-b144-cb285a56e7db None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:46.573264 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2262c347-83ac-41ce-b144-cb285a56e7db None admin] RBAC: Adding query filter params (name=member) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:46.573773 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2262c347-83ac-41ce-b144-cb285a56e7db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:46.576082 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2262c347-83ac-41ce-b144-cb285a56e7db None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:46.588130 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 191/394] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Jul 1 19:21:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:46.593060 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2262c347-83ac-41ce-b144-cb285a56e7db None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:46.600591 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 204/395] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:21:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 19:21:46.601509 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166df798-ec95-4600-a124-94e7f46c74ab None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:46.619242 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:46.737977 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2262c347-83ac-41ce-b144-cb285a56e7db None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:46.761003 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166df798-ec95-4600-a124-94e7f46c74ab None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:46.774899 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c500525-79e5-42c5-9e66-9755aef6040f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:46.776078 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c500525-79e5-42c5-9e66-9755aef6040f None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:46.776078 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c500525-79e5-42c5-9e66-9755aef6040f None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:46.776350 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c500525-79e5-42c5-9e66-9755aef6040f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:46.787828 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c500525-79e5-42c5-9e66-9755aef6040f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:21:46.796651 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-8c500525-79e5-42c5-9e66-9755aef6040f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 19:21:46.796651 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:21:46.796651 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:21:46.796651 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:21:46.796651 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:21:46.796651 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:21:46.796651 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:21:46.796651 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:21:46.796651 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:21:46.796651 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:21:46.796651 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:21:46.796651 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:21:46.796651 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:21:46.796651 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:21:46.796651 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:21:46.796651 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:21:46.797703 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:21:46.797703 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:21:46.797703 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:21:46.797703 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:21:46.797703 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:21:46.797703 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:21:46.797703 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:21:46.797703 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:21:46.797703 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:21:46.797703 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:21:46.797703 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:21:46.797703 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:21:46.797703 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:21:46.797703 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:21:46.797703 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:21:46.797703 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:21:46.798582 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:21:46.798582 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:21:46.798582 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:21:46.798582 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:21:46.798582 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:21:46.798582 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:21:46.798582 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:21:46.798582 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:21:46.798582 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:21:46.798582 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:21:46.798582 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 19:21:46.798582 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:21:46.803009 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 192/396] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Jul 1 19:21:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:21:46.804160 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c500525-79e5-42c5-9e66-9755aef6040f None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:46.814951 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71caee86-469f-406f-bc2b-6385dddb8318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:46.817141 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71caee86-469f-406f-bc2b-6385dddb8318 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:46.817788 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71caee86-469f-406f-bc2b-6385dddb8318 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:46.818932 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71caee86-469f-406f-bc2b-6385dddb8318 None admin] PATH_INFO: `/v3/groups/c35827b60ff544918b6872031644fbd1` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:46.820913 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71caee86-469f-406f-bc2b-6385dddb8318 None admin] RBAC: Authorizing `identity:get_group(group_id=c35827b60ff544918b6872031644fbd1)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:46.825435 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71caee86-469f-406f-bc2b-6385dddb8318 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:46.828144 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 205/397] 10.222.0.26 () {56 vars in 1180 bytes} [Fri Jul 1 19:21:46 2022] GET /identity/v3/groups/c35827b60ff544918b6872031644fbd1 => generated 226 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:46.829132 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71caee86-469f-406f-bc2b-6385dddb8318 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:46.871715 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:46.891897 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:46.937346 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c500525-79e5-42c5-9e66-9755aef6040f None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:46.975118 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71caee86-469f-406f-bc2b-6385dddb8318 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:46.979853 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a140e12a-c6ae-46e0-936c-e10196118118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:46.980974 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a140e12a-c6ae-46e0-936c-e10196118118 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:46.981501 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a140e12a-c6ae-46e0-936c-e10196118118 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:46.981975 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a140e12a-c6ae-46e0-936c-e10196118118 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:46.997082 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a140e12a-c6ae-46e0-936c-e10196118118 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:21:47.005509 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-a140e12a-c6ae-46e0-936c-e10196118118 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 19:21:47.005509 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:21:47.005509 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:21:47.005509 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:21:47.005509 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:21:47.005509 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:21:47.005509 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:21:47.005509 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:21:47.005509 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:21:47.005509 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:21:47.005509 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:21:47.005509 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:21:47.005509 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:21:47.005509 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:21:47.005509 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:21:47.005509 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:21:47.006836 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:21:47.006836 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:21:47.006836 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:21:47.006836 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:21:47.006836 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:21:47.006836 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:21:47.006836 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:21:47.006836 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:21:47.006836 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:21:47.006836 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:21:47.006836 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:21:47.006836 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:21:47.006836 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:21:47.006836 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:21:47.006836 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:21:47.006836 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:21:47.007621 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:21:47.007621 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:21:47.007621 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:21:47.007621 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:21:47.007621 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:21:47.007621 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:21:47.007621 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:21:47.007621 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:21:47.007621 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:21:47.007621 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:21:47.007621 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 19:21:47.007621 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:21:47.007621 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 193/398] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Jul 1 19:21:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:21:47.007621 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a140e12a-c6ae-46e0-936c-e10196118118 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:47.022818 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbf92f6-917f-4429-861b-95ffeee0bef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:47.023698 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf92f6-917f-4429-861b-95ffeee0bef6 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:47.024217 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf92f6-917f-4429-861b-95ffeee0bef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:47.024741 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf92f6-917f-4429-861b-95ffeee0bef6 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:47.025698 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbf92f6-917f-4429-861b-95ffeee0bef6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:47.026217 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbf92f6-917f-4429-861b-95ffeee0bef6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:47.027709 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbf92f6-917f-4429-861b-95ffeee0bef6 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:47.037567 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 206/399] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Jul 1 19:21:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:47.038561 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbf92f6-917f-4429-861b-95ffeee0bef6 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:47.123278 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a140e12a-c6ae-46e0-936c-e10196118118 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:47.142925 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:47.154461 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:47.157821 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbf92f6-917f-4429-861b-95ffeee0bef6 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:47.161905 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbee04b-593c-4512-b36c-73e0743075e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:47.162664 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbee04b-593c-4512-b36c-73e0743075e5 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:47.163043 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbee04b-593c-4512-b36c-73e0743075e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:47.163413 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbee04b-593c-4512-b36c-73e0743075e5 None admin] PATH_INFO: `/v3/projects/b3f5af7a5da14e5c84bea28cc3aa5626` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:47.164715 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbee04b-593c-4512-b36c-73e0743075e5 None admin] RBAC: Authorizing `identity:get_project(project_id=b3f5af7a5da14e5c84bea28cc3aa5626)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:47.166284 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbee04b-593c-4512-b36c-73e0743075e5 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:47.168480 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 194/400] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Jul 1 19:21:47 2022] GET /identity/v3/projects/b3f5af7a5da14e5c84bea28cc3aa5626 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:47.169641 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbee04b-593c-4512-b36c-73e0743075e5 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:47.201480 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9936f84a-b0a4-48b4-be4f-3d92f1a4f31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:47.203481 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9936f84a-b0a4-48b4-be4f-3d92f1a4f31b None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:47.204090 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9936f84a-b0a4-48b4-be4f-3d92f1a4f31b None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:47.204540 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9936f84a-b0a4-48b4-be4f-3d92f1a4f31b None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:47.205483 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9936f84a-b0a4-48b4-be4f-3d92f1a4f31b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:47.205964 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9936f84a-b0a4-48b4-be4f-3d92f1a4f31b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:47.207706 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9936f84a-b0a4-48b4-be4f-3d92f1a4f31b None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:47.218656 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 207/401] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Jul 1 19:21:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:47.219849 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9936f84a-b0a4-48b4-be4f-3d92f1a4f31b None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:47.276889 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbee04b-593c-4512-b36c-73e0743075e5 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:47.314310 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b466fa-4d20-463b-810b-ea84b49ba8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:47.315156 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b466fa-4d20-463b-810b-ea84b49ba8d6 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:47.315438 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b466fa-4d20-463b-810b-ea84b49ba8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:47.315712 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b466fa-4d20-463b-810b-ea84b49ba8d6 None admin] PATH_INFO: `/v3/groups/c35827b60ff544918b6872031644fbd1` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:47.317173 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b466fa-4d20-463b-810b-ea84b49ba8d6 None admin] RBAC: Authorizing `identity:get_group(group_id=c35827b60ff544918b6872031644fbd1)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:47.318662 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b466fa-4d20-463b-810b-ea84b49ba8d6 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:47.324871 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 195/402] 10.222.0.26 () {56 vars in 1180 bytes} [Fri Jul 1 19:21:47 2022] GET /identity/v3/groups/c35827b60ff544918b6872031644fbd1 => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:47.324871 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b466fa-4d20-463b-810b-ea84b49ba8d6 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:47.339466 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9936f84a-b0a4-48b4-be4f-3d92f1a4f31b None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:47.383849 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e93e39-d86e-4cdf-b141-c567e5e81a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:47.385014 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e93e39-d86e-4cdf-b141-c567e5e81a8e None admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:47.385380 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e93e39-d86e-4cdf-b141-c567e5e81a8e None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:47.385650 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e93e39-d86e-4cdf-b141-c567e5e81a8e None admin] PATH_INFO: `/v3/projects/b3f5af7a5da14e5c84bea28cc3aa5626/groups/c35827b60ff544918b6872031644fbd1/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:47.388414 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e93e39-d86e-4cdf-b141-c567e5e81a8e None admin] RBAC: Authorizing `identity:create_grant(project_id=b3f5af7a5da14e5c84bea28cc3aa5626, group_id=c35827b60ff544918b6872031644fbd1, role_id=4cbf6ec846eb4b7c8cc52e9bfd6f076f)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:47.390697 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e93e39-d86e-4cdf-b141-c567e5e81a8e None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:47.398698 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:47.417861 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 208/403] 10.222.0.26 () {58 vars in 1442 bytes} [Fri Jul 1 19:21:47 2022] PUT /identity/v3/projects/b3f5af7a5da14e5c84bea28cc3aa5626/groups/c35827b60ff544918b6872031644fbd1/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:21:47.417861 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6667184-6053-4c44-9b39-3d5c0e2c82b2 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:47.417861 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6667184-6053-4c44-9b39-3d5c0e2c82b2 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:47.417861 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6667184-6053-4c44-9b39-3d5c0e2c82b2 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:47.417861 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 209/404] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:21:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:21:47.422622 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6667184-6053-4c44-9b39-3d5c0e2c82b2 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:47.446917 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b466fa-4d20-463b-810b-ea84b49ba8d6 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:47.448459 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:47.501052 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e739be94-c0b7-47f6-ab1f-584a997a27e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:47.501989 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e739be94-c0b7-47f6-ab1f-584a997a27e3 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:47.502273 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e739be94-c0b7-47f6-ab1f-584a997a27e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:47.502609 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e739be94-c0b7-47f6-ab1f-584a997a27e3 None admin] PATH_INFO: `/v3/groups/c35827b60ff544918b6872031644fbd1` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:47.504889 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e739be94-c0b7-47f6-ab1f-584a997a27e3 None admin] RBAC: Authorizing `identity:get_group(group_id=c35827b60ff544918b6872031644fbd1)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:47.507568 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e739be94-c0b7-47f6-ab1f-584a997a27e3 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:47.510172 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 196/405] 10.222.0.26 () {56 vars in 1180 bytes} [Fri Jul 1 19:21:47 2022] GET /identity/v3/groups/c35827b60ff544918b6872031644fbd1 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:47.512092 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a72a0-17f2-4f22-a85b-8e8293288f5a None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:47.512380 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a72a0-17f2-4f22-a85b-8e8293288f5a None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:47.512660 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a72a0-17f2-4f22-a85b-8e8293288f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:47.539305 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-610a72a0-17f2-4f22-a85b-8e8293288f5a None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:21:47.541260 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-610a72a0-17f2-4f22-a85b-8e8293288f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:21:47.602286 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6667184-6053-4c44-9b39-3d5c0e2c82b2 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:47.647608 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc94945b-ece6-47ff-bd69-6cae550eba71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:47.648471 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc94945b-ece6-47ff-bd69-6cae550eba71 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:47.648756 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc94945b-ece6-47ff-bd69-6cae550eba71 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:47.649051 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc94945b-ece6-47ff-bd69-6cae550eba71 None admin] PATH_INFO: `/v3/projects/9260fc0eba4449f190981e3ec5a011ad` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:47.650744 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 197/406] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:21:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:21:47.654682 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610a72a0-17f2-4f22-a85b-8e8293288f5a None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:47.657052 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc94945b-ece6-47ff-bd69-6cae550eba71 None admin] RBAC: Authorizing `identity:get_project(project_id=9260fc0eba4449f190981e3ec5a011ad)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:47.661270 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc94945b-ece6-47ff-bd69-6cae550eba71 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:47.661270 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 210/407] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Jul 1 19:21:47 2022] GET /identity/v3/projects/9260fc0eba4449f190981e3ec5a011ad => generated 298 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:47.666634 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc94945b-ece6-47ff-bd69-6cae550eba71 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:47.743792 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:47.764130 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:47.787119 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc94945b-ece6-47ff-bd69-6cae550eba71 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:47.802876 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610a72a0-17f2-4f22-a85b-8e8293288f5a None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:47.828982 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace8c17-c9da-4eaf-a2de-61c6357650ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:47.829887 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace8c17-c9da-4eaf-a2de-61c6357650ef None admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:47.830171 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace8c17-c9da-4eaf-a2de-61c6357650ef None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:47.830449 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace8c17-c9da-4eaf-a2de-61c6357650ef None admin] PATH_INFO: `/v3/projects/9260fc0eba4449f190981e3ec5a011ad/groups/c35827b60ff544918b6872031644fbd1/roles/dd71f7898e6a4d9f99d1554dd7d27033` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:47.834837 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ace8c17-c9da-4eaf-a2de-61c6357650ef None admin] RBAC: Authorizing `identity:create_grant(project_id=9260fc0eba4449f190981e3ec5a011ad, group_id=c35827b60ff544918b6872031644fbd1, role_id=dd71f7898e6a4d9f99d1554dd7d27033)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:47.837530 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ace8c17-c9da-4eaf-a2de-61c6357650ef None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:47.851724 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c51055-2d33-4c0d-aa13-c08807536b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:47.852749 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c51055-2d33-4c0d-aa13-c08807536b13 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:47.853325 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c51055-2d33-4c0d-aa13-c08807536b13 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:47.853458 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c51055-2d33-4c0d-aa13-c08807536b13 None admin] PATH_INFO: `/v3/projects/b3f5af7a5da14e5c84bea28cc3aa5626` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:47.854774 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c51055-2d33-4c0d-aa13-c08807536b13 None admin] RBAC: Authorizing `identity:get_project(project_id=b3f5af7a5da14e5c84bea28cc3aa5626)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:47.856652 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c51055-2d33-4c0d-aa13-c08807536b13 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:47.861511 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 211/409] 10.222.0.26 () {58 vars in 1442 bytes} [Fri Jul 1 19:21:47 2022] PUT /identity/v3/projects/9260fc0eba4449f190981e3ec5a011ad/groups/c35827b60ff544918b6872031644fbd1/roles/dd71f7898e6a4d9f99d1554dd7d27033 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 19:21:47.863039 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace8c17-c9da-4eaf-a2de-61c6357650ef None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:47.863615 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 198/409] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Jul 1 19:21:47 2022] GET /identity/v3/projects/b3f5af7a5da14e5c84bea28cc3aa5626 => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:47.865011 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c51055-2d33-4c0d-aa13-c08807536b13 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:47.981967 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c51055-2d33-4c0d-aa13-c08807536b13 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:48.011808 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace8c17-c9da-4eaf-a2de-61c6357650ef None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:48.017037 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:48.022985 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49402cb8-59e1-4ca8-aff3-7e4f20953a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:48.023960 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49402cb8-59e1-4ca8-aff3-7e4f20953a72 None admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:48.024316 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49402cb8-59e1-4ca8-aff3-7e4f20953a72 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:48.024666 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49402cb8-59e1-4ca8-aff3-7e4f20953a72 None admin] PATH_INFO: `/v3/projects/b3f5af7a5da14e5c84bea28cc3aa5626/groups/c35827b60ff544918b6872031644fbd1/roles/dd71f7898e6a4d9f99d1554dd7d27033` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:48.027142 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49402cb8-59e1-4ca8-aff3-7e4f20953a72 None admin] RBAC: Authorizing `identity:create_grant(project_id=b3f5af7a5da14e5c84bea28cc3aa5626, group_id=c35827b60ff544918b6872031644fbd1, role_id=dd71f7898e6a4d9f99d1554dd7d27033)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:48.028694 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49402cb8-59e1-4ca8-aff3-7e4f20953a72 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:48.053773 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 199/410] 10.222.0.26 () {58 vars in 1442 bytes} [Fri Jul 1 19:21:47 2022] PUT /identity/v3/projects/b3f5af7a5da14e5c84bea28cc3aa5626/groups/c35827b60ff544918b6872031644fbd1/roles/dd71f7898e6a4d9f99d1554dd7d27033 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:21:48.063886 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473e789-99b8-4b5f-87ba-2bc8c93d5bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:48.065091 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473e789-99b8-4b5f-87ba-2bc8c93d5bb8 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:48.065583 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473e789-99b8-4b5f-87ba-2bc8c93d5bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:48.066057 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473e789-99b8-4b5f-87ba-2bc8c93d5bb8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:48.076591 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:48.084516 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1473e789-99b8-4b5f-87ba-2bc8c93d5bb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:21:48.094241 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-1473e789-99b8-4b5f-87ba-2bc8c93d5bb8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:21:48.094241 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:21:48.094241 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:21:48.094241 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:21:48.094241 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:21:48.094241 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:21:48.094241 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:21:48.094241 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:21:48.094241 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:21:48.094241 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:21:48.094241 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:21:48.094241 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:21:48.094241 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:21:48.094241 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:21:48.094241 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:21:48.094241 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:21:48.095248 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:21:48.095248 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:21:48.095248 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:21:48.095248 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:21:48.095248 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:21:48.095248 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:21:48.095248 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:21:48.095248 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:21:48.095248 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:21:48.095248 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:21:48.095248 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:21:48.095248 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:21:48.095248 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:21:48.095248 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:21:48.095248 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:21:48.095248 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:21:48.096051 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:21:48.096051 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:21:48.096051 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:21:48.096051 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:21:48.096051 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:21:48.096051 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:21:48.096051 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:21:48.096051 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:21:48.096051 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:21:48.096051 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:21:48.096051 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:21:48.096051 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:21:48.098713 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 212/411] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Jul 1 19:21:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:21:48.105290 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49402cb8-59e1-4ca8-aff3-7e4f20953a72 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:48.250436 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49402cb8-59e1-4ca8-aff3-7e4f20953a72 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:48.289024 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6b681f-5656-452c-a838-d512ca3cbb28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:48.289729 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b681f-5656-452c-a838-d512ca3cbb28 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:48.290013 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b681f-5656-452c-a838-d512ca3cbb28 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:48.290288 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b681f-5656-452c-a838-d512ca3cbb28 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:48.291040 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6b681f-5656-452c-a838-d512ca3cbb28 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:48.291350 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6b681f-5656-452c-a838-d512ca3cbb28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:48.292798 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6b681f-5656-452c-a838-d512ca3cbb28 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:48.302181 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 200/412] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Jul 1 19:21:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:48.308350 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473e789-99b8-4b5f-87ba-2bc8c93d5bb8 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:48.419073 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473e789-99b8-4b5f-87ba-2bc8c93d5bb8 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:48.458785 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c6da86-044d-4575-9a77-a2459bcfb608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:48.460019 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c6da86-044d-4575-9a77-a2459bcfb608 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:48.460505 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c6da86-044d-4575-9a77-a2459bcfb608 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:48.461004 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c6da86-044d-4575-9a77-a2459bcfb608 None admin] PATH_INFO: `/v3/groups/ec7df40dd0a0438b8d0f5bbc5c2df889` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:48.462502 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c6da86-044d-4575-9a77-a2459bcfb608 None admin] RBAC: Authorizing `identity:get_group(group_id=ec7df40dd0a0438b8d0f5bbc5c2df889)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:48.464194 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c6da86-044d-4575-9a77-a2459bcfb608 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:48.466435 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 213/413] 10.222.0.26 () {56 vars in 1180 bytes} [Fri Jul 1 19:21:48 2022] GET /identity/v3/groups/ec7df40dd0a0438b8d0f5bbc5c2df889 => generated 229 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:21:48.472697 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6b681f-5656-452c-a838-d512ca3cbb28 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:48.567183 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:48.603070 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9867083-23e2-4ab8-b770-54f595f998ea None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:48.603713 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9867083-23e2-4ab8-b770-54f595f998ea None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:48.604192 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9867083-23e2-4ab8-b770-54f595f998ea None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:48.605896 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 214/414] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:21:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:21:48.612344 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c042307-17d5-46ff-9e9c-00dc1ab89bce None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:48.612899 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c042307-17d5-46ff-9e9c-00dc1ab89bce None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:48.613526 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c042307-17d5-46ff-9e9c-00dc1ab89bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:48.624746 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6b681f-5656-452c-a838-d512ca3cbb28 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:48.660129 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-7c042307-17d5-46ff-9e9c-00dc1ab89bce None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:21:48.661692 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-7c042307-17d5-46ff-9e9c-00dc1ab89bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:21:48.703172 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f416903d-fe04-40a9-b138-ec761253ce4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:48.704028 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f416903d-fe04-40a9-b138-ec761253ce4a None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:48.704311 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f416903d-fe04-40a9-b138-ec761253ce4a None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:48.704587 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f416903d-fe04-40a9-b138-ec761253ce4a None admin] PATH_INFO: `/v3/projects/82f5068f09304c36812a397a31aad7a3` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:48.705822 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f416903d-fe04-40a9-b138-ec761253ce4a None admin] RBAC: Authorizing `identity:get_project(project_id=82f5068f09304c36812a397a31aad7a3)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:48.707271 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f416903d-fe04-40a9-b138-ec761253ce4a None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:48.719218 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 201/415] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Jul 1 19:21:48 2022] GET /identity/v3/projects/82f5068f09304c36812a397a31aad7a3 => generated 344 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:48.728733 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f416903d-fe04-40a9-b138-ec761253ce4a None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:48.738071 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:48.751392 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 215/416] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:21:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:21:48.793728 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c042307-17d5-46ff-9e9c-00dc1ab89bce None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:48.847233 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f416903d-fe04-40a9-b138-ec761253ce4a None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:48.884035 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:48.891123 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef8737f-7817-43dd-9bd8-03bd3d857385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:48.892225 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8737f-7817-43dd-9bd8-03bd3d857385 None admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:48.892765 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8737f-7817-43dd-9bd8-03bd3d857385 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:48.893183 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8737f-7817-43dd-9bd8-03bd3d857385 None admin] PATH_INFO: `/v3/projects/82f5068f09304c36812a397a31aad7a3/groups/ec7df40dd0a0438b8d0f5bbc5c2df889/roles/6cb03785fb184ef587509b3174622f69` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:48.900946 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef8737f-7817-43dd-9bd8-03bd3d857385 None admin] RBAC: Authorizing `identity:create_grant(project_id=82f5068f09304c36812a397a31aad7a3, group_id=ec7df40dd0a0438b8d0f5bbc5c2df889, role_id=6cb03785fb184ef587509b3174622f69)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:48.902724 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef8737f-7817-43dd-9bd8-03bd3d857385 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:48.927871 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 202/417] 10.222.0.26 () {58 vars in 1442 bytes} [Fri Jul 1 19:21:48 2022] PUT /identity/v3/projects/82f5068f09304c36812a397a31aad7a3/groups/ec7df40dd0a0438b8d0f5bbc5c2df889/roles/6cb03785fb184ef587509b3174622f69 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:21:48.940165 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c042307-17d5-46ff-9e9c-00dc1ab89bce None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:48.981993 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2808077-f568-4222-ba05-5721ba7bae0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:48.982871 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2808077-f568-4222-ba05-5721ba7bae0f None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:48.983161 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2808077-f568-4222-ba05-5721ba7bae0f None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:48.983442 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2808077-f568-4222-ba05-5721ba7bae0f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:48.995479 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2808077-f568-4222-ba05-5721ba7bae0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:21:49.003464 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-a2808077-f568-4222-ba05-5721ba7bae0f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 01 19:21:49.003464 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:21:49.003464 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:21:49.003464 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:21:49.003464 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:21:49.003464 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:21:49.003464 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:21:49.003464 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:21:49.003464 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:21:49.003464 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:21:49.003464 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:21:49.003464 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:21:49.003464 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:21:49.003464 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:21:49.003464 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:21:49.003464 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:21:49.004484 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:21:49.004484 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:21:49.004484 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:21:49.004484 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:21:49.004484 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:21:49.004484 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:21:49.004484 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:21:49.004484 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:21:49.004484 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:21:49.004484 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:21:49.004484 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:21:49.004484 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:21:49.004484 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:21:49.004484 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:21:49.004484 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:21:49.004484 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:21:49.005498 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:21:49.005498 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:21:49.005498 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:21:49.005498 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:21:49.005498 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:21:49.005498 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:21:49.005498 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:21:49.005498 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:21:49.005498 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:21:49.005498 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:21:49.005498 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 01 19:21:49.005498 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:21:49.005498 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 216/418] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Jul 1 19:21:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:21:49.011157 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef8737f-7817-43dd-9bd8-03bd3d857385 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:49.137956 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef8737f-7817-43dd-9bd8-03bd3d857385 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:49.179661 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4805718-399c-481c-983b-886c67b46500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:49.180362 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4805718-399c-481c-983b-886c67b46500 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:49.180651 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4805718-399c-481c-983b-886c67b46500 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:49.180935 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4805718-399c-481c-983b-886c67b46500 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:49.181745 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4805718-399c-481c-983b-886c67b46500 None admin] RBAC: Adding query filter params (name=member) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:49.182060 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4805718-399c-481c-983b-886c67b46500 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:49.183451 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4805718-399c-481c-983b-886c67b46500 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:49.192889 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 203/419] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Jul 1 19:21:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:49.198509 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2808077-f568-4222-ba05-5721ba7bae0f None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:49.280632 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:49.335596 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2808077-f568-4222-ba05-5721ba7bae0f None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:49.385415 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c65263e-f8aa-4c4d-8c90-f33d0eca9afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:49.386232 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c65263e-f8aa-4c4d-8c90-f33d0eca9afc None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:49.386596 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c65263e-f8aa-4c4d-8c90-f33d0eca9afc None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:49.386912 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c65263e-f8aa-4c4d-8c90-f33d0eca9afc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:49.485367 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c65263e-f8aa-4c4d-8c90-f33d0eca9afc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:49.487159 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c65263e-f8aa-4c4d-8c90-f33d0eca9afc None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:49.571147 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:49.628023 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 217/420] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Jul 1 19:21:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 19:21:49.633403 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4805718-399c-481c-983b-886c67b46500 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:49.753330 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:49.829228 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4805718-399c-481c-983b-886c67b46500 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:49.877859 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2652d126-2e8d-4854-99fe-06f4c25769d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:49.878780 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652d126-2e8d-4854-99fe-06f4c25769d6 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:49.879067 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652d126-2e8d-4854-99fe-06f4c25769d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:49.879343 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652d126-2e8d-4854-99fe-06f4c25769d6 None admin] PATH_INFO: `/v3/projects/9260fc0eba4449f190981e3ec5a011ad` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:49.880540 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2652d126-2e8d-4854-99fe-06f4c25769d6 None admin] RBAC: Authorizing `identity:get_project(project_id=9260fc0eba4449f190981e3ec5a011ad)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:49.882019 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2652d126-2e8d-4854-99fe-06f4c25769d6 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:49.883887 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 204/421] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Jul 1 19:21:49 2022] GET /identity/v3/projects/9260fc0eba4449f190981e3ec5a011ad => generated 298 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:49.889823 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c65263e-f8aa-4c4d-8c90-f33d0eca9afc None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:50.056092 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c65263e-f8aa-4c4d-8c90-f33d0eca9afc None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:50.091682 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc10e2c-0f1a-4994-80b9-85a9af294ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:50.093462 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc10e2c-0f1a-4994-80b9-85a9af294ecc None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:50.093952 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc10e2c-0f1a-4994-80b9-85a9af294ecc None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:50.094429 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc10e2c-0f1a-4994-80b9-85a9af294ecc None admin] PATH_INFO: `/v3/groups/c35827b60ff544918b6872031644fbd1` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:50.095822 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc10e2c-0f1a-4994-80b9-85a9af294ecc None admin] RBAC: Authorizing `identity:get_group(group_id=c35827b60ff544918b6872031644fbd1)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:50.097520 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc10e2c-0f1a-4994-80b9-85a9af294ecc None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:50.099711 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 218/422] 10.222.0.26 () {56 vars in 1180 bytes} [Fri Jul 1 19:21:49 2022] GET /identity/v3/groups/c35827b60ff544918b6872031644fbd1 => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:50.105104 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2652d126-2e8d-4854-99fe-06f4c25769d6 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:50.188970 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1319aa-abbb-48f7-b192-8695b3b53da4 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:50.189654 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1319aa-abbb-48f7-b192-8695b3b53da4 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:50.190009 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1319aa-abbb-48f7-b192-8695b3b53da4 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:50.191806 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 219/423] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:21:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 19:21:50.197564 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676cadfa-f594-45f1-8ed6-226766a6c187 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:50.197933 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676cadfa-f594-45f1-8ed6-226766a6c187 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:50.198291 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676cadfa-f594-45f1-8ed6-226766a6c187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:50.234944 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-676cadfa-f594-45f1-8ed6-226766a6c187 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:21:50.236536 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-676cadfa-f594-45f1-8ed6-226766a6c187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:21:50.269887 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:50.275759 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2652d126-2e8d-4854-99fe-06f4c25769d6 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:50.290050 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:50.323936 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4275ff2e-6356-4a1a-8896-38d466edb3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:50.324522 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4275ff2e-6356-4a1a-8896-38d466edb3ed None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:50.324813 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4275ff2e-6356-4a1a-8896-38d466edb3ed None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:50.325097 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4275ff2e-6356-4a1a-8896-38d466edb3ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:50.325965 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4275ff2e-6356-4a1a-8896-38d466edb3ed None admin] RBAC: Adding query filter params (group.id=c35827b60ff544918b6872031644fbd1, role.id=4cbf6ec846eb4b7c8cc52e9bfd6f076f, scope.project.id=9260fc0eba4449f190981e3ec5a011ad) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:50.326279 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4275ff2e-6356-4a1a-8896-38d466edb3ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:50.328450 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4275ff2e-6356-4a1a-8896-38d466edb3ed None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:50.335287 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 205/424] 10.222.0.26 () {56 vars in 1376 bytes} [Fri Jul 1 19:21:50 2022] GET /identity/v3/role_assignments?group.id=c35827b60ff544918b6872031644fbd1&scope.project.id=9260fc0eba4449f190981e3ec5a011ad&role.id=4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 611 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:50.343613 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 220/425] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:21:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 19:21:50.399171 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4275ff2e-6356-4a1a-8896-38d466edb3ed None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:50.522584 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4275ff2e-6356-4a1a-8896-38d466edb3ed None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:50.543006 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af122a94-5a39-488d-bba0-23aa8d27de95 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:50.543746 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af122a94-5a39-488d-bba0-23aa8d27de95 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:50.544307 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af122a94-5a39-488d-bba0-23aa8d27de95 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:50.547479 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 221/426] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:21:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:21:50.554718 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2be1c6-87ee-44df-93df-6b92464c7889 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:50.555449 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2be1c6-87ee-44df-93df-6b92464c7889 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:50.556042 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2be1c6-87ee-44df-93df-6b92464c7889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:50.563385 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d488b2-9783-41dd-903f-ba0d798945f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:50.564202 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d488b2-9783-41dd-903f-ba0d798945f9 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:50.564497 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d488b2-9783-41dd-903f-ba0d798945f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:50.564772 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d488b2-9783-41dd-903f-ba0d798945f9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:50.576359 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d488b2-9783-41dd-903f-ba0d798945f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:21:50.579773 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-1c2be1c6-87ee-44df-93df-6b92464c7889 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:21:50.581411 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-1c2be1c6-87ee-44df-93df-6b92464c7889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:21:50.584265 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-64d488b2-9783-41dd-903f-ba0d798945f9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 01 19:21:50.584265 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:21:50.584265 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:21:50.584265 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:21:50.584265 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:21:50.584265 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:21:50.584265 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:21:50.584265 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:21:50.584265 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:21:50.584265 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:21:50.584265 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:21:50.584265 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:21:50.584265 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:21:50.584265 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:21:50.584265 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:21:50.584265 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:21:50.585480 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:21:50.585480 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:21:50.585480 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:21:50.585480 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:21:50.585480 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:21:50.585480 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:21:50.585480 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:21:50.585480 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:21:50.585480 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:21:50.585480 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:21:50.585480 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:21:50.585480 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:21:50.585480 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:21:50.585480 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:21:50.585480 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:21:50.585480 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:21:50.586510 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:21:50.586510 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:21:50.586510 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:21:50.586510 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:21:50.586510 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:21:50.586510 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:21:50.586510 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:21:50.586510 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:21:50.586510 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:21:50.586510 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:21:50.586510 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 01 19:21:50.586510 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:21:50.586510 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 206/427] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Jul 1 19:21:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:21:50.593295 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d488b2-9783-41dd-903f-ba0d798945f9 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:50.645341 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:50.704848 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 222/428] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:21:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 19:21:50.734386 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2be1c6-87ee-44df-93df-6b92464c7889 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:50.738809 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d488b2-9783-41dd-903f-ba0d798945f9 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:50.774048 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca9835-5e57-44c4-87d3-3f7ff4f03969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:50.774857 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca9835-5e57-44c4-87d3-3f7ff4f03969 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:50.775209 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca9835-5e57-44c4-87d3-3f7ff4f03969 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:50.775570 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca9835-5e57-44c4-87d3-3f7ff4f03969 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:50.776379 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eca9835-5e57-44c4-87d3-3f7ff4f03969 None admin] RBAC: Adding query filter params (name=member) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:50.776758 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eca9835-5e57-44c4-87d3-3f7ff4f03969 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:50.779085 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eca9835-5e57-44c4-87d3-3f7ff4f03969 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:50.788924 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 207/429] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Jul 1 19:21:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:21:50.793347 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca9835-5e57-44c4-87d3-3f7ff4f03969 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:50.855209 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:50.869616 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2be1c6-87ee-44df-93df-6b92464c7889 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:50.906609 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:50.908145 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e3ff8c-02bf-4ff5-9a4f-26e164d9910a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:50.909034 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e3ff8c-02bf-4ff5-9a4f-26e164d9910a None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:50.909375 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e3ff8c-02bf-4ff5-9a4f-26e164d9910a None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:50.909749 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e3ff8c-02bf-4ff5-9a4f-26e164d9910a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:50.911666 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca9835-5e57-44c4-87d3-3f7ff4f03969 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:50.925876 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e3ff8c-02bf-4ff5-9a4f-26e164d9910a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:21:50.934901 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-c5e3ff8c-02bf-4ff5-9a4f-26e164d9910a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 19:21:50.934901 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:21:50.934901 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:21:50.934901 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:21:50.934901 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:21:50.934901 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:21:50.934901 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:21:50.934901 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:21:50.934901 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:21:50.934901 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:21:50.934901 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:21:50.934901 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:21:50.934901 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:21:50.934901 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:21:50.934901 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:21:50.934901 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:21:50.936063 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:21:50.936063 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:21:50.936063 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:21:50.936063 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:21:50.936063 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:21:50.936063 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:21:50.936063 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:21:50.936063 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:21:50.936063 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:21:50.936063 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:21:50.936063 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:21:50.936063 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:21:50.936063 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:21:50.936063 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:21:50.936063 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:21:50.936063 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:21:50.937158 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:21:50.937158 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:21:50.937158 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:21:50.937158 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:21:50.937158 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:21:50.937158 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:21:50.937158 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:21:50.937158 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:21:50.937158 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:21:50.937158 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:21:50.937158 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 19:21:50.937158 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:21:50.938792 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 223/430] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Jul 1 19:21:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:21:50.940298 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c761ca2-b8bb-4830-a040-86797be3e045 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:50.940615 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c761ca2-b8bb-4830-a040-86797be3e045 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:50.940903 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c761ca2-b8bb-4830-a040-86797be3e045 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:50.946397 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 224/431] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:21:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:21:50.948743 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee668e8-f25e-4c59-b006-026023e28907 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:50.949111 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee668e8-f25e-4c59-b006-026023e28907 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:50.949511 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee668e8-f25e-4c59-b006-026023e28907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:50.964408 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfbcb46-9efd-4e5b-ad1c-45ad0cb60011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:50.965420 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfbcb46-9efd-4e5b-ad1c-45ad0cb60011 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:50.965860 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfbcb46-9efd-4e5b-ad1c-45ad0cb60011 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:50.966234 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfbcb46-9efd-4e5b-ad1c-45ad0cb60011 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:50.968880 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-4ee668e8-f25e-4c59-b006-026023e28907 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:21:50.970135 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-4ee668e8-f25e-4c59-b006-026023e28907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:21:51.055579 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 225/432] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:21:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 19:21:51.056459 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee668e8-f25e-4c59-b006-026023e28907 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:51.064287 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfbcb46-9efd-4e5b-ad1c-45ad0cb60011 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:51.066674 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfbcb46-9efd-4e5b-ad1c-45ad0cb60011 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:51.153712 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:51.180005 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee668e8-f25e-4c59-b006-026023e28907 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:51.197039 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:51.208306 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 208/433] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Jul 1 19:21:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 01 19:21:51.209495 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfbcb46-9efd-4e5b-ad1c-45ad0cb60011 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:51.216911 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c5a1b-ae15-4e13-9c54-453b1dfafb16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:51.218230 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c5a1b-ae15-4e13-9c54-453b1dfafb16 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:51.218443 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c5a1b-ae15-4e13-9c54-453b1dfafb16 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:51.218725 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c5a1b-ae15-4e13-9c54-453b1dfafb16 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:51.219478 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7c5a1b-ae15-4e13-9c54-453b1dfafb16 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:51.219786 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7c5a1b-ae15-4e13-9c54-453b1dfafb16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:51.221176 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7c5a1b-ae15-4e13-9c54-453b1dfafb16 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:51.233985 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 226/434] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Jul 1 19:21:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:51.233985 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c5a1b-ae15-4e13-9c54-453b1dfafb16 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:51.333645 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfbcb46-9efd-4e5b-ad1c-45ad0cb60011 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:51.338108 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c5a1b-ae15-4e13-9c54-453b1dfafb16 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:51.387339 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41664e2b-2698-4e06-8b2e-ad9c602f392c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:51.388223 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41664e2b-2698-4e06-8b2e-ad9c602f392c None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:51.388569 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41664e2b-2698-4e06-8b2e-ad9c602f392c None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:51.388910 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41664e2b-2698-4e06-8b2e-ad9c602f392c None admin] PATH_INFO: `/v3/projects/b3f5af7a5da14e5c84bea28cc3aa5626` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:51.390859 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41664e2b-2698-4e06-8b2e-ad9c602f392c None admin] RBAC: Authorizing `identity:get_project(project_id=b3f5af7a5da14e5c84bea28cc3aa5626)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:51.393070 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41664e2b-2698-4e06-8b2e-ad9c602f392c None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:51.394364 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf74a5d-569d-4fed-a2ca-504f1afcb87b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:51.400511 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 227/435] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Jul 1 19:21:51 2022] GET /identity/v3/projects/b3f5af7a5da14e5c84bea28cc3aa5626 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:51.400511 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41664e2b-2698-4e06-8b2e-ad9c602f392c None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:51.400707 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf74a5d-569d-4fed-a2ca-504f1afcb87b None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:51.400707 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf74a5d-569d-4fed-a2ca-504f1afcb87b None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:51.400707 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf74a5d-569d-4fed-a2ca-504f1afcb87b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:51.413996 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:51.418930 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf74a5d-569d-4fed-a2ca-504f1afcb87b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:21:51.435149 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-ccf74a5d-569d-4fed-a2ca-504f1afcb87b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 19:21:51.435149 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:21:51.435149 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:21:51.435149 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:21:51.435149 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:21:51.435149 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:21:51.435149 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:21:51.435149 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:21:51.435149 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:21:51.435149 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:21:51.435149 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:21:51.435149 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:21:51.435149 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:21:51.435149 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:21:51.435149 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:21:51.435149 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:21:51.437695 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:21:51.437695 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:21:51.437695 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:21:51.437695 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:21:51.437695 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:21:51.437695 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:21:51.437695 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:21:51.437695 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:21:51.437695 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:21:51.437695 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:21:51.437695 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:21:51.437695 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:21:51.437695 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:21:51.437695 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:21:51.437695 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:21:51.437695 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:21:51.439549 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:21:51.439549 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:21:51.439549 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:21:51.439549 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:21:51.439549 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:21:51.439549 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:21:51.439549 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:21:51.439549 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:21:51.439549 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:21:51.439549 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:21:51.439549 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 19:21:51.439549 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:21:51.445362 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 209/436] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Jul 1 19:21:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:21:51.446793 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf74a5d-569d-4fed-a2ca-504f1afcb87b None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:51.527676 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:51.547992 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41664e2b-2698-4e06-8b2e-ad9c602f392c None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:51.581095 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf74a5d-569d-4fed-a2ca-504f1afcb87b None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:51.593699 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d191ea18-14c0-4e2e-a741-bd462ff73274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:51.594350 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d191ea18-14c0-4e2e-a741-bd462ff73274 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:51.594959 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d191ea18-14c0-4e2e-a741-bd462ff73274 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:51.595235 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d191ea18-14c0-4e2e-a741-bd462ff73274 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:51.631088 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27678693-1641-402c-b11e-5e73291173b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:51.632446 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27678693-1641-402c-b11e-5e73291173b7 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:51.632887 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27678693-1641-402c-b11e-5e73291173b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:51.633662 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27678693-1641-402c-b11e-5e73291173b7 None admin] PATH_INFO: `/v3/groups/c35827b60ff544918b6872031644fbd1` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:51.635071 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27678693-1641-402c-b11e-5e73291173b7 None admin] RBAC: Authorizing `identity:get_group(group_id=c35827b60ff544918b6872031644fbd1)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:51.636569 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27678693-1641-402c-b11e-5e73291173b7 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:51.638607 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 210/437] 10.222.0.26 () {56 vars in 1180 bytes} [Fri Jul 1 19:21:51 2022] GET /identity/v3/groups/c35827b60ff544918b6872031644fbd1 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:51.640042 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27678693-1641-402c-b11e-5e73291173b7 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:51.691107 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d191ea18-14c0-4e2e-a741-bd462ff73274 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:51.692484 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d191ea18-14c0-4e2e-a741-bd462ff73274 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:51.700876 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:51.762779 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27678693-1641-402c-b11e-5e73291173b7 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:51.788708 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:51.798412 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa15fe9-fe97-4541-bc3a-a0764b7a4430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:51.799087 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa15fe9-fe97-4541-bc3a-a0764b7a4430 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:51.799371 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa15fe9-fe97-4541-bc3a-a0764b7a4430 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:51.799656 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa15fe9-fe97-4541-bc3a-a0764b7a4430 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:51.800404 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa15fe9-fe97-4541-bc3a-a0764b7a4430 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:51.800715 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa15fe9-fe97-4541-bc3a-a0764b7a4430 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:51.802140 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa15fe9-fe97-4541-bc3a-a0764b7a4430 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:51.805533 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 228/438] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Jul 1 19:21:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 19:21:51.806896 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5657e43-0c0f-4397-bad4-c03adc0a8070 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:51.807179 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5657e43-0c0f-4397-bad4-c03adc0a8070 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:51.807448 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5657e43-0c0f-4397-bad4-c03adc0a8070 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:51.808712 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 229/439] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:21:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:21:51.809424 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5657e43-0c0f-4397-bad4-c03adc0a8070 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:51.815927 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 211/440] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Jul 1 19:21:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:51.816973 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa15fe9-fe97-4541-bc3a-a0764b7a4430 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:51.931090 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5657e43-0c0f-4397-bad4-c03adc0a8070 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:51.937722 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa15fe9-fe97-4541-bc3a-a0764b7a4430 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:51.939737 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:51.968476 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d119dc2-7258-4239-9028-da697c8a1224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:51.969017 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d119dc2-7258-4239-9028-da697c8a1224 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:51.969347 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d119dc2-7258-4239-9028-da697c8a1224 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:51.969632 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d119dc2-7258-4239-9028-da697c8a1224 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:51.970474 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d119dc2-7258-4239-9028-da697c8a1224 None admin] RBAC: Adding query filter params (group.id=c35827b60ff544918b6872031644fbd1, role.id=4cbf6ec846eb4b7c8cc52e9bfd6f076f, scope.project.id=b3f5af7a5da14e5c84bea28cc3aa5626) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:51.970791 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d119dc2-7258-4239-9028-da697c8a1224 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:51.972254 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d119dc2-7258-4239-9028-da697c8a1224 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:51.977336 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9270c4-1ae8-486f-baea-88a94ce039d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:51.978276 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 230/441] 10.222.0.26 () {56 vars in 1376 bytes} [Fri Jul 1 19:21:51 2022] GET /identity/v3/role_assignments?group.id=c35827b60ff544918b6872031644fbd1&scope.project.id=b3f5af7a5da14e5c84bea28cc3aa5626&role.id=4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 611 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:51.978409 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9270c4-1ae8-486f-baea-88a94ce039d6 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:51.978820 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9270c4-1ae8-486f-baea-88a94ce039d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:51.979289 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9270c4-1ae8-486f-baea-88a94ce039d6 None admin] PATH_INFO: `/v3/projects/9260fc0eba4449f190981e3ec5a011ad` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:51.979470 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e333956-7936-4a8c-bcc1-861ac1a7510f None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:51.979757 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e333956-7936-4a8c-bcc1-861ac1a7510f None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:51.980175 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e333956-7936-4a8c-bcc1-861ac1a7510f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:51.981407 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9270c4-1ae8-486f-baea-88a94ce039d6 None admin] RBAC: Authorizing `identity:get_project(project_id=9260fc0eba4449f190981e3ec5a011ad)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:51.984469 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9270c4-1ae8-486f-baea-88a94ce039d6 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:51.991800 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 212/442] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Jul 1 19:21:51 2022] GET /identity/v3/projects/9260fc0eba4449f190981e3ec5a011ad => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:51.991800 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9270c4-1ae8-486f-baea-88a94ce039d6 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:51.999834 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-8e333956-7936-4a8c-bcc1-861ac1a7510f None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:21:52.001084 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-8e333956-7936-4a8c-bcc1-861ac1a7510f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:21:52.081766 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:52.095347 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 231/443] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:21:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:21:52.096832 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e333956-7936-4a8c-bcc1-861ac1a7510f None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:52.160494 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9270c4-1ae8-486f-baea-88a94ce039d6 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:52.209507 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fdfca8-6cae-4705-99b1-5050a20e63f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:52.210639 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fdfca8-6cae-4705-99b1-5050a20e63f4 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:52.210639 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fdfca8-6cae-4705-99b1-5050a20e63f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:52.210934 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fdfca8-6cae-4705-99b1-5050a20e63f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:52.229378 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:52.234897 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e333956-7936-4a8c-bcc1-861ac1a7510f None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:52.275255 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36061e4-9d3d-432f-bfc6-14999ddb4cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:52.276404 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36061e4-9d3d-432f-bfc6-14999ddb4cdd None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:52.276855 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36061e4-9d3d-432f-bfc6-14999ddb4cdd None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:52.277149 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36061e4-9d3d-432f-bfc6-14999ddb4cdd None admin] PATH_INFO: `/v3/groups/c35827b60ff544918b6872031644fbd1` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:52.278380 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36061e4-9d3d-432f-bfc6-14999ddb4cdd None admin] RBAC: Authorizing `identity:get_group(group_id=c35827b60ff544918b6872031644fbd1)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:52.280338 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36061e4-9d3d-432f-bfc6-14999ddb4cdd None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:52.281987 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 232/444] 10.222.0.26 () {56 vars in 1180 bytes} [Fri Jul 1 19:21:52 2022] GET /identity/v3/groups/c35827b60ff544918b6872031644fbd1 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:52.282771 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36061e4-9d3d-432f-bfc6-14999ddb4cdd None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:52.292361 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fdfca8-6cae-4705-99b1-5050a20e63f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:52.293870 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fdfca8-6cae-4705-99b1-5050a20e63f4 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:52.359369 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:52.397141 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36061e4-9d3d-432f-bfc6-14999ddb4cdd None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:52.405262 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 213/445] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Jul 1 19:21:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 19:21:52.406105 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fdfca8-6cae-4705-99b1-5050a20e63f4 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:52.438022 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5554658d-03f2-4155-8edc-d4245af4f46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:52.438816 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5554658d-03f2-4155-8edc-d4245af4f46c None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:52.439133 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5554658d-03f2-4155-8edc-d4245af4f46c None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:52.439356 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5554658d-03f2-4155-8edc-d4245af4f46c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:52.449895 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5554658d-03f2-4155-8edc-d4245af4f46c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:21:52.464098 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-5554658d-03f2-4155-8edc-d4245af4f46c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:21:52.464098 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:21:52.464098 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:21:52.464098 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:21:52.464098 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:21:52.464098 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:21:52.464098 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:21:52.464098 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:21:52.464098 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:21:52.464098 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:21:52.464098 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:21:52.464098 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:21:52.464098 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:21:52.464098 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:21:52.464098 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:21:52.464098 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:21:52.465187 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:21:52.465187 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:21:52.465187 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:21:52.465187 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:21:52.465187 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:21:52.465187 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:21:52.465187 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:21:52.465187 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:21:52.465187 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:21:52.465187 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:21:52.465187 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:21:52.465187 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:21:52.465187 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:21:52.465187 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:21:52.465187 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:21:52.465187 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:21:52.466034 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:21:52.466034 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:21:52.466034 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:21:52.466034 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:21:52.466034 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:21:52.466034 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:21:52.466034 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:21:52.466034 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:21:52.466034 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:21:52.466034 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:21:52.466034 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:21:52.466034 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:21:52.466034 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 233/446] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Jul 1 19:21:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:21:52.467642 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5554658d-03f2-4155-8edc-d4245af4f46c None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:52.510277 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:52.530871 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fdfca8-6cae-4705-99b1-5050a20e63f4 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:52.567449 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd8ab3-feb9-4b66-9127-a4986e78320c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:52.568107 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd8ab3-feb9-4b66-9127-a4986e78320c None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:52.568397 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd8ab3-feb9-4b66-9127-a4986e78320c None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:52.568671 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd8ab3-feb9-4b66-9127-a4986e78320c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:52.569540 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cd8ab3-feb9-4b66-9127-a4986e78320c None admin] RBAC: Adding query filter params (group.id=c35827b60ff544918b6872031644fbd1, role.id=dd71f7898e6a4d9f99d1554dd7d27033, scope.project.id=9260fc0eba4449f190981e3ec5a011ad) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:52.569851 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cd8ab3-feb9-4b66-9127-a4986e78320c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:52.571304 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cd8ab3-feb9-4b66-9127-a4986e78320c None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:52.577920 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 214/447] 10.222.0.26 () {56 vars in 1376 bytes} [Fri Jul 1 19:21:52 2022] GET /identity/v3/role_assignments?group.id=c35827b60ff544918b6872031644fbd1&scope.project.id=9260fc0eba4449f190981e3ec5a011ad&role.id=dd71f7898e6a4d9f99d1554dd7d27033 => generated 611 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:52.578911 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd8ab3-feb9-4b66-9127-a4986e78320c None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:52.605160 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5554658d-03f2-4155-8edc-d4245af4f46c None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:52.605403 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:52.656082 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af9fbd-3106-4ba6-8bdb-f31cad75a369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:52.657420 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af9fbd-3106-4ba6-8bdb-f31cad75a369 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:52.657986 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af9fbd-3106-4ba6-8bdb-f31cad75a369 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:52.658274 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af9fbd-3106-4ba6-8bdb-f31cad75a369 None admin] PATH_INFO: `/v3/projects/b3f5af7a5da14e5c84bea28cc3aa5626` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:52.660099 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5af9fbd-3106-4ba6-8bdb-f31cad75a369 None admin] RBAC: Authorizing `identity:get_project(project_id=b3f5af7a5da14e5c84bea28cc3aa5626)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:52.662259 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5af9fbd-3106-4ba6-8bdb-f31cad75a369 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:52.668776 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 234/448] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Jul 1 19:21:52 2022] GET /identity/v3/projects/b3f5af7a5da14e5c84bea28cc3aa5626 => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:52.670358 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af9fbd-3106-4ba6-8bdb-f31cad75a369 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:52.720662 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd8ab3-feb9-4b66-9127-a4986e78320c None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:52.763056 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ea25aa-a4f4-4bad-928d-28c40412334a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:52.763632 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea25aa-a4f4-4bad-928d-28c40412334a None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:52.764443 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea25aa-a4f4-4bad-928d-28c40412334a None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:52.764727 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea25aa-a4f4-4bad-928d-28c40412334a None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:52.765551 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ea25aa-a4f4-4bad-928d-28c40412334a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:52.765865 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ea25aa-a4f4-4bad-928d-28c40412334a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:52.767277 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ea25aa-a4f4-4bad-928d-28c40412334a None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:52.776282 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 215/449] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Jul 1 19:21:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:52.783786 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ea25aa-a4f4-4bad-928d-28c40412334a None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:52.828894 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:52.836432 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af9fbd-3106-4ba6-8bdb-f31cad75a369 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:52.881006 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d74d8-5728-4aa4-871c-ad659e1c074b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:52.881912 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d74d8-5728-4aa4-871c-ad659e1c074b None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:52.882195 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d74d8-5728-4aa4-871c-ad659e1c074b None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:52.882472 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d74d8-5728-4aa4-871c-ad659e1c074b None admin] PATH_INFO: `/v3/groups/c35827b60ff544918b6872031644fbd1` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:52.883791 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5d74d8-5728-4aa4-871c-ad659e1c074b None admin] RBAC: Authorizing `identity:get_group(group_id=c35827b60ff544918b6872031644fbd1)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:52.887878 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5d74d8-5728-4aa4-871c-ad659e1c074b None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:52.887878 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 235/450] 10.222.0.26 () {56 vars in 1180 bytes} [Fri Jul 1 19:21:52 2022] GET /identity/v3/groups/c35827b60ff544918b6872031644fbd1 => generated 226 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:21:52.893900 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d74d8-5728-4aa4-871c-ad659e1c074b None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:52.916399 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:52.943957 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ea25aa-a4f4-4bad-928d-28c40412334a None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:52.994395 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993dffa8-2f83-4d2b-b599-853aaa1a21e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:52.995050 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993dffa8-2f83-4d2b-b599-853aaa1a21e6 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:52.995337 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993dffa8-2f83-4d2b-b599-853aaa1a21e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:52.995608 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993dffa8-2f83-4d2b-b599-853aaa1a21e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:53.052168 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d74d8-5728-4aa4-871c-ad659e1c074b None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:53.095867 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993dffa8-2f83-4d2b-b599-853aaa1a21e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:53.096609 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993dffa8-2f83-4d2b-b599-853aaa1a21e6 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:53.097941 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aceab04-66d8-4bdd-a548-fe7e40b0e912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:53.098959 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aceab04-66d8-4bdd-a548-fe7e40b0e912 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:53.099415 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aceab04-66d8-4bdd-a548-fe7e40b0e912 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:53.099884 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aceab04-66d8-4bdd-a548-fe7e40b0e912 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:53.100775 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aceab04-66d8-4bdd-a548-fe7e40b0e912 None admin] RBAC: Adding query filter params (group.id=c35827b60ff544918b6872031644fbd1, role.id=dd71f7898e6a4d9f99d1554dd7d27033, scope.project.id=b3f5af7a5da14e5c84bea28cc3aa5626) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:53.101890 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aceab04-66d8-4bdd-a548-fe7e40b0e912 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:53.103772 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aceab04-66d8-4bdd-a548-fe7e40b0e912 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:53.113858 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 236/451] 10.222.0.26 () {56 vars in 1376 bytes} [Fri Jul 1 19:21:52 2022] GET /identity/v3/role_assignments?group.id=c35827b60ff544918b6872031644fbd1&scope.project.id=b3f5af7a5da14e5c84bea28cc3aa5626&role.id=dd71f7898e6a4d9f99d1554dd7d27033 => generated 611 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:21:53.215977 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:53.236956 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 216/452] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Jul 1 19:21:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 19:21:53.243032 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aceab04-66d8-4bdd-a548-fe7e40b0e912 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:53.275553 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:53.358202 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aceab04-66d8-4bdd-a548-fe7e40b0e912 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:53.407189 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc44ea-248e-459b-a0c8-f6cb1e15c7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:53.408444 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc44ea-248e-459b-a0c8-f6cb1e15c7ca None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:53.408444 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc44ea-248e-459b-a0c8-f6cb1e15c7ca None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:53.408626 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc44ea-248e-459b-a0c8-f6cb1e15c7ca None admin] PATH_INFO: `/v3/projects/82f5068f09304c36812a397a31aad7a3` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:53.409858 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cc44ea-248e-459b-a0c8-f6cb1e15c7ca None admin] RBAC: Authorizing `identity:get_project(project_id=82f5068f09304c36812a397a31aad7a3)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:53.416569 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cc44ea-248e-459b-a0c8-f6cb1e15c7ca None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:53.418393 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 237/453] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Jul 1 19:21:53 2022] GET /identity/v3/projects/82f5068f09304c36812a397a31aad7a3 => generated 344 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:53.431231 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993dffa8-2f83-4d2b-b599-853aaa1a21e6 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:53.532785 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993dffa8-2f83-4d2b-b599-853aaa1a21e6 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:53.568152 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e4b1d7-c057-4191-a4dd-26189557ee1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:53.568994 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4b1d7-c057-4191-a4dd-26189557ee1b None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:53.569306 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4b1d7-c057-4191-a4dd-26189557ee1b None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:53.569587 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4b1d7-c057-4191-a4dd-26189557ee1b None admin] PATH_INFO: `/v3/groups/ec7df40dd0a0438b8d0f5bbc5c2df889` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:53.570754 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e4b1d7-c057-4191-a4dd-26189557ee1b None admin] RBAC: Authorizing `identity:get_group(group_id=ec7df40dd0a0438b8d0f5bbc5c2df889)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:53.572189 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e4b1d7-c057-4191-a4dd-26189557ee1b None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:53.573861 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 217/454] 10.222.0.26 () {56 vars in 1180 bytes} [Fri Jul 1 19:21:53 2022] GET /identity/v3/groups/ec7df40dd0a0438b8d0f5bbc5c2df889 => generated 229 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:53.579912 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc44ea-248e-459b-a0c8-f6cb1e15c7ca None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:53.676813 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:53.683196 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc44ea-248e-459b-a0c8-f6cb1e15c7ca None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:53.715601 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b02198a-a2dd-44bd-9f85-9ff8b1682010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:53.716246 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b02198a-a2dd-44bd-9f85-9ff8b1682010 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:53.716528 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b02198a-a2dd-44bd-9f85-9ff8b1682010 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:53.716802 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b02198a-a2dd-44bd-9f85-9ff8b1682010 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:53.718162 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b02198a-a2dd-44bd-9f85-9ff8b1682010 None admin] RBAC: Adding query filter params (group.id=ec7df40dd0a0438b8d0f5bbc5c2df889, role.id=6cb03785fb184ef587509b3174622f69, scope.project.id=82f5068f09304c36812a397a31aad7a3) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:53.718474 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b02198a-a2dd-44bd-9f85-9ff8b1682010 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:53.719899 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b02198a-a2dd-44bd-9f85-9ff8b1682010 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:53.725682 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 238/455] 10.222.0.26 () {56 vars in 1376 bytes} [Fri Jul 1 19:21:53 2022] GET /identity/v3/role_assignments?group.id=ec7df40dd0a0438b8d0f5bbc5c2df889&scope.project.id=82f5068f09304c36812a397a31aad7a3&role.id=6cb03785fb184ef587509b3174622f69 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:56.125923 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaed274-2f9f-4e3f-b370-6203d7e8456a None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:56.126961 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaed274-2f9f-4e3f-b370-6203d7e8456a None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:56.127511 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaed274-2f9f-4e3f-b370-6203d7e8456a None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:56.129338 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 218/456] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:21:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:21:56.135080 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5e044-faf1-42a9-bb87-308da2eec8d9 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:56.135961 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5e044-faf1-42a9-bb87-308da2eec8d9 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:56.136437 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5e044-faf1-42a9-bb87-308da2eec8d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:56.162295 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-5ab5e044-faf1-42a9-bb87-308da2eec8d9 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:21:56.163837 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-5ab5e044-faf1-42a9-bb87-308da2eec8d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:21:56.251314 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 239/457] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:21:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 19:21:56.279409 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaed274-2f9f-4e3f-b370-6203d7e8456a None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:56.348871 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:56.418892 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaed274-2f9f-4e3f-b370-6203d7e8456a None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:56.482287 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659a275e-48c9-4d90-87f9-924975280f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:56.484036 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a275e-48c9-4d90-87f9-924975280f8b None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:56.484463 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a275e-48c9-4d90-87f9-924975280f8b None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:56.484882 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a275e-48c9-4d90-87f9-924975280f8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:56.510641 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659a275e-48c9-4d90-87f9-924975280f8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:56.512961 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659a275e-48c9-4d90-87f9-924975280f8b None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:56.553694 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-659a275e-48c9-4d90-87f9-924975280f8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:21:56.553694 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:21:56.553694 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:21:56.553694 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:21:56.553694 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:21:56.553694 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:21:56.553694 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:21:56.553694 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:21:56.553694 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:21:56.553694 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:21:56.553694 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:21:56.553694 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:21:56.553694 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:21:56.553694 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:21:56.553694 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:21:56.554598 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:21:56.554598 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:21:56.554598 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:21:56.554598 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:21:56.554598 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:21:56.554598 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:21:56.554598 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:21:56.554598 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:21:56.554598 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:21:56.554598 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:21:56.554598 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:21:56.554598 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:21:56.554598 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:21:56.554598 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:21:56.554598 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:21:56.554598 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:21:56.554598 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:21:56.555439 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:21:56.555439 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:21:56.555439 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:21:56.555439 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:21:56.556085 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 219/458] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:21:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:21:56.562669 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab5e044-faf1-42a9-bb87-308da2eec8d9 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:56.619047 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36414e36-0862-40d1-83f3-d58560f252c0 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:56.619355 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36414e36-0862-40d1-83f3-d58560f252c0 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:56.619610 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36414e36-0862-40d1-83f3-d58560f252c0 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:56.621294 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 220/459] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:21:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:21:56.638821 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af38c608-ceb1-4af5-9522-d5b0bad368a2 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:56.639133 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af38c608-ceb1-4af5-9522-d5b0bad368a2 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:56.639385 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af38c608-ceb1-4af5-9522-d5b0bad368a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:56.678654 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-af38c608-ceb1-4af5-9522-d5b0bad368a2 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:21:56.680237 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-af38c608-ceb1-4af5-9522-d5b0bad368a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:21:56.697746 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab5e044-faf1-42a9-bb87-308da2eec8d9 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:56.705266 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:56.736137 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3789da51-0ad9-4e5b-b791-39ff8000892c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:56.736838 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789da51-0ad9-4e5b-b791-39ff8000892c None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:56.737129 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789da51-0ad9-4e5b-b791-39ff8000892c None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:56.737441 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789da51-0ad9-4e5b-b791-39ff8000892c None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:56.738237 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3789da51-0ad9-4e5b-b791-39ff8000892c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:56.738552 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3789da51-0ad9-4e5b-b791-39ff8000892c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:56.740058 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3789da51-0ad9-4e5b-b791-39ff8000892c None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:56.752743 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 240/460] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Jul 1 19:21:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:56.758212 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3789da51-0ad9-4e5b-b791-39ff8000892c None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:56.869639 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3789da51-0ad9-4e5b-b791-39ff8000892c None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:56.874401 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 221/461] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:21:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 19:21:56.926028 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f066e-b7b1-4dba-8b11-f7bffa9f15dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:56.926722 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f066e-b7b1-4dba-8b11-f7bffa9f15dc None admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:56.927020 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f066e-b7b1-4dba-8b11-f7bffa9f15dc None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:56.927404 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f066e-b7b1-4dba-8b11-f7bffa9f15dc None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:56.928282 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670f066e-b7b1-4dba-8b11-f7bffa9f15dc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:56.930094 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670f066e-b7b1-4dba-8b11-f7bffa9f15dc None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:56.941118 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af38c608-ceb1-4af5-9522-d5b0bad368a2 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:56.960254 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 241/462] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Jul 1 19:21:56 2022] POST /identity/v3/users => generated 246 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 19:21:57.000776 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:57.069864 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d52b66e-aa83-4c80-9039-105862433ced None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:57.069864 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d52b66e-aa83-4c80-9039-105862433ced None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:57.070933 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d52b66e-aa83-4c80-9039-105862433ced None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:57.071495 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 242/463] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:21:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:21:57.078544 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3521f305-3a80-48aa-8261-b29e81696a8c None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:57.079149 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3521f305-3a80-48aa-8261-b29e81696a8c None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:57.079687 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3521f305-3a80-48aa-8261-b29e81696a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:57.094463 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:57.103465 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-3521f305-3a80-48aa-8261-b29e81696a8c None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:21:57.104681 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af38c608-ceb1-4af5-9522-d5b0bad368a2 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:57.105589 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-3521f305-3a80-48aa-8261-b29e81696a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:21:57.163655 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2016257e-6d6c-457b-9a26-f1308cf66c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:57.164474 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2016257e-6d6c-457b-9a26-f1308cf66c3f None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:57.164759 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2016257e-6d6c-457b-9a26-f1308cf66c3f None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:57.165032 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2016257e-6d6c-457b-9a26-f1308cf66c3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:57.188690 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2016257e-6d6c-457b-9a26-f1308cf66c3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:57.190160 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2016257e-6d6c-457b-9a26-f1308cf66c3f None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:57.193992 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 243/464] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:21:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 19:21:57.223349 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-2016257e-6d6c-457b-9a26-f1308cf66c3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:21:57.223349 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:21:57.223349 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:21:57.223349 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:21:57.223349 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:21:57.223349 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:21:57.223349 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:21:57.223349 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:21:57.223349 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:21:57.223349 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:21:57.223349 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:21:57.223349 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:21:57.223349 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:21:57.223349 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:21:57.223349 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:21:57.224305 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:21:57.224305 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:21:57.224305 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:21:57.224305 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:21:57.224305 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:21:57.224305 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:21:57.224305 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:21:57.224305 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:21:57.224305 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:21:57.224305 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:21:57.224305 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:21:57.224305 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:21:57.224305 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:21:57.224305 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:21:57.224305 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:21:57.224305 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:21:57.224305 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:21:57.225393 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:21:57.225393 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:21:57.225393 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:21:57.225393 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:21:57.229812 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 222/465] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:21:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:21:57.236013 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3521f305-3a80-48aa-8261-b29e81696a8c None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:57.244894 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2016257e-6d6c-457b-9a26-f1308cf66c3f None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:57.338960 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:57.358082 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2016257e-6d6c-457b-9a26-f1308cf66c3f None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:57.367756 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3521f305-3a80-48aa-8261-b29e81696a8c None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:57.404876 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d35c2f-ef36-4d16-b0c9-768747955e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:57.405817 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d35c2f-ef36-4d16-b0c9-768747955e38 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:57.406103 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d35c2f-ef36-4d16-b0c9-768747955e38 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:57.406382 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d35c2f-ef36-4d16-b0c9-768747955e38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:57.413000 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fb7db8-c5d9-4b5e-981a-ebaa682294f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:57.414117 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb7db8-c5d9-4b5e-981a-ebaa682294f1 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:57.414585 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb7db8-c5d9-4b5e-981a-ebaa682294f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:57.415069 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb7db8-c5d9-4b5e-981a-ebaa682294f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:57.416084 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fb7db8-c5d9-4b5e-981a-ebaa682294f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:57.416678 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fb7db8-c5d9-4b5e-981a-ebaa682294f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:57.418378 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fb7db8-c5d9-4b5e-981a-ebaa682294f1 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:57.420648 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d35c2f-ef36-4d16-b0c9-768747955e38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:57.421452 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:57.423111 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d35c2f-ef36-4d16-b0c9-768747955e38 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:57.433452 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 244/466] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Jul 1 19:21:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:57.439696 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fb7db8-c5d9-4b5e-981a-ebaa682294f1 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:57.446000 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-51d35c2f-ef36-4d16-b0c9-768747955e38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:21:57.446000 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:21:57.446000 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:21:57.446000 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:21:57.446000 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:21:57.446000 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:21:57.446000 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:21:57.446000 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:21:57.446000 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:21:57.446000 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:21:57.446000 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:21:57.446000 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:21:57.446000 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:21:57.446000 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:21:57.446000 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:21:57.447045 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:21:57.447045 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:21:57.447045 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:21:57.447045 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:21:57.447045 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:21:57.447045 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:21:57.447045 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:21:57.447045 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:21:57.447045 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:21:57.447045 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:21:57.447045 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:21:57.447045 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:21:57.447045 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:21:57.447045 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:21:57.447045 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:21:57.447045 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:21:57.447045 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:21:57.448128 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:21:57.448128 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:21:57.448128 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:21:57.448128 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:21:57.450005 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 223/467] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:21:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:21:57.456414 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d35c2f-ef36-4d16-b0c9-768747955e38 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:57.565264 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fb7db8-c5d9-4b5e-981a-ebaa682294f1 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:57.597208 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cb93f8-493a-4967-96f3-6a727fa8751d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:57.597898 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb93f8-493a-4967-96f3-6a727fa8751d None admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:57.598262 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb93f8-493a-4967-96f3-6a727fa8751d None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:57.598615 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb93f8-493a-4967-96f3-6a727fa8751d None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:57.599410 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cb93f8-493a-4967-96f3-6a727fa8751d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:57.601163 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cb93f8-493a-4967-96f3-6a727fa8751d None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:57.625771 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 245/468] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Jul 1 19:21:57 2022] POST /identity/v3/users => generated 248 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 19:21:57.634327 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d35c2f-ef36-4d16-b0c9-768747955e38 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:57.710212 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893aacb7-12ed-4cc3-b388-a1fdecf5006d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:57.711157 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893aacb7-12ed-4cc3-b388-a1fdecf5006d None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:57.711599 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893aacb7-12ed-4cc3-b388-a1fdecf5006d None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:57.712031 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893aacb7-12ed-4cc3-b388-a1fdecf5006d None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:57.712962 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893aacb7-12ed-4cc3-b388-a1fdecf5006d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:57.713450 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893aacb7-12ed-4cc3-b388-a1fdecf5006d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:57.715029 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893aacb7-12ed-4cc3-b388-a1fdecf5006d None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:57.725108 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:57.732916 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 224/469] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Jul 1 19:21:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:57.738203 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cb93f8-493a-4967-96f3-6a727fa8751d None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:57.791414 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b4a61-0f1e-4bce-869e-8ae9f744ee7f None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:57.791760 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b4a61-0f1e-4bce-869e-8ae9f744ee7f None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:57.791983 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b4a61-0f1e-4bce-869e-8ae9f744ee7f None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:57.797815 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 225/470] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:21:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:21:57.806748 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa5c79-782d-41b9-bc5e-f47e2c3af6db None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:57.807067 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa5c79-782d-41b9-bc5e-f47e2c3af6db None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:57.807326 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa5c79-782d-41b9-bc5e-f47e2c3af6db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:57.841840 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:57.851602 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-88aa5c79-782d-41b9-bc5e-f47e2c3af6db None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:21:57.853504 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-88aa5c79-782d-41b9-bc5e-f47e2c3af6db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:21:57.884626 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cb93f8-493a-4967-96f3-6a727fa8751d None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:57.927665 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db284506-e775-44ba-8ec7-4df0a473e8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:57.928598 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db284506-e775-44ba-8ec7-4df0a473e8a8 None admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:57.928888 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db284506-e775-44ba-8ec7-4df0a473e8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:57.929172 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db284506-e775-44ba-8ec7-4df0a473e8a8 None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:57.929948 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db284506-e775-44ba-8ec7-4df0a473e8a8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:57.931413 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db284506-e775-44ba-8ec7-4df0a473e8a8 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:57.962070 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 246/471] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Jul 1 19:21:57 2022] POST /identity/v3/users => generated 249 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:21:57.997251 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 226/472] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:21:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:21:58.033112 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db284506-e775-44ba-8ec7-4df0a473e8a8 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:58.158554 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db284506-e775-44ba-8ec7-4df0a473e8a8 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:58.168882 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:58.197487 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eddf9d-641a-4999-8c14-14457a04be32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:58.198293 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eddf9d-641a-4999-8c14-14457a04be32 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:58.198577 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eddf9d-641a-4999-8c14-14457a04be32 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:58.198856 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eddf9d-641a-4999-8c14-14457a04be32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:58.212361 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eddf9d-641a-4999-8c14-14457a04be32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:58.213964 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eddf9d-641a-4999-8c14-14457a04be32 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:58.232144 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-e8eddf9d-641a-4999-8c14-14457a04be32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:21:58.232144 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:21:58.232144 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:21:58.232144 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:21:58.232144 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:21:58.232144 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:21:58.232144 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:21:58.232144 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:21:58.232144 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:21:58.232144 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:21:58.232144 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:21:58.232144 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:21:58.232144 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:21:58.232144 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:21:58.232144 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:21:58.233707 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:21:58.233707 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:21:58.233707 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:21:58.233707 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:21:58.233707 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:21:58.233707 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:21:58.233707 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:21:58.233707 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:21:58.233707 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:21:58.233707 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:21:58.233707 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:21:58.233707 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:21:58.233707 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:21:58.233707 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:21:58.233707 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:21:58.233707 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:21:58.233707 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:21:58.235120 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:21:58.235120 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:21:58.235120 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:21:58.235120 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:21:58.235120 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 247/473] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:21:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:21:58.241416 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa5c79-782d-41b9-bc5e-f47e2c3af6db None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:58.350683 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa5c79-782d-41b9-bc5e-f47e2c3af6db None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:58.380326 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:58.395339 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec92b7c2-d2e5-4ef6-a8e0-5d2c6c785b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:58.396208 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec92b7c2-d2e5-4ef6-a8e0-5d2c6c785b0a None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:58.396499 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec92b7c2-d2e5-4ef6-a8e0-5d2c6c785b0a None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:58.396775 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec92b7c2-d2e5-4ef6-a8e0-5d2c6c785b0a None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:58.397557 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec92b7c2-d2e5-4ef6-a8e0-5d2c6c785b0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:58.397865 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec92b7c2-d2e5-4ef6-a8e0-5d2c6c785b0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:58.399267 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec92b7c2-d2e5-4ef6-a8e0-5d2c6c785b0a None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:58.413436 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 227/474] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Jul 1 19:21:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:21:58.419922 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eddf9d-641a-4999-8c14-14457a04be32 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:58.450910 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be88462a-55da-45c6-b960-bf4daadeecea None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:58.451678 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be88462a-55da-45c6-b960-bf4daadeecea None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:58.452155 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be88462a-55da-45c6-b960-bf4daadeecea None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:58.454068 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 228/475] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:21:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 19:21:58.459325 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b451dec-34bd-485d-adf2-501b5ac4be83 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:58.459816 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b451dec-34bd-485d-adf2-501b5ac4be83 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:58.460265 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b451dec-34bd-485d-adf2-501b5ac4be83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:58.479191 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-3b451dec-34bd-485d-adf2-501b5ac4be83 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:21:58.480674 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-3b451dec-34bd-485d-adf2-501b5ac4be83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:21:58.595666 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eddf9d-641a-4999-8c14-14457a04be32 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:58.608167 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 229/476] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:21:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 19:21:58.651875 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb64d2f5-aaa1-4b98-9c9f-dd9ee6afbae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:58.652843 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb64d2f5-aaa1-4b98-9c9f-dd9ee6afbae3 None admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:58.653471 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb64d2f5-aaa1-4b98-9c9f-dd9ee6afbae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:58.653954 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb64d2f5-aaa1-4b98-9c9f-dd9ee6afbae3 None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:58.655466 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb64d2f5-aaa1-4b98-9c9f-dd9ee6afbae3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:58.657172 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb64d2f5-aaa1-4b98-9c9f-dd9ee6afbae3 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:58.678746 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b451dec-34bd-485d-adf2-501b5ac4be83 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:58.687775 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 248/477] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Jul 1 19:21:58 2022] POST /identity/v3/users => generated 248 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 19:21:58.862912 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b451dec-34bd-485d-adf2-501b5ac4be83 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:58.883846 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:58.910276 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5137a6a-4382-4ecb-84dd-104354fd58da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:58.910958 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5137a6a-4382-4ecb-84dd-104354fd58da None admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:58.911246 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5137a6a-4382-4ecb-84dd-104354fd58da None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:58.911526 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5137a6a-4382-4ecb-84dd-104354fd58da None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:58.912290 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5137a6a-4382-4ecb-84dd-104354fd58da None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:58.913704 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5137a6a-4382-4ecb-84dd-104354fd58da None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:58.926338 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.sql.core [None req-f5137a6a-4382-4ecb-84dd-104354fd58da None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 01 19:21:58.926338 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 01 19:21:58.926338 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [parameters: {'id': 'c1a0b6da90fb4f7b8da6e9cc0361d5a7', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 01 19:21:58.926338 dv-cinder-844601-7-smb devstack@keystone.service[80247]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80247) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 01 19:21:58.943733 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-f5137a6a-4382-4ecb-84dd-104354fd58da None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 01 19:21:58.943733 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:21:58.943733 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 01 19:21:58.943733 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 01 19:21:58.943733 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 01 19:21:58.943733 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 01 19:21:58.943733 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 01 19:21:58.943733 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application result = self._query(query) Jul 01 19:21:58.943733 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 01 19:21:58.943733 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application conn.query(q) Jul 01 19:21:58.943733 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 01 19:21:58.943733 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 01 19:21:58.943733 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 01 19:21:58.943733 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application result.read() Jul 01 19:21:58.943733 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 01 19:21:58.945902 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 01 19:21:58.945902 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 01 19:21:58.945902 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 01 19:21:58.945902 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 01 19:21:58.945902 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 01 19:21:58.945902 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 01 19:21:58.945902 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 01 19:21:58.945902 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 01 19:21:58.945902 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:21:58.945902 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 01 19:21:58.945902 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:21:58.945902 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:21:58.945902 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 01 19:21:58.945902 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 01 19:21:58.945902 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 01 19:21:58.945902 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return ref.to_dict() Jul 01 19:21:58.945902 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 01 19:21:58.945902 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application next(self.gen) Jul 01 19:21:58.947792 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 01 19:21:58.947792 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application yield resource Jul 01 19:21:58.947792 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 01 19:21:58.947792 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application next(self.gen) Jul 01 19:21:58.947792 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 01 19:21:58.947792 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self.session.rollback() Jul 01 19:21:58.947792 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 01 19:21:58.947792 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self.force_reraise() Jul 01 19:21:58.947792 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 01 19:21:58.947792 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise self.value Jul 01 19:21:58.947792 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 01 19:21:58.947792 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 01 19:21:58.947792 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 01 19:21:58.947792 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application session.commit() Jul 01 19:21:58.947792 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 01 19:21:58.947792 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 01 19:21:58.947792 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 01 19:21:58.950735 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._prepare_impl() Jul 01 19:21:58.950735 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 01 19:21:58.950735 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self.session.flush() Jul 01 19:21:58.950735 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 01 19:21:58.950735 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._flush(objects) Jul 01 19:21:58.950735 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 01 19:21:58.950735 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 01 19:21:58.950735 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 01 19:21:58.950735 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application compat.raise_( Jul 01 19:21:58.950735 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 01 19:21:58.950735 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception Jul 01 19:21:58.950735 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 01 19:21:58.950735 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application flush_context.execute() Jul 01 19:21:58.950735 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 01 19:21:58.950735 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rec.execute(self) Jul 01 19:21:58.950735 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 01 19:21:58.950735 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 01 19:21:58.958142 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 01 19:21:58.958142 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 01 19:21:58.958142 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 01 19:21:58.958142 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 01 19:21:58.958142 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 01 19:21:58.958142 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 01 19:21:58.958142 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 01 19:21:58.958142 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 01 19:21:58.958142 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 01 19:21:58.958142 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 01 19:21:58.958142 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 01 19:21:58.958142 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 01 19:21:58.958142 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 01 19:21:58.958142 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 01 19:21:58.958142 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 01 19:21:58.958142 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception Jul 01 19:21:58.961046 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 01 19:21:58.961046 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 01 19:21:58.961046 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 01 19:21:58.961046 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 01 19:21:58.961046 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 01 19:21:58.961046 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application result = self._query(query) Jul 01 19:21:58.961046 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 01 19:21:58.961046 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application conn.query(q) Jul 01 19:21:58.961046 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 01 19:21:58.961046 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 01 19:21:58.961046 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 01 19:21:58.961046 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application result.read() Jul 01 19:21:58.961046 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 01 19:21:58.961046 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 01 19:21:58.961046 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 01 19:21:58.961046 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 01 19:21:58.970996 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 01 19:21:58.970996 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 01 19:21:58.970996 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 01 19:21:58.970996 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 01 19:21:58.970996 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 01 19:21:58.970996 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 01 19:21:58.970996 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [parameters: {'id': 'c1a0b6da90fb4f7b8da6e9cc0361d5a7', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 01 19:21:58.970996 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 01 19:21:58.970996 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:21:58.970996 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 19:21:58.970996 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:21:58.970996 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:21:58.970996 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:21:58.970996 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:21:58.970996 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:21:58.970996 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:21:58.973907 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:21:58.973907 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:21:58.973907 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:21:58.973907 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:21:58.973907 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:21:58.973907 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:21:58.973907 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 01 19:21:58.973907 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 01 19:21:58.973907 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:21:58.973907 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:21:58.973907 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 01 19:21:58.973907 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 01 19:21:58.973907 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 01 19:21:58.973907 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 01 19:21:58.973907 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 01 19:21:58.973907 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:21:58.976858 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 230/478] 10.222.0.26 () {60 vars in 1131 bytes} [Fri Jul 1 19:21:58 2022] POST /identity/v3/roles => generated 144 bytes in 267 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:21:58.977080 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb64d2f5-aaa1-4b98-9c9f-dd9ee6afbae3 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:59.027232 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:59.151441 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb64d2f5-aaa1-4b98-9c9f-dd9ee6afbae3 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:59.198214 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df797382-59d5-4b12-941e-b97c9ca3b83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:59.200503 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df797382-59d5-4b12-941e-b97c9ca3b83d None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:59.201773 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df797382-59d5-4b12-941e-b97c9ca3b83d None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:59.202452 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df797382-59d5-4b12-941e-b97c9ca3b83d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:59.228803 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df797382-59d5-4b12-941e-b97c9ca3b83d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:21:59.245575 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-df797382-59d5-4b12-941e-b97c9ca3b83d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 19:21:59.245575 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:21:59.245575 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:21:59.245575 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:21:59.245575 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:21:59.245575 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:21:59.245575 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:21:59.245575 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:21:59.245575 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:21:59.245575 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:21:59.245575 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:21:59.245575 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:21:59.245575 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:21:59.245575 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:21:59.245575 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:21:59.245575 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:21:59.247005 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:21:59.247005 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:21:59.247005 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:21:59.247005 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:21:59.247005 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:21:59.247005 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:21:59.247005 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:21:59.247005 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:21:59.247005 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:21:59.247005 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:21:59.247005 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:21:59.247005 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:21:59.247005 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:21:59.247005 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:21:59.247005 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:21:59.247005 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:21:59.248495 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:21:59.248495 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:21:59.248495 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:21:59.248495 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:21:59.248495 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:21:59.248495 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:21:59.248495 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:21:59.248495 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:21:59.248495 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:21:59.248495 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:21:59.248495 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 19:21:59.248495 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:21:59.252961 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 249/479] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Jul 1 19:21:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:21:59.261442 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5137a6a-4382-4ecb-84dd-104354fd58da None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:59.393749 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5137a6a-4382-4ecb-84dd-104354fd58da None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:21:59.452013 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7373d345-aa4c-4982-9d97-6a211af1308b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:21:59.452595 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373d345-aa4c-4982-9d97-6a211af1308b None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:59.452879 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373d345-aa4c-4982-9d97-6a211af1308b None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:59.453155 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373d345-aa4c-4982-9d97-6a211af1308b None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:59.453961 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7373d345-aa4c-4982-9d97-6a211af1308b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:21:59.454271 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7373d345-aa4c-4982-9d97-6a211af1308b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:21:59.455715 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7373d345-aa4c-4982-9d97-6a211af1308b None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:21:59.465554 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 231/480] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Jul 1 19:21:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:21:59.683519 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250c944-3fd8-47a4-b0cf-2c6412cdcf67 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:59.683958 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250c944-3fd8-47a4-b0cf-2c6412cdcf67 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:59.684391 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250c944-3fd8-47a4-b0cf-2c6412cdcf67 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:59.687412 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 250/481] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:21:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:21:59.693441 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d49f29-3b87-49da-a79b-143390443bd1 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:21:59.693882 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d49f29-3b87-49da-a79b-143390443bd1 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:21:59.694408 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d49f29-3b87-49da-a79b-143390443bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:21:59.726568 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-f9d49f29-3b87-49da-a79b-143390443bd1 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:21:59.727879 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-f9d49f29-3b87-49da-a79b-143390443bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:21:59.801622 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:59.847358 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 232/482] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:21:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:21:59.872937 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e250c944-3fd8-47a4-b0cf-2c6412cdcf67 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:21:59.962070 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:21:59.988735 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e250c944-3fd8-47a4-b0cf-2c6412cdcf67 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:00.025906 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a37cacd-4f1d-4336-ab88-192326ac8b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:00.026712 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37cacd-4f1d-4336-ab88-192326ac8b07 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:00.027003 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37cacd-4f1d-4336-ab88-192326ac8b07 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:00.027283 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37cacd-4f1d-4336-ab88-192326ac8b07 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:00.039584 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a37cacd-4f1d-4336-ab88-192326ac8b07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:22:00.048115 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-7a37cacd-4f1d-4336-ab88-192326ac8b07 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:22:00.048115 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:00.048115 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:00.048115 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:00.048115 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:00.048115 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:00.048115 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:00.048115 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:00.048115 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:00.048115 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:00.048115 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:00.048115 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:00.048115 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:22:00.048115 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:22:00.048115 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:22:00.048115 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:22:00.049835 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:22:00.049835 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:22:00.049835 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:22:00.049835 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:22:00.049835 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:00.049835 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:00.049835 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:00.049835 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:00.049835 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:00.049835 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:00.049835 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:00.049835 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:00.049835 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:00.049835 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:00.049835 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:00.049835 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:00.051439 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:00.051439 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:00.051439 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:00.051439 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:00.051439 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:22:00.051439 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:22:00.051439 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:22:00.051439 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:22:00.051439 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:22:00.051439 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:22:00.051439 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:22:00.051439 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:00.051439 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 251/483] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Jul 1 19:21:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:00.055924 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d49f29-3b87-49da-a79b-143390443bd1 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:00.193949 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d49f29-3b87-49da-a79b-143390443bd1 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:00.236744 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f4299f-b897-4072-bad5-869259c2583d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:00.237464 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4299f-b897-4072-bad5-869259c2583d None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:00.237759 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4299f-b897-4072-bad5-869259c2583d None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:00.238045 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4299f-b897-4072-bad5-869259c2583d None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:00.238872 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f4299f-b897-4072-bad5-869259c2583d None admin] RBAC: Adding query filter params (name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:00.239122 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f4299f-b897-4072-bad5-869259c2583d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:00.241055 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f4299f-b897-4072-bad5-869259c2583d None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:00.252124 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 233/484] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Jul 1 19:22:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:00.258575 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a37cacd-4f1d-4336-ab88-192326ac8b07 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:00.382685 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a37cacd-4f1d-4336-ab88-192326ac8b07 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:00.422514 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e147f6-a623-4f01-803d-8e69c6f78279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:00.423317 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e147f6-a623-4f01-803d-8e69c6f78279 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:00.423603 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e147f6-a623-4f01-803d-8e69c6f78279 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:00.423888 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e147f6-a623-4f01-803d-8e69c6f78279 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:00.427342 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:00.437702 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e147f6-a623-4f01-803d-8e69c6f78279 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:00.439661 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e147f6-a623-4f01-803d-8e69c6f78279 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:00.461167 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-12e147f6-a623-4f01-803d-8e69c6f78279 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:00.461167 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:00.461167 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:00.461167 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:00.461167 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:00.461167 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:00.461167 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:00.461167 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:00.461167 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:00.461167 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:00.461167 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:00.461167 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:00.461167 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:22:00.461167 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:22:00.461167 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:22:00.462547 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:22:00.462547 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:00.462547 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:00.462547 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:00.462547 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:00.462547 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:00.462547 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:00.462547 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:00.462547 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:00.462547 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:00.462547 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:00.462547 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:00.462547 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:00.462547 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:00.462547 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:00.462547 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:00.462547 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:00.464603 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:22:00.464603 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:22:00.464603 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:00.464603 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:00.464603 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 252/485] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:22:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:00.470032 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f4299f-b897-4072-bad5-869259c2583d None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:00.549071 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:00.643653 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f4299f-b897-4072-bad5-869259c2583d None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:00.680465 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde4a3e-ad26-4ea0-889c-378aafd46122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:00.681147 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde4a3e-ad26-4ea0-889c-378aafd46122 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:00.681461 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde4a3e-ad26-4ea0-889c-378aafd46122 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:00.681726 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde4a3e-ad26-4ea0-889c-378aafd46122 None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:00.682446 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bde4a3e-ad26-4ea0-889c-378aafd46122 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:00.682756 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bde4a3e-ad26-4ea0-889c-378aafd46122 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:00.684130 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bde4a3e-ad26-4ea0-889c-378aafd46122 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:00.697709 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 234/486] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Jul 1 19:22:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:00.706667 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e147f6-a623-4f01-803d-8e69c6f78279 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:00.902344 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e147f6-a623-4f01-803d-8e69c6f78279 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:00.964316 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e146fd6-104a-4ca0-b8f9-26ae021c2dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:00.965123 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e146fd6-104a-4ca0-b8f9-26ae021c2dc0 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:00.965484 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e146fd6-104a-4ca0-b8f9-26ae021c2dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:00.965765 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e146fd6-104a-4ca0-b8f9-26ae021c2dc0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:00.977702 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e146fd6-104a-4ca0-b8f9-26ae021c2dc0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:00.979170 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e146fd6-104a-4ca0-b8f9-26ae021c2dc0 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:00.999521 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-7e146fd6-104a-4ca0-b8f9-26ae021c2dc0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 01 19:22:00.999521 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:00.999521 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:00.999521 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:00.999521 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:00.999521 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:00.999521 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:00.999521 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:00.999521 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:00.999521 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:00.999521 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:00.999521 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:00.999521 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 19:22:00.999521 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 19:22:00.999521 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 19:22:00.999521 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 19:22:01.000958 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:01.000958 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:01.000958 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 19:22:01.000958 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:22:01.000958 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 19:22:01.000958 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:22:01.000958 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:01.000958 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:01.000958 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:01.000958 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:01.000958 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:01.000958 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:01.000958 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:01.000958 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:01.000958 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:01.000958 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:01.000958 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:01.000958 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:01.003121 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:01.003121 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:01.003121 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 19:22:01.003121 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 19:22:01.003121 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 19:22:01.003121 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 19:22:01.003121 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 19:22:01.003121 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 19:22:01.003121 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 01 19:22:01.003121 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:01.003121 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 253/487] 10.222.0.26 () {56 vars in 1093 bytes} [Fri Jul 1 19:22:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:01.006393 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde4a3e-ad26-4ea0-889c-378aafd46122 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:01.135726 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5da1c-9a22-47f7-9643-88dce1992dff None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:01.136115 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5da1c-9a22-47f7-9643-88dce1992dff None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:01.136480 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5da1c-9a22-47f7-9643-88dce1992dff None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:01.138455 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 254/488] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:22:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:22:01.146637 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a249f546-4aef-491b-b010-7ff84e3842e0 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:01.147157 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a249f546-4aef-491b-b010-7ff84e3842e0 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:01.147557 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a249f546-4aef-491b-b010-7ff84e3842e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:01.193699 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-a249f546-4aef-491b-b010-7ff84e3842e0 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:22:01.195578 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-a249f546-4aef-491b-b010-7ff84e3842e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:22:01.197499 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:01.223182 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde4a3e-ad26-4ea0-889c-378aafd46122 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:01.287738 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f5268b-25fc-43fa-b804-4d4880cab973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:01.288793 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f5268b-25fc-43fa-b804-4d4880cab973 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:01.289289 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f5268b-25fc-43fa-b804-4d4880cab973 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:01.289770 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f5268b-25fc-43fa-b804-4d4880cab973 None admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:01.291314 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f5268b-25fc-43fa-b804-4d4880cab973 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:01.291850 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f5268b-25fc-43fa-b804-4d4880cab973 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:01.294481 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f5268b-25fc-43fa-b804-4d4880cab973 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:01.294926 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:01.323109 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 255/489] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:22:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 19:22:01.324483 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de3e4f-ca2f-4aaa-a1c5-8c2785262669 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:01.324776 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de3e4f-ca2f-4aaa-a1c5-8c2785262669 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:01.325061 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de3e4f-ca2f-4aaa-a1c5-8c2785262669 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:01.330988 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 256/490] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:22:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:22:01.332657 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922f0ef-ee2d-4a44-9a24-f84c522ac9ed None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:01.333150 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922f0ef-ee2d-4a44-9a24-f84c522ac9ed None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:01.333601 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922f0ef-ee2d-4a44-9a24-f84c522ac9ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:01.352177 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-5922f0ef-ee2d-4a44-9a24-f84c522ac9ed None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:22:01.353502 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-5922f0ef-ee2d-4a44-9a24-f84c522ac9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:22:01.398640 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 235/491] 10.222.0.26 () {56 vars in 1133 bytes} [Fri Jul 1 19:22:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:01.408143 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f5268b-25fc-43fa-b804-4d4880cab973 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:01.435725 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 257/492] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:22:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:22:01.436659 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5922f0ef-ee2d-4a44-9a24-f84c522ac9ed None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:01.571379 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5922f0ef-ee2d-4a44-9a24-f84c522ac9ed None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:01.582011 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:01.613572 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099e500f-5d75-4b55-a0b9-7cc64b3fbf2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:01.614426 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e500f-5d75-4b55-a0b9-7cc64b3fbf2f None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:01.614716 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e500f-5d75-4b55-a0b9-7cc64b3fbf2f None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:01.614979 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e500f-5d75-4b55-a0b9-7cc64b3fbf2f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:01.624223 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f5268b-25fc-43fa-b804-4d4880cab973 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:01.628208 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099e500f-5d75-4b55-a0b9-7cc64b3fbf2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:22:01.636700 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-099e500f-5d75-4b55-a0b9-7cc64b3fbf2f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:22:01.636700 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:01.636700 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:01.636700 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:01.636700 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:01.636700 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:01.636700 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:01.636700 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:01.636700 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:01.636700 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:01.636700 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:01.636700 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:01.636700 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:22:01.636700 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:22:01.636700 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:22:01.636700 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:22:01.640203 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:22:01.640203 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:22:01.640203 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:22:01.640203 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:22:01.640203 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:01.640203 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:01.640203 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:01.640203 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:01.640203 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:01.640203 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:01.640203 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:01.640203 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:01.640203 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:01.640203 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:01.640203 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:01.640203 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:01.648658 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:01.648658 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:01.648658 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:01.648658 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:01.648658 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:22:01.648658 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:22:01.648658 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:22:01.648658 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:22:01.648658 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:22:01.648658 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:22:01.648658 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:22:01.648658 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:01.648658 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 258/493] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Jul 1 19:22:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:01.648658 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099e500f-5d75-4b55-a0b9-7cc64b3fbf2f None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:01.699030 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7233a252-0dcf-4393-9937-329581d5dd29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:01.700319 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7233a252-0dcf-4393-9937-329581d5dd29 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:01.700950 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7233a252-0dcf-4393-9937-329581d5dd29 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:01.701666 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7233a252-0dcf-4393-9937-329581d5dd29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:01.754190 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:01.776408 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099e500f-5d75-4b55-a0b9-7cc64b3fbf2f None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:01.846742 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd4d5ea-a019-485a-9d27-1997f4adfde0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:01.847900 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd4d5ea-a019-485a-9d27-1997f4adfde0 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:01.848519 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd4d5ea-a019-485a-9d27-1997f4adfde0 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:01.849028 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd4d5ea-a019-485a-9d27-1997f4adfde0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:01.871879 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd4d5ea-a019-485a-9d27-1997f4adfde0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:22:01.886350 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-2bd4d5ea-a019-485a-9d27-1997f4adfde0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:22:01.886350 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:01.886350 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:01.886350 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:01.886350 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:01.886350 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:01.886350 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:01.886350 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:01.886350 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:01.886350 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:01.886350 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:01.886350 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:01.886350 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:22:01.886350 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:22:01.886350 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:22:01.886350 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:22:01.887503 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:22:01.887503 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:22:01.887503 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:22:01.887503 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:22:01.887503 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:01.887503 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:01.887503 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:01.887503 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:01.887503 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:01.887503 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:01.887503 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:01.887503 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:01.887503 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:01.887503 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:01.887503 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:01.887503 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:01.888307 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:01.888307 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:01.888307 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:01.888307 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:01.888307 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:22:01.888307 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:22:01.888307 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:22:01.888307 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:22:01.888307 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:22:01.888307 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:22:01.888307 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:22:01.888307 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:01.892373 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 259/494] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Jul 1 19:22:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:01.893457 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd4d5ea-a019-485a-9d27-1997f4adfde0 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:01.902412 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7233a252-0dcf-4393-9937-329581d5dd29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:01.904402 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7233a252-0dcf-4393-9937-329581d5dd29 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:01.943735 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:02.027538 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd4d5ea-a019-485a-9d27-1997f4adfde0 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:02.067343 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6920ccf0-1459-49b2-9493-d64edd1f1bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:02.068477 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920ccf0-1459-49b2-9493-d64edd1f1bfa None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:02.069011 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920ccf0-1459-49b2-9493-d64edd1f1bfa None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:02.069706 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920ccf0-1459-49b2-9493-d64edd1f1bfa None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:02.071210 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6920ccf0-1459-49b2-9493-d64edd1f1bfa None admin] RBAC: Adding query filter params (name=service) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:02.071872 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6920ccf0-1459-49b2-9493-d64edd1f1bfa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:02.073664 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6920ccf0-1459-49b2-9493-d64edd1f1bfa None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:02.083966 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 260/495] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Jul 1 19:22:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:02.085132 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6920ccf0-1459-49b2-9493-d64edd1f1bfa None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:02.105353 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 236/496] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Jul 1 19:22:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 694 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 01 19:22:02.105353 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e07342-2438-42fc-88fa-09e004437464 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:02.105353 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e07342-2438-42fc-88fa-09e004437464 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:02.105353 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e07342-2438-42fc-88fa-09e004437464 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:02.107023 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 237/497] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:22:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:22:02.115144 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e07342-2438-42fc-88fa-09e004437464 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:02.214370 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:02.217701 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:02.226517 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6920ccf0-1459-49b2-9493-d64edd1f1bfa None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:02.265689 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66017a5a-ef6d-4e16-b33c-e3a788522d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:02.266367 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66017a5a-ef6d-4e16-b33c-e3a788522d3c None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:02.266656 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66017a5a-ef6d-4e16-b33c-e3a788522d3c None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:02.266938 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66017a5a-ef6d-4e16-b33c-e3a788522d3c None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:02.267691 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66017a5a-ef6d-4e16-b33c-e3a788522d3c None admin] RBAC: Adding query filter params (name=service) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:02.268004 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66017a5a-ef6d-4e16-b33c-e3a788522d3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:02.269411 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66017a5a-ef6d-4e16-b33c-e3a788522d3c None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:02.278151 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 261/498] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Jul 1 19:22:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:02.278816 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66017a5a-ef6d-4e16-b33c-e3a788522d3c None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:02.296762 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e07342-2438-42fc-88fa-09e004437464 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:02.345309 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450f7af3-c8ec-4f10-9c41-9f77f030f279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:02.346620 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f7af3-c8ec-4f10-9c41-9f77f030f279 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:02.347126 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f7af3-c8ec-4f10-9c41-9f77f030f279 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:02.347453 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f7af3-c8ec-4f10-9c41-9f77f030f279 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:02.359347 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450f7af3-c8ec-4f10-9c41-9f77f030f279 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:02.360756 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450f7af3-c8ec-4f10-9c41-9f77f030f279 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:02.379156 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-450f7af3-c8ec-4f10-9c41-9f77f030f279 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:02.379156 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:02.379156 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:02.379156 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:02.379156 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:02.379156 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:02.379156 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:02.379156 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:02.379156 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:02.379156 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:02.379156 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:02.379156 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:02.379156 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:22:02.379156 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:22:02.379156 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:22:02.380700 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:22:02.380700 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:02.380700 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:02.380700 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:02.380700 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:02.380700 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:02.380700 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:02.380700 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:02.380700 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:02.380700 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:02.380700 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:02.380700 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:02.380700 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:02.380700 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:02.380700 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:02.380700 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:02.380700 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:02.382356 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:22:02.382356 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:22:02.382356 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:02.382356 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:02.382356 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 238/499] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:22:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:02.382356 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506a7bf-c04f-4087-957e-5735179da216 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:02.382356 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506a7bf-c04f-4087-957e-5735179da216 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:02.382356 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506a7bf-c04f-4087-957e-5735179da216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:02.400972 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-f506a7bf-c04f-4087-957e-5735179da216 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:22:02.402168 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-f506a7bf-c04f-4087-957e-5735179da216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:22:02.404952 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66017a5a-ef6d-4e16-b33c-e3a788522d3c None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:02.447244 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e5282a-a629-4e36-bf4c-f7c095649e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:02.448038 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e5282a-a629-4e36-bf4c-f7c095649e3e None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:02.448328 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e5282a-a629-4e36-bf4c-f7c095649e3e None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:02.448605 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e5282a-a629-4e36-bf4c-f7c095649e3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:02.459792 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e5282a-a629-4e36-bf4c-f7c095649e3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:02.461549 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e5282a-a629-4e36-bf4c-f7c095649e3e None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:02.479772 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-69e5282a-a629-4e36-bf4c-f7c095649e3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:02.479772 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:02.479772 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:02.479772 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:02.479772 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:02.479772 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:02.479772 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:02.479772 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:02.479772 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:02.479772 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:02.479772 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:02.479772 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:02.479772 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:22:02.479772 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:22:02.479772 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:22:02.480746 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:22:02.480746 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:02.480746 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:02.480746 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:02.480746 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:02.480746 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:02.480746 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:02.480746 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:02.480746 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:02.480746 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:02.480746 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:02.480746 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:02.480746 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:02.480746 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:02.480746 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:02.480746 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:02.480746 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:02.481656 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:22:02.481656 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:22:02.481656 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:02.481656 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:02.481656 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 262/500] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:22:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:02.482222 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e5282a-a629-4e36-bf4c-f7c095649e3e None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:02.487213 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:02.491834 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 239/501] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:22:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:22:02.492927 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f506a7bf-c04f-4087-957e-5735179da216 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:02.539355 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:02.603844 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e5282a-a629-4e36-bf4c-f7c095649e3e None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:02.624180 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f506a7bf-c04f-4087-957e-5735179da216 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:02.647858 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a522bc-2534-46a2-b4e5-344abd36b661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:02.648756 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a522bc-2534-46a2-b4e5-344abd36b661 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:02.649110 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a522bc-2534-46a2-b4e5-344abd36b661 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:02.649565 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a522bc-2534-46a2-b4e5-344abd36b661 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:02.661056 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a522bc-2534-46a2-b4e5-344abd36b661 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:02.662800 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a522bc-2534-46a2-b4e5-344abd36b661 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:02.669903 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bae59ca-1ca0-4b79-b308-d7e14a7270bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:02.670570 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bae59ca-1ca0-4b79-b308-d7e14a7270bd None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:02.670855 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bae59ca-1ca0-4b79-b308-d7e14a7270bd None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:02.671499 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bae59ca-1ca0-4b79-b308-d7e14a7270bd None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:02.671854 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bae59ca-1ca0-4b79-b308-d7e14a7270bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:02.672166 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bae59ca-1ca0-4b79-b308-d7e14a7270bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:02.673602 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bae59ca-1ca0-4b79-b308-d7e14a7270bd None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:02.681323 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-38a522bc-2534-46a2-b4e5-344abd36b661 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:02.681323 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:02.681323 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:02.681323 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:02.681323 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:02.681323 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:02.681323 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:02.681323 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:02.681323 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:02.681323 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:02.681323 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:02.681323 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:02.681323 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:22:02.681323 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:22:02.681323 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:22:02.682893 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:22:02.682893 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:02.682893 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:02.682893 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:02.682893 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:02.682893 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:02.682893 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:02.682893 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:02.682893 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:02.682893 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:02.682893 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:02.682893 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:02.682893 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:02.682893 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:02.682893 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:02.682893 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:02.682893 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:02.684541 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:22:02.684541 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:22:02.684541 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:02.684541 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:02.684541 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 263/502] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:22:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:02.684541 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a522bc-2534-46a2-b4e5-344abd36b661 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:02.696779 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 240/503] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Jul 1 19:22:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:02.696779 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bae59ca-1ca0-4b79-b308-d7e14a7270bd None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:02.747586 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:02.796874 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a522bc-2534-46a2-b4e5-344abd36b661 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:02.797250 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:02.805062 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bae59ca-1ca0-4b79-b308-d7e14a7270bd None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:02.832417 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0624c94-c78f-46f1-abed-a460f08fa033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:02.833076 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0624c94-c78f-46f1-abed-a460f08fa033 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:02.833404 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0624c94-c78f-46f1-abed-a460f08fa033 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:02.833774 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0624c94-c78f-46f1-abed-a460f08fa033 None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:02.834588 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0624c94-c78f-46f1-abed-a460f08fa033 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:02.835084 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0624c94-c78f-46f1-abed-a460f08fa033 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:02.836873 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0624c94-c78f-46f1-abed-a460f08fa033 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:02.843572 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520ca0a3-1507-4b60-b3a4-1d8178be2b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:02.844365 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520ca0a3-1507-4b60-b3a4-1d8178be2b12 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:02.844647 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520ca0a3-1507-4b60-b3a4-1d8178be2b12 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:02.844922 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520ca0a3-1507-4b60-b3a4-1d8178be2b12 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:02.849177 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 264/504] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Jul 1 19:22:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:02.850491 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ade6f-5700-43de-8b24-4879d512962a None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:02.850785 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ade6f-5700-43de-8b24-4879d512962a None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:02.851064 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ade6f-5700-43de-8b24-4879d512962a None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:02.852311 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 265/505] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:22:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:22:02.853007 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8ade6f-5700-43de-8b24-4879d512962a None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:02.860325 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520ca0a3-1507-4b60-b3a4-1d8178be2b12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:22:02.868146 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-520ca0a3-1507-4b60-b3a4-1d8178be2b12 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:22:02.868146 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:02.868146 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:02.868146 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:02.868146 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:02.868146 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:02.868146 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:02.868146 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:02.868146 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:02.868146 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:02.868146 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:02.868146 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:02.868146 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:22:02.868146 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:22:02.868146 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:22:02.868146 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:22:02.869061 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:22:02.869061 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:22:02.869061 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:22:02.869061 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:22:02.869061 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:02.869061 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:02.869061 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:02.869061 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:02.869061 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:02.869061 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:02.869061 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:02.869061 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:02.869061 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:02.869061 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:02.869061 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:02.869061 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:02.869886 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:02.869886 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:02.869886 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:02.869886 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:02.869886 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:22:02.869886 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:22:02.869886 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:22:02.869886 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:22:02.869886 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:22:02.869886 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:22:02.869886 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:22:02.869886 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:02.869886 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 241/506] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Jul 1 19:22:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:02.870984 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520ca0a3-1507-4b60-b3a4-1d8178be2b12 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:02.968365 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8ade6f-5700-43de-8b24-4879d512962a None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:02.983435 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520ca0a3-1507-4b60-b3a4-1d8178be2b12 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:02.986311 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:03.005383 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8f5342-f73a-4dba-b542-6cfa7d403f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:03.006052 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f5342-f73a-4dba-b542-6cfa7d403f3b None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:03.006370 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f5342-f73a-4dba-b542-6cfa7d403f3b None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:03.006644 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f5342-f73a-4dba-b542-6cfa7d403f3b None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:03.007367 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8f5342-f73a-4dba-b542-6cfa7d403f3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:03.007672 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8f5342-f73a-4dba-b542-6cfa7d403f3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:03.009040 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8f5342-f73a-4dba-b542-6cfa7d403f3b None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:03.020900 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 266/507] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Jul 1 19:22:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:03.021631 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c005a6a-2bc9-4b56-bc34-0e9fdb4a2a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:03.021839 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8f5342-f73a-4dba-b542-6cfa7d403f3b None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:03.022617 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c005a6a-2bc9-4b56-bc34-0e9fdb4a2a5a None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:03.023006 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c005a6a-2bc9-4b56-bc34-0e9fdb4a2a5a None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:03.023386 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c005a6a-2bc9-4b56-bc34-0e9fdb4a2a5a None admin] PATH_INFO: `/v3/users/glance` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:03.032996 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c005a6a-2bc9-4b56-bc34-0e9fdb4a2a5a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:03.034487 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c005a6a-2bc9-4b56-bc34-0e9fdb4a2a5a None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:03.050414 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-0c005a6a-2bc9-4b56-bc34-0e9fdb4a2a5a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 01 19:22:03.050414 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:03.050414 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:03.050414 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:03.050414 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:03.050414 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:03.050414 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:03.050414 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:03.050414 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:03.050414 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:03.050414 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:03.050414 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:03.050414 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 19:22:03.050414 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 19:22:03.050414 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 19:22:03.050414 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 19:22:03.051674 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:03.051674 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:03.051674 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 19:22:03.051674 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:22:03.051674 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 19:22:03.051674 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:22:03.051674 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:03.051674 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:03.051674 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:03.051674 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:03.051674 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:03.051674 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:03.051674 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:03.051674 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:03.051674 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:03.051674 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:03.051674 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:03.051674 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:03.052691 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:03.052691 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:03.052691 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 19:22:03.052691 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 19:22:03.052691 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 19:22:03.052691 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 19:22:03.052691 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 19:22:03.052691 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 19:22:03.052691 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 01 19:22:03.052691 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:03.052691 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 242/508] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Jul 1 19:22:02 2022] GET /identity/v3/users/glance => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:03.053784 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a85c08b-bf0f-4ba7-a132-9d8380873760 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:03.053784 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a85c08b-bf0f-4ba7-a132-9d8380873760 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:03.053909 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a85c08b-bf0f-4ba7-a132-9d8380873760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:03.070639 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-2a85c08b-bf0f-4ba7-a132-9d8380873760 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:22:03.071818 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-2a85c08b-bf0f-4ba7-a132-9d8380873760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:22:03.085704 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:03.143099 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8f5342-f73a-4dba-b542-6cfa7d403f3b None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:03.155774 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 243/509] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:22:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:22:03.156640 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a85c08b-bf0f-4ba7-a132-9d8380873760 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:03.189313 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209fb6a1-1063-47ff-99e2-d5e730a04cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:03.190136 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209fb6a1-1063-47ff-99e2-d5e730a04cdc None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:03.190419 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209fb6a1-1063-47ff-99e2-d5e730a04cdc None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:03.190687 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209fb6a1-1063-47ff-99e2-d5e730a04cdc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:03.198015 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209fb6a1-1063-47ff-99e2-d5e730a04cdc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:03.199490 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209fb6a1-1063-47ff-99e2-d5e730a04cdc None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:03.215763 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-209fb6a1-1063-47ff-99e2-d5e730a04cdc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:22:03.215763 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:03.215763 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:03.215763 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:03.215763 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:03.215763 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:03.215763 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:03.215763 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:03.215763 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:03.215763 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:03.215763 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:03.215763 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:03.215763 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 19:22:03.215763 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 19:22:03.215763 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 19:22:03.217314 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 19:22:03.217314 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:03.217314 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:03.217314 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:03.217314 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:03.217314 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:03.217314 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:03.217314 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:03.217314 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:03.217314 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:03.217314 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:03.217314 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:03.217314 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:03.217314 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:03.217314 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:03.217314 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:03.217314 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:03.218174 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 19:22:03.218174 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 19:22:03.218174 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 19:22:03.218174 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 19:22:03.218174 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 19:22:03.218174 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 19:22:03.218174 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:22:03.218174 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:03.218174 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 267/510] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Jul 1 19:22:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:03.218699 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209fb6a1-1063-47ff-99e2-d5e730a04cdc None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:03.268037 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:03.279884 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a85c08b-bf0f-4ba7-a132-9d8380873760 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:03.323256 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183a6ed4-3320-4c80-9f97-6e55bfb07d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:03.324155 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a6ed4-3320-4c80-9f97-6e55bfb07d5e None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:03.324440 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a6ed4-3320-4c80-9f97-6e55bfb07d5e None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:03.324720 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a6ed4-3320-4c80-9f97-6e55bfb07d5e None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:03.326234 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183a6ed4-3320-4c80-9f97-6e55bfb07d5e None admin] RBAC: Adding query filter params (name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:03.326234 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183a6ed4-3320-4c80-9f97-6e55bfb07d5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:03.327341 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183a6ed4-3320-4c80-9f97-6e55bfb07d5e None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:03.342857 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 244/511] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Jul 1 19:22:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:03.342857 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183a6ed4-3320-4c80-9f97-6e55bfb07d5e None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:03.343854 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209fb6a1-1063-47ff-99e2-d5e730a04cdc None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:03.350147 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:03.380595 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89fd034-b971-4a65-8d52-3c15fa8b7134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:03.381439 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89fd034-b971-4a65-8d52-3c15fa8b7134 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:03.381723 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89fd034-b971-4a65-8d52-3c15fa8b7134 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:03.381999 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89fd034-b971-4a65-8d52-3c15fa8b7134 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:03.389996 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89fd034-b971-4a65-8d52-3c15fa8b7134 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:03.391474 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89fd034-b971-4a65-8d52-3c15fa8b7134 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:03.415767 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-b89fd034-b971-4a65-8d52-3c15fa8b7134 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 01 19:22:03.415767 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:03.415767 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:03.415767 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:03.415767 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:03.415767 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:03.415767 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:03.415767 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:03.415767 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:03.415767 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:03.415767 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:03.415767 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:03.415767 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 19:22:03.415767 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 19:22:03.415767 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 19:22:03.415767 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 19:22:03.418048 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:03.418048 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:03.418048 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 19:22:03.418048 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:22:03.418048 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 19:22:03.418048 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:22:03.418048 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:03.418048 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:03.418048 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:03.418048 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:03.418048 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:03.418048 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:03.418048 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:03.418048 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:03.418048 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:03.418048 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:03.418048 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:03.418048 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:03.419428 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:03.419428 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:03.419428 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 19:22:03.419428 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 19:22:03.419428 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 19:22:03.419428 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 19:22:03.419428 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 19:22:03.419428 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 19:22:03.419428 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 01 19:22:03.419428 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:03.419428 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 268/512] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Jul 1 19:22:03 2022] GET /identity/v3/users/neutron => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:03.420925 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89fd034-b971-4a65-8d52-3c15fa8b7134 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:03.468600 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183a6ed4-3320-4c80-9f97-6e55bfb07d5e None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:03.506841 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f305b5c-4de5-4dfd-a87f-80624df31105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:03.507762 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f305b5c-4de5-4dfd-a87f-80624df31105 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:03.508048 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f305b5c-4de5-4dfd-a87f-80624df31105 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:03.508329 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f305b5c-4de5-4dfd-a87f-80624df31105 None admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:03.509176 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f305b5c-4de5-4dfd-a87f-80624df31105 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:03.509523 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f305b5c-4de5-4dfd-a87f-80624df31105 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:03.510978 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f305b5c-4de5-4dfd-a87f-80624df31105 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:03.538296 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 245/513] 10.222.0.26 () {56 vars in 1137 bytes} [Fri Jul 1 19:22:03 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:03.539617 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f305b5c-4de5-4dfd-a87f-80624df31105 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:03.548300 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:03.555344 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89fd034-b971-4a65-8d52-3c15fa8b7134 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:03.597552 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16fc6cf-7a6d-4340-aafb-4210b98fbbff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:03.598353 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16fc6cf-7a6d-4340-aafb-4210b98fbbff None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:03.598642 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16fc6cf-7a6d-4340-aafb-4210b98fbbff None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:03.598923 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16fc6cf-7a6d-4340-aafb-4210b98fbbff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:03.610696 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:03.611473 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16fc6cf-7a6d-4340-aafb-4210b98fbbff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:03.613393 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16fc6cf-7a6d-4340-aafb-4210b98fbbff None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:03.636569 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-d16fc6cf-7a6d-4340-aafb-4210b98fbbff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:03.636569 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:03.636569 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:03.636569 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:03.636569 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:03.636569 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:03.636569 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:03.636569 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:03.636569 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:03.636569 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:03.636569 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:03.636569 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:03.636569 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:22:03.636569 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:22:03.636569 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:22:03.637776 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:22:03.637776 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:03.637776 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:03.637776 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:03.637776 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:03.637776 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:03.637776 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:03.637776 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:03.637776 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:03.637776 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:03.637776 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:03.637776 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:03.637776 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:03.637776 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:03.637776 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:03.637776 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:03.637776 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:03.638669 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:22:03.638669 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:22:03.638669 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:03.638669 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:03.639313 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 269/514] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:22:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:03.640401 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16fc6cf-7a6d-4340-aafb-4210b98fbbff None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:03.670966 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f305b5c-4de5-4dfd-a87f-80624df31105 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:03.711013 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1318728-7cdd-4da9-a7b7-b7edd40fccb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:03.711686 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1318728-7cdd-4da9-a7b7-b7edd40fccb6 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:03.711971 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1318728-7cdd-4da9-a7b7-b7edd40fccb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:03.712536 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1318728-7cdd-4da9-a7b7-b7edd40fccb6 None admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:03.713049 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1318728-7cdd-4da9-a7b7-b7edd40fccb6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:03.713400 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1318728-7cdd-4da9-a7b7-b7edd40fccb6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:03.714865 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1318728-7cdd-4da9-a7b7-b7edd40fccb6 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:03.734940 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 246/515] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Jul 1 19:22:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:03.735809 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1318728-7cdd-4da9-a7b7-b7edd40fccb6 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:03.766128 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16fc6cf-7a6d-4340-aafb-4210b98fbbff None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:03.806189 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbe3877-23bf-4e5e-ab68-93a0249d4f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:03.809208 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe3877-23bf-4e5e-ab68-93a0249d4f85 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:03.809208 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe3877-23bf-4e5e-ab68-93a0249d4f85 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:03.809542 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe3877-23bf-4e5e-ab68-93a0249d4f85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:03.821891 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbe3877-23bf-4e5e-ab68-93a0249d4f85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:03.823795 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbe3877-23bf-4e5e-ab68-93a0249d4f85 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:03.834945 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:03.847412 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-fbbe3877-23bf-4e5e-ab68-93a0249d4f85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:03.847412 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:03.847412 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:03.847412 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:03.847412 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:03.847412 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:03.847412 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:03.847412 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:03.847412 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:03.847412 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:03.847412 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:03.847412 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:03.847412 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:22:03.847412 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:22:03.847412 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:22:03.848473 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:22:03.848473 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:03.848473 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:03.848473 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:03.848473 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:03.848473 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:03.848473 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:03.848473 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:03.848473 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:03.848473 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:03.848473 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:03.848473 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:03.848473 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:03.848473 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:03.848473 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:03.848473 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:03.848473 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:03.850396 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:22:03.850396 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:22:03.850396 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:03.850396 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:03.850792 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1318728-7cdd-4da9-a7b7-b7edd40fccb6 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:03.850923 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 270/516] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:22:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:03.850923 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbe3877-23bf-4e5e-ab68-93a0249d4f85 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:03.880054 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:03.892294 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76dcf60-b4bd-48a9-acb2-d586fa9b6039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:03.892965 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76dcf60-b4bd-48a9-acb2-d586fa9b6039 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:03.893274 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76dcf60-b4bd-48a9-acb2-d586fa9b6039 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:03.893555 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76dcf60-b4bd-48a9-acb2-d586fa9b6039 None admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:03.894396 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76dcf60-b4bd-48a9-acb2-d586fa9b6039 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:03.894703 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76dcf60-b4bd-48a9-acb2-d586fa9b6039 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:03.896164 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76dcf60-b4bd-48a9-acb2-d586fa9b6039 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:03.914099 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 247/517] 10.222.0.26 () {56 vars in 1139 bytes} [Fri Jul 1 19:22:03 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:03.914927 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76dcf60-b4bd-48a9-acb2-d586fa9b6039 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:03.962010 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbe3877-23bf-4e5e-ab68-93a0249d4f85 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:03.997587 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5104d7-9f37-4b0e-a8d5-2ad9d8981644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:03.998749 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5104d7-9f37-4b0e-a8d5-2ad9d8981644 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:03.999037 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5104d7-9f37-4b0e-a8d5-2ad9d8981644 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:03.999320 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5104d7-9f37-4b0e-a8d5-2ad9d8981644 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:04.030220 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76dcf60-b4bd-48a9-acb2-d586fa9b6039 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:04.068260 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945384ec-eb28-4abf-a5a3-861fd26dce8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:04.068924 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945384ec-eb28-4abf-a5a3-861fd26dce8e None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:04.069223 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945384ec-eb28-4abf-a5a3-861fd26dce8e None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:04.069535 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945384ec-eb28-4abf-a5a3-861fd26dce8e None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:04.070047 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:04.070239 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945384ec-eb28-4abf-a5a3-861fd26dce8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:04.070558 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945384ec-eb28-4abf-a5a3-861fd26dce8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:04.071965 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945384ec-eb28-4abf-a5a3-861fd26dce8e None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:04.072738 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5104d7-9f37-4b0e-a8d5-2ad9d8981644 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:04.074907 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5104d7-9f37-4b0e-a8d5-2ad9d8981644 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:04.083933 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 248/518] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Jul 1 19:22:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:04.084769 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945384ec-eb28-4abf-a5a3-861fd26dce8e None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:04.136819 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:04.181859 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 271/519] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Jul 1 19:22:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 19:22:04.182715 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5104d7-9f37-4b0e-a8d5-2ad9d8981644 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:04.209218 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945384ec-eb28-4abf-a5a3-861fd26dce8e None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:04.253639 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ad6182-b16b-4d2a-93ac-67671cd90aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:04.254398 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ad6182-b16b-4d2a-93ac-67671cd90aa6 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:04.254863 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ad6182-b16b-4d2a-93ac-67671cd90aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:04.255277 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ad6182-b16b-4d2a-93ac-67671cd90aa6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:04.256315 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ad6182-b16b-4d2a-93ac-67671cd90aa6 None admin] RBAC: Adding query filter params (role.id=35ca0f0b9a964300a63780ec435e730b, scope.project.id=69c523a41f4048cfb7df553b6feb6310, user.id=13fd76fc7dd1410b9cde5adbaa6cb2e5) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:04.256718 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ad6182-b16b-4d2a-93ac-67671cd90aa6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:04.258644 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ad6182-b16b-4d2a-93ac-67671cd90aa6 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:04.265333 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 249/520] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Jul 1 19:22:04 2022] GET /identity/v3/role_assignments?user.id=13fd76fc7dd1410b9cde5adbaa6cb2e5&scope.project.id=69c523a41f4048cfb7df553b6feb6310&role.id=35ca0f0b9a964300a63780ec435e730b => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:04.266383 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ad6182-b16b-4d2a-93ac-67671cd90aa6 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:04.316219 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:04.322671 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5104d7-9f37-4b0e-a8d5-2ad9d8981644 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:04.371907 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd5262-27e6-4b62-a186-9e523ce849b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:04.373873 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd5262-27e6-4b62-a186-9e523ce849b7 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:04.374567 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd5262-27e6-4b62-a186-9e523ce849b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:04.376708 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd5262-27e6-4b62-a186-9e523ce849b7 None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:04.378120 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbd5262-27e6-4b62-a186-9e523ce849b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:04.378834 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbd5262-27e6-4b62-a186-9e523ce849b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:04.381899 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbd5262-27e6-4b62-a186-9e523ce849b7 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:04.401907 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 272/521] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Jul 1 19:22:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:04.403750 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd5262-27e6-4b62-a186-9e523ce849b7 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:04.412669 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ad6182-b16b-4d2a-93ac-67671cd90aa6 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:04.422305 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:04.459103 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ec20e-44b9-4eb1-80f1-87e0a026930f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:04.460013 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ec20e-44b9-4eb1-80f1-87e0a026930f None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:04.460309 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ec20e-44b9-4eb1-80f1-87e0a026930f None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:04.460595 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ec20e-44b9-4eb1-80f1-87e0a026930f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:04.534555 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd5262-27e6-4b62-a186-9e523ce849b7 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:04.550639 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92ec20e-44b9-4eb1-80f1-87e0a026930f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:04.553615 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92ec20e-44b9-4eb1-80f1-87e0a026930f None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:04.586104 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2fbc94-d71b-4874-be03-137bb83a3a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:04.587130 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2fbc94-d71b-4874-be03-137bb83a3a6f None admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:04.587818 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2fbc94-d71b-4874-be03-137bb83a3a6f None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:04.588256 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2fbc94-d71b-4874-be03-137bb83a3a6f None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:04.588985 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2fbc94-d71b-4874-be03-137bb83a3a6f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:04.590631 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2fbc94-d71b-4874-be03-137bb83a3a6f None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:04.619253 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 273/522] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Jul 1 19:22:04 2022] POST /identity/v3/users => generated 247 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:22:04.620403 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2fbc94-d71b-4874-be03-137bb83a3a6f None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:04.666308 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:04.752536 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 250/523] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Jul 1 19:22:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 19:22:04.755561 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ec20e-44b9-4eb1-80f1-87e0a026930f None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:04.774405 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:04.783220 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2fbc94-d71b-4874-be03-137bb83a3a6f None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:04.854403 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2498d78-e597-4787-ba6c-2e4ab94db5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:04.854641 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2498d78-e597-4787-ba6c-2e4ab94db5c2 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:04.854835 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2498d78-e597-4787-ba6c-2e4ab94db5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:04.855109 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2498d78-e597-4787-ba6c-2e4ab94db5c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:04.867759 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2498d78-e597-4787-ba6c-2e4ab94db5c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:04.869109 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2498d78-e597-4787-ba6c-2e4ab94db5c2 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:04.888007 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-f2498d78-e597-4787-ba6c-2e4ab94db5c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:04.888007 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:04.888007 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:04.888007 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:04.888007 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:04.888007 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:04.888007 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:04.888007 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:04.888007 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:04.888007 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:04.888007 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:04.888007 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:04.888007 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:22:04.888007 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:22:04.888007 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:22:04.889682 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:22:04.889682 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:04.889682 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:04.889682 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:04.889682 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:04.889682 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:04.889682 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:04.889682 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:04.889682 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:04.889682 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:04.889682 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:04.889682 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:04.889682 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:04.889682 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:04.889682 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:04.889682 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:04.889682 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:04.890555 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:22:04.890555 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:22:04.890555 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:04.890555 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:04.890555 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 274/524] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:22:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:04.890827 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2498d78-e597-4787-ba6c-2e4ab94db5c2 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:04.919383 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ec20e-44b9-4eb1-80f1-87e0a026930f None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:04.973998 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:04.978592 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c81f86-4d3b-4dd5-898f-8fe49cd045d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:04.982089 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c81f86-4d3b-4dd5-898f-8fe49cd045d0 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:04.983060 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c81f86-4d3b-4dd5-898f-8fe49cd045d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:04.983487 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c81f86-4d3b-4dd5-898f-8fe49cd045d0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:04.999269 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c81f86-4d3b-4dd5-898f-8fe49cd045d0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:05.002549 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c81f86-4d3b-4dd5-898f-8fe49cd045d0 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:05.019313 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2498d78-e597-4787-ba6c-2e4ab94db5c2 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:05.037411 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-d1c81f86-4d3b-4dd5-898f-8fe49cd045d0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 01 19:22:05.037411 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:05.037411 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:05.037411 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:05.037411 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:05.037411 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:05.037411 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:05.037411 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:05.037411 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:05.037411 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:05.037411 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:05.037411 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:05.037411 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 19:22:05.037411 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 19:22:05.037411 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 19:22:05.037411 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 19:22:05.038369 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:05.038369 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:05.038369 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 19:22:05.038369 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:22:05.038369 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 19:22:05.038369 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:22:05.038369 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:05.038369 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:05.038369 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:05.038369 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:05.038369 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:05.038369 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:05.038369 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:05.038369 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:05.038369 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:05.038369 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:05.038369 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:05.038369 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:05.039253 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:05.039253 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:05.039253 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 19:22:05.039253 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 19:22:05.039253 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 19:22:05.039253 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 19:22:05.039253 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 19:22:05.039253 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 19:22:05.039253 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 01 19:22:05.039253 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:05.040690 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 251/525] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Jul 1 19:22:04 2022] GET /identity/v3/users/cinder => generated 84 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:05.041796 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c81f86-4d3b-4dd5-898f-8fe49cd045d0 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:05.069330 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c5f957-672e-46d6-a90a-f0d438035c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:05.070346 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5f957-672e-46d6-a90a-f0d438035c8e None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:05.070701 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5f957-672e-46d6-a90a-f0d438035c8e None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:05.071044 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5f957-672e-46d6-a90a-f0d438035c8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:05.084986 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c5f957-672e-46d6-a90a-f0d438035c8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:05.087246 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c5f957-672e-46d6-a90a-f0d438035c8e None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:05.112808 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-93c5f957-672e-46d6-a90a-f0d438035c8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:05.112808 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:05.112808 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:05.112808 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:05.112808 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:05.112808 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:05.112808 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:05.112808 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:05.112808 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:05.112808 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:05.112808 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:05.112808 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:05.112808 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:22:05.112808 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:22:05.112808 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:22:05.114190 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:22:05.114190 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:05.114190 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:05.114190 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:05.114190 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:05.114190 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:05.114190 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:05.114190 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:05.114190 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:05.114190 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:05.114190 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:05.114190 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:05.114190 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:05.114190 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:05.114190 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:05.114190 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:05.114190 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:05.115564 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:22:05.115564 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:22:05.115564 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:05.115564 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:05.115564 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 275/526] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:22:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:05.115564 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c5f957-672e-46d6-a90a-f0d438035c8e None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:05.176453 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:05.244270 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c5f957-672e-46d6-a90a-f0d438035c8e None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:05.252176 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c81f86-4d3b-4dd5-898f-8fe49cd045d0 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:05.271627 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:05.289916 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a9b317-a2cf-4eee-92f2-f6fa851eada1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:05.290937 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a9b317-a2cf-4eee-92f2-f6fa851eada1 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:05.291417 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a9b317-a2cf-4eee-92f2-f6fa851eada1 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:05.291891 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a9b317-a2cf-4eee-92f2-f6fa851eada1 None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:05.292969 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a9b317-a2cf-4eee-92f2-f6fa851eada1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:05.293448 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a9b317-a2cf-4eee-92f2-f6fa851eada1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:05.295827 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a9b317-a2cf-4eee-92f2-f6fa851eada1 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:05.300429 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e71873d-685e-4b45-bb18-05a89cd407c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:05.301258 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e71873d-685e-4b45-bb18-05a89cd407c8 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:05.301634 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e71873d-685e-4b45-bb18-05a89cd407c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:05.302017 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e71873d-685e-4b45-bb18-05a89cd407c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:05.302885 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e71873d-685e-4b45-bb18-05a89cd407c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:05.303557 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e71873d-685e-4b45-bb18-05a89cd407c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:05.305045 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e71873d-685e-4b45-bb18-05a89cd407c8 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:05.319873 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 252/527] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Jul 1 19:22:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:05.320877 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e71873d-685e-4b45-bb18-05a89cd407c8 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:05.344096 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 276/528] 10.222.0.26 () {56 vars in 1137 bytes} [Fri Jul 1 19:22:05 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:05.345272 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a9b317-a2cf-4eee-92f2-f6fa851eada1 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:05.445790 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e71873d-685e-4b45-bb18-05a89cd407c8 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:05.456225 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a9b317-a2cf-4eee-92f2-f6fa851eada1 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:05.489162 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:05.492582 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a950d8-515d-49e2-bcd5-cd752444eb88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:05.493077 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c0884b-17f2-4be3-967e-5486588f8279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:05.493750 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a950d8-515d-49e2-bcd5-cd752444eb88 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:05.495384 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c0884b-17f2-4be3-967e-5486588f8279 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:05.495488 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a950d8-515d-49e2-bcd5-cd752444eb88 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:05.495574 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c0884b-17f2-4be3-967e-5486588f8279 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:05.495656 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a950d8-515d-49e2-bcd5-cd752444eb88 None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:05.495736 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c0884b-17f2-4be3-967e-5486588f8279 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:05.495832 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a950d8-515d-49e2-bcd5-cd752444eb88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:05.495980 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a950d8-515d-49e2-bcd5-cd752444eb88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:05.497938 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a950d8-515d-49e2-bcd5-cd752444eb88 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:05.502834 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c0884b-17f2-4be3-967e-5486588f8279 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:05.504407 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c0884b-17f2-4be3-967e-5486588f8279 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:05.512608 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 253/529] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Jul 1 19:22:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:05.513597 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a950d8-515d-49e2-bcd5-cd752444eb88 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:05.523900 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-d1c0884b-17f2-4be3-967e-5486588f8279 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:22:05.523900 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:05.523900 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:05.523900 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:05.523900 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:05.523900 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:05.523900 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:05.523900 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:05.523900 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:05.523900 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:05.523900 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:05.523900 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:05.523900 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 19:22:05.523900 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 19:22:05.523900 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 19:22:05.524876 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 19:22:05.524876 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:05.524876 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:05.524876 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:05.524876 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:05.524876 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:05.524876 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:05.524876 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:05.524876 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:05.524876 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:05.524876 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:05.524876 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:05.524876 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:05.524876 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:05.524876 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:05.524876 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:05.524876 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:05.525760 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 19:22:05.525760 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 19:22:05.525760 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 19:22:05.525760 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 19:22:05.525760 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 19:22:05.525760 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 19:22:05.525760 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:22:05.525760 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:05.525760 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 277/530] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Jul 1 19:22:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:05.527019 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c0884b-17f2-4be3-967e-5486588f8279 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:05.579085 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:05.643396 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c0884b-17f2-4be3-967e-5486588f8279 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:05.654042 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a950d8-515d-49e2-bcd5-cd752444eb88 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:05.684685 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94c2c10-17c8-44f0-b052-df4b91a03926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:05.685863 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c2c10-17c8-44f0-b052-df4b91a03926 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:05.686255 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c2c10-17c8-44f0-b052-df4b91a03926 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:05.686655 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c2c10-17c8-44f0-b052-df4b91a03926 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:05.694089 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94c2c10-17c8-44f0-b052-df4b91a03926 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:05.695694 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94c2c10-17c8-44f0-b052-df4b91a03926 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:05.700816 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0732d6-c7fd-4aa3-b5a8-4284512e566d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:05.701961 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0732d6-c7fd-4aa3-b5a8-4284512e566d None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:05.702251 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0732d6-c7fd-4aa3-b5a8-4284512e566d None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:05.702534 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0732d6-c7fd-4aa3-b5a8-4284512e566d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:05.711742 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-c94c2c10-17c8-44f0-b052-df4b91a03926 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:22:05.711742 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:05.711742 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:05.711742 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:05.711742 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:05.711742 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:05.711742 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:05.711742 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:05.711742 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:05.711742 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:05.711742 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:05.711742 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:05.711742 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 19:22:05.711742 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 19:22:05.711742 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 19:22:05.712605 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 19:22:05.712605 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:05.712605 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:05.712605 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:05.712605 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:05.712605 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:05.712605 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:05.712605 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:05.712605 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:05.712605 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:05.712605 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:05.712605 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:05.712605 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:05.712605 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:05.712605 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:05.712605 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:05.712605 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:05.713463 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 19:22:05.713463 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 19:22:05.713463 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 19:22:05.713463 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 19:22:05.713463 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 19:22:05.713463 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 19:22:05.713463 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:22:05.713463 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:05.718743 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 278/531] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Jul 1 19:22:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:05.719780 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94c2c10-17c8-44f0-b052-df4b91a03926 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:05.781589 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:05.797724 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0732d6-c7fd-4aa3-b5a8-4284512e566d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:05.799439 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0732d6-c7fd-4aa3-b5a8-4284512e566d None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:05.830415 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:05.834971 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94c2c10-17c8-44f0-b052-df4b91a03926 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:05.874391 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a178e01-c95a-47e2-b93f-1f98d7cd703a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:05.875067 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a178e01-c95a-47e2-b93f-1f98d7cd703a None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:05.875352 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a178e01-c95a-47e2-b93f-1f98d7cd703a None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:05.875631 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a178e01-c95a-47e2-b93f-1f98d7cd703a None admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:05.876865 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a178e01-c95a-47e2-b93f-1f98d7cd703a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:05.876865 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a178e01-c95a-47e2-b93f-1f98d7cd703a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:05.878242 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a178e01-c95a-47e2-b93f-1f98d7cd703a None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:05.899365 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 279/532] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Jul 1 19:22:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:05.900356 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a178e01-c95a-47e2-b93f-1f98d7cd703a None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:05.912471 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 254/533] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Jul 1 19:22:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 19:22:05.913643 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0732d6-c7fd-4aa3-b5a8-4284512e566d None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:06.012039 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a178e01-c95a-47e2-b93f-1f98d7cd703a None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:06.024875 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0732d6-c7fd-4aa3-b5a8-4284512e566d None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:06.048974 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e50d3c-1aa3-4b74-802c-4ab715724cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:06.049687 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e50d3c-1aa3-4b74-802c-4ab715724cf9 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:06.049974 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e50d3c-1aa3-4b74-802c-4ab715724cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:06.050428 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e50d3c-1aa3-4b74-802c-4ab715724cf9 None admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:06.051233 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e50d3c-1aa3-4b74-802c-4ab715724cf9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:06.051547 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e50d3c-1aa3-4b74-802c-4ab715724cf9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:06.052996 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e50d3c-1aa3-4b74-802c-4ab715724cf9 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:06.057653 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:06.066314 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8273b038-b476-4e55-9226-bb8c9f710842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:06.067264 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273b038-b476-4e55-9226-bb8c9f710842 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:06.067773 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273b038-b476-4e55-9226-bb8c9f710842 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:06.068261 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273b038-b476-4e55-9226-bb8c9f710842 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:06.069330 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8273b038-b476-4e55-9226-bb8c9f710842 None admin] RBAC: Adding query filter params (role.id=35ca0f0b9a964300a63780ec435e730b, scope.project.id=69c523a41f4048cfb7df553b6feb6310, user.id=5bbcb2463f9c46ddaaa247e4876aca48) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:06.069854 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8273b038-b476-4e55-9226-bb8c9f710842 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:06.071521 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8273b038-b476-4e55-9226-bb8c9f710842 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:06.072110 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 280/534] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Jul 1 19:22:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:06.073165 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e50d3c-1aa3-4b74-802c-4ab715724cf9 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:06.079466 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 255/535] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Jul 1 19:22:05 2022] GET /identity/v3/role_assignments?user.id=5bbcb2463f9c46ddaaa247e4876aca48&scope.project.id=69c523a41f4048cfb7df553b6feb6310&role.id=35ca0f0b9a964300a63780ec435e730b => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:06.087984 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8273b038-b476-4e55-9226-bb8c9f710842 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:06.102830 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:06.228602 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e50d3c-1aa3-4b74-802c-4ab715724cf9 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:06.292685 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8273b038-b476-4e55-9226-bb8c9f710842 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:06.332921 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0accab1a-2672-4812-88de-6f1f8a0658ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:06.334072 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0accab1a-2672-4812-88de-6f1f8a0658ac None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:06.334564 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0accab1a-2672-4812-88de-6f1f8a0658ac None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:06.335041 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0accab1a-2672-4812-88de-6f1f8a0658ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:06.336088 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0accab1a-2672-4812-88de-6f1f8a0658ac None admin] RBAC: Adding query filter params (role.id=35ca0f0b9a964300a63780ec435e730b, scope.project.id=69c523a41f4048cfb7df553b6feb6310, user.id=4557d17438a249ee8f75927449a1a059) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:06.336641 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0accab1a-2672-4812-88de-6f1f8a0658ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:06.338628 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0accab1a-2672-4812-88de-6f1f8a0658ac None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:06.345848 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 256/536] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Jul 1 19:22:06 2022] GET /identity/v3/role_assignments?user.id=4557d17438a249ee8f75927449a1a059&scope.project.id=69c523a41f4048cfb7df553b6feb6310&role.id=35ca0f0b9a964300a63780ec435e730b => generated 259 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:06.360701 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5bd318-5d79-4641-ac00-24a9039c2d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:06.361568 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5bd318-5d79-4641-ac00-24a9039c2d86 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:06.361857 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5bd318-5d79-4641-ac00-24a9039c2d86 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:06.362135 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5bd318-5d79-4641-ac00-24a9039c2d86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:06.376347 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5bd318-5d79-4641-ac00-24a9039c2d86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:06.378749 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5bd318-5d79-4641-ac00-24a9039c2d86 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:06.430712 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-6d5bd318-5d79-4641-ac00-24a9039c2d86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:06.430712 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:06.430712 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:06.430712 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:06.430712 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:06.430712 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:06.430712 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:06.430712 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:06.430712 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:06.430712 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:06.430712 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:06.430712 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:06.430712 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:22:06.430712 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:22:06.430712 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:22:06.431632 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:22:06.431632 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:06.431632 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:06.431632 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:06.431632 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:06.431632 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:06.431632 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:06.431632 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:06.431632 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:06.431632 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:06.431632 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:06.431632 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:06.431632 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:06.431632 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:06.431632 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:06.431632 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:06.431632 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:06.432463 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:22:06.432463 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:22:06.432463 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:06.432463 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:06.432769 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af2e57-d2f2-42a6-9087-32adb8138637 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:06.433325 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 281/537] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:22:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:06.433898 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af2e57-d2f2-42a6-9087-32adb8138637 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:06.434387 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af2e57-d2f2-42a6-9087-32adb8138637 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:06.436418 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 257/538] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:22:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:22:06.440374 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5bd318-5d79-4641-ac00-24a9039c2d86 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:06.443052 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54eddfb-1c93-4473-94f3-d5ac6d358732 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:06.443573 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54eddfb-1c93-4473-94f3-d5ac6d358732 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:06.444075 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54eddfb-1c93-4473-94f3-d5ac6d358732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:06.490047 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-e54eddfb-1c93-4473-94f3-d5ac6d358732 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:22:06.491677 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-e54eddfb-1c93-4473-94f3-d5ac6d358732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:22:06.521648 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:06.597670 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:06.648815 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5bd318-5d79-4641-ac00-24a9039c2d86 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:06.704579 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d963cf5-00c3-4572-89f7-948bb8eba54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:06.705607 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d963cf5-00c3-4572-89f7-948bb8eba54e None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:06.706037 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d963cf5-00c3-4572-89f7-948bb8eba54e None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:06.706458 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d963cf5-00c3-4572-89f7-948bb8eba54e None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:06.707593 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d963cf5-00c3-4572-89f7-948bb8eba54e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:06.708064 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d963cf5-00c3-4572-89f7-948bb8eba54e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:06.710408 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d963cf5-00c3-4572-89f7-948bb8eba54e None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:06.719010 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 258/539] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:22:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 19:22:06.731764 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 282/540] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Jul 1 19:22:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:06.737157 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54eddfb-1c93-4473-94f3-d5ac6d358732 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:06.772375 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d963cf5-00c3-4572-89f7-948bb8eba54e None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:06.962166 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54eddfb-1c93-4473-94f3-d5ac6d358732 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:06.984907 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d963cf5-00c3-4572-89f7-948bb8eba54e None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:07.015539 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae53b42-1c7c-4f78-bf95-1dcf18a03d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:07.016723 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae53b42-1c7c-4f78-bf95-1dcf18a03d61 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:07.017177 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae53b42-1c7c-4f78-bf95-1dcf18a03d61 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:07.017644 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae53b42-1c7c-4f78-bf95-1dcf18a03d61 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:07.021329 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:07.028537 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6263f92f-498f-4ff4-a3fc-184c33a1834a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:07.029894 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6263f92f-498f-4ff4-a3fc-184c33a1834a None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:07.030370 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6263f92f-498f-4ff4-a3fc-184c33a1834a None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:07.030662 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6263f92f-498f-4ff4-a3fc-184c33a1834a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:07.030814 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae53b42-1c7c-4f78-bf95-1dcf18a03d61 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:07.033313 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae53b42-1c7c-4f78-bf95-1dcf18a03d61 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:07.042816 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6263f92f-498f-4ff4-a3fc-184c33a1834a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:22:07.050671 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-6263f92f-498f-4ff4-a3fc-184c33a1834a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:22:07.050671 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:07.050671 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:07.050671 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:07.050671 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:07.050671 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:07.050671 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:07.050671 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:07.050671 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:07.050671 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:07.050671 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:07.050671 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:07.050671 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:22:07.050671 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:22:07.050671 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:22:07.050671 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:22:07.051569 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:22:07.051569 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:22:07.051569 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:22:07.051569 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:22:07.051569 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:07.051569 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:07.051569 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:07.051569 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:07.051569 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:07.051569 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:07.051569 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:07.051569 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:07.051569 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:07.051569 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:07.051569 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:07.051569 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:07.052370 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:07.052370 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:07.052370 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:07.052370 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:07.052370 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:22:07.052370 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:22:07.052370 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:22:07.052370 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:22:07.052370 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:22:07.052370 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:22:07.052370 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:22:07.052370 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:07.052971 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 283/541] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Jul 1 19:22:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:07.057266 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf0297-e14f-4dbc-9af3-cd7ca5438833 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:07.057266 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf0297-e14f-4dbc-9af3-cd7ca5438833 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:07.057266 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf0297-e14f-4dbc-9af3-cd7ca5438833 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:07.060203 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 284/542] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:22:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:22:07.060893 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-6ae53b42-1c7c-4f78-bf95-1dcf18a03d61 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:22:07.060893 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:07.060893 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:07.060893 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:07.060893 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:07.060893 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:07.060893 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:07.060893 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:07.060893 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:07.060893 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:07.060893 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:07.060893 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:07.060893 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 19:22:07.060893 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 19:22:07.060893 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 19:22:07.062208 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 19:22:07.062208 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:07.062208 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:07.062208 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:07.062208 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:07.062208 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:07.062208 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:07.062208 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:07.062208 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:07.062208 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:07.062208 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:07.062208 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:07.062208 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:07.062208 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:07.062208 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:07.062208 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:07.062208 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:07.063395 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 19:22:07.063395 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 19:22:07.063395 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 19:22:07.063395 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 19:22:07.063395 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 19:22:07.063395 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 19:22:07.063395 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:22:07.063395 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:07.063915 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bf0297-e14f-4dbc-9af3-cd7ca5438833 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:07.069297 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 259/543] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Jul 1 19:22:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:07.069297 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b98f9d-7529-48e1-a84a-8430007ef710 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:07.069297 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b98f9d-7529-48e1-a84a-8430007ef710 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:07.069297 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b98f9d-7529-48e1-a84a-8430007ef710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:07.079385 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:07.096679 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-74b98f9d-7529-48e1-a84a-8430007ef710 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:22:07.098587 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-74b98f9d-7529-48e1-a84a-8430007ef710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:22:07.191960 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bf0297-e14f-4dbc-9af3-cd7ca5438833 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:07.203990 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 260/544] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:22:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:22:07.207494 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b98f9d-7529-48e1-a84a-8430007ef710 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:07.239300 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a71db3-c00a-4bcc-a425-8c23cf544bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:07.240298 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a71db3-c00a-4bcc-a425-8c23cf544bec None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:07.240742 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a71db3-c00a-4bcc-a425-8c23cf544bec None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:07.241193 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a71db3-c00a-4bcc-a425-8c23cf544bec None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:07.245458 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a71db3-c00a-4bcc-a425-8c23cf544bec None admin] RBAC: Adding query filter params (name=service) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:07.245458 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a71db3-c00a-4bcc-a425-8c23cf544bec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:07.248561 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a71db3-c00a-4bcc-a425-8c23cf544bec None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:07.263184 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 285/545] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Jul 1 19:22:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:22:07.264521 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a71db3-c00a-4bcc-a425-8c23cf544bec None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:07.332138 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:07.345593 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b98f9d-7529-48e1-a84a-8430007ef710 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:07.383971 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e02511-8bdf-428c-bc9e-825409e7b148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:07.385020 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e02511-8bdf-428c-bc9e-825409e7b148 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:07.385657 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e02511-8bdf-428c-bc9e-825409e7b148 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:07.386278 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e02511-8bdf-428c-bc9e-825409e7b148 None admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:07.387274 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e02511-8bdf-428c-bc9e-825409e7b148 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:07.387796 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e02511-8bdf-428c-bc9e-825409e7b148 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:07.389781 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e02511-8bdf-428c-bc9e-825409e7b148 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:07.392056 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:07.393449 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a71db3-c00a-4bcc-a425-8c23cf544bec None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:07.407184 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 261/546] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Jul 1 19:22:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:07.408465 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e02511-8bdf-428c-bc9e-825409e7b148 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:07.465636 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd8af7e-5bf1-4cdc-a8d7-8267a317e587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:07.466925 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd8af7e-5bf1-4cdc-a8d7-8267a317e587 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:07.467375 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd8af7e-5bf1-4cdc-a8d7-8267a317e587 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:07.468101 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd8af7e-5bf1-4cdc-a8d7-8267a317e587 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:07.486590 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd8af7e-5bf1-4cdc-a8d7-8267a317e587 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:22:07.494708 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-afd8af7e-5bf1-4cdc-a8d7-8267a317e587 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:22:07.494708 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:07.494708 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:07.494708 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:07.494708 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:07.494708 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:07.494708 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:07.494708 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:07.494708 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:07.494708 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:07.494708 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:07.494708 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:07.494708 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:22:07.494708 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:22:07.494708 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:22:07.494708 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:22:07.496088 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:22:07.496088 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:22:07.496088 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:22:07.496088 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:22:07.496088 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:07.496088 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:07.496088 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:07.496088 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:07.496088 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:07.496088 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:07.496088 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:07.496088 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:07.496088 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:07.496088 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:07.496088 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:07.496088 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:07.497427 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:07.497427 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:07.497427 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:07.497427 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:07.497427 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:22:07.497427 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:22:07.497427 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:22:07.497427 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:22:07.497427 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:22:07.497427 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:22:07.497427 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:22:07.497427 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:07.501433 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 286/547] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Jul 1 19:22:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:07.502313 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd8af7e-5bf1-4cdc-a8d7-8267a317e587 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:07.575011 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e02511-8bdf-428c-bc9e-825409e7b148 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:07.623822 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc71856-85a2-44a5-bb22-19af46999f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:07.624847 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc71856-85a2-44a5-bb22-19af46999f23 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:07.625333 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc71856-85a2-44a5-bb22-19af46999f23 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:07.625779 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc71856-85a2-44a5-bb22-19af46999f23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:07.653339 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd8af7e-5bf1-4cdc-a8d7-8267a317e587 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:07.653984 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc71856-85a2-44a5-bb22-19af46999f23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:07.656957 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc71856-85a2-44a5-bb22-19af46999f23 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:07.670868 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:07.691207 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-fcc71856-85a2-44a5-bb22-19af46999f23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:07.691207 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:07.691207 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:07.691207 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:07.691207 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:07.691207 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:07.691207 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:07.691207 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:07.691207 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:07.691207 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:07.691207 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:07.691207 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:07.691207 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:22:07.691207 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:22:07.691207 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:22:07.692187 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:22:07.692187 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:07.692187 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:07.692187 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:07.692187 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:07.692187 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:07.692187 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:07.692187 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:07.692187 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:07.692187 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:07.692187 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:07.692187 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:07.692187 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:07.692187 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:07.692187 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:07.692187 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:07.692187 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:07.693741 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:22:07.693741 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:22:07.693741 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:07.693741 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:07.696189 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 262/548] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:22:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:07.697221 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc71856-85a2-44a5-bb22-19af46999f23 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:07.713076 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95020789-3496-470a-8cfb-cac0488261f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:07.714158 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95020789-3496-470a-8cfb-cac0488261f0 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:07.714596 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95020789-3496-470a-8cfb-cac0488261f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:07.715023 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95020789-3496-470a-8cfb-cac0488261f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:07.717492 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95020789-3496-470a-8cfb-cac0488261f0 None admin] RBAC: Adding query filter params (role.id=35ca0f0b9a964300a63780ec435e730b, scope.project.id=69c523a41f4048cfb7df553b6feb6310, user.id=9a3ed285ee4c4d04abf7daf0aeb9fb7c) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:07.717984 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95020789-3496-470a-8cfb-cac0488261f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:07.721073 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95020789-3496-470a-8cfb-cac0488261f0 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:07.741269 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 287/549] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Jul 1 19:22:07 2022] GET /identity/v3/role_assignments?user.id=9a3ed285ee4c4d04abf7daf0aeb9fb7c&scope.project.id=69c523a41f4048cfb7df553b6feb6310&role.id=35ca0f0b9a964300a63780ec435e730b => generated 259 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:07.741269 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95020789-3496-470a-8cfb-cac0488261f0 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:07.782066 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:07.912810 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc71856-85a2-44a5-bb22-19af46999f23 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:07.936431 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95020789-3496-470a-8cfb-cac0488261f0 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:07.980159 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7805ec9a-3e53-4bc7-ba51-fd22048c0e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:07.981706 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7805ec9a-3e53-4bc7-ba51-fd22048c0e56 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:07.982740 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7805ec9a-3e53-4bc7-ba51-fd22048c0e56 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:07.983485 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7805ec9a-3e53-4bc7-ba51-fd22048c0e56 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:07.984485 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7805ec9a-3e53-4bc7-ba51-fd22048c0e56 None admin] RBAC: Adding query filter params (name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:07.985010 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7805ec9a-3e53-4bc7-ba51-fd22048c0e56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:07.986713 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7805ec9a-3e53-4bc7-ba51-fd22048c0e56 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:08.001662 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7985aa6-c99c-43ff-b582-70d00fcb5fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:08.002665 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7985aa6-c99c-43ff-b582-70d00fcb5fa0 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:08.003119 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7985aa6-c99c-43ff-b582-70d00fcb5fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:08.003596 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7985aa6-c99c-43ff-b582-70d00fcb5fa0 None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:08.004746 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7985aa6-c99c-43ff-b582-70d00fcb5fa0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:08.005225 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7985aa6-c99c-43ff-b582-70d00fcb5fa0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:08.007921 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7985aa6-c99c-43ff-b582-70d00fcb5fa0 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:08.008649 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 263/550] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Jul 1 19:22:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:08.017987 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7805ec9a-3e53-4bc7-ba51-fd22048c0e56 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:08.025905 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 288/551] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Jul 1 19:22:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:08.034145 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7985aa6-c99c-43ff-b582-70d00fcb5fa0 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:08.086987 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:08.224027 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7805ec9a-3e53-4bc7-ba51-fd22048c0e56 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:08.230330 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7985aa6-c99c-43ff-b582-70d00fcb5fa0 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:08.246509 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:08.293197 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ac3646-a2ba-43dc-b780-710273b3e5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:08.293928 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a832da3-91f5-4639-8bd2-6e1772496d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:08.295262 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a832da3-91f5-4639-8bd2-6e1772496d1a None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:08.295552 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a832da3-91f5-4639-8bd2-6e1772496d1a None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:08.295822 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a832da3-91f5-4639-8bd2-6e1772496d1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:08.297077 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ac3646-a2ba-43dc-b780-710273b3e5e8 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:08.297387 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ac3646-a2ba-43dc-b780-710273b3e5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:08.297666 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ac3646-a2ba-43dc-b780-710273b3e5e8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:08.312822 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ac3646-a2ba-43dc-b780-710273b3e5e8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:08.314310 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ac3646-a2ba-43dc-b780-710273b3e5e8 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:08.321367 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a832da3-91f5-4639-8bd2-6e1772496d1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:08.322846 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a832da3-91f5-4639-8bd2-6e1772496d1a None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:08.344480 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-c6ac3646-a2ba-43dc-b780-710273b3e5e8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 01 19:22:08.344480 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:08.344480 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:08.344480 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:08.344480 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:08.344480 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:08.344480 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:08.344480 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:08.344480 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:08.344480 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:08.344480 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:08.344480 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:08.344480 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 19:22:08.344480 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 19:22:08.344480 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 19:22:08.344480 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 19:22:08.345604 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:08.345604 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:08.345604 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 19:22:08.345604 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:22:08.345604 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 19:22:08.345604 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:22:08.345604 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:08.345604 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:08.345604 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:08.345604 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:08.345604 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:08.345604 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:08.345604 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:08.345604 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:08.345604 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:08.345604 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:08.345604 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:08.345604 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:08.346511 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:08.346511 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:08.346511 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 19:22:08.346511 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 19:22:08.346511 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 19:22:08.346511 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 19:22:08.346511 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 19:22:08.346511 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 19:22:08.346511 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 01 19:22:08.346511 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:08.347034 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 289/552] 10.222.0.26 () {56 vars in 1093 bytes} [Fri Jul 1 19:22:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:22:08.358833 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ac3646-a2ba-43dc-b780-710273b3e5e8 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:08.359698 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-9a832da3-91f5-4639-8bd2-6e1772496d1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:08.359698 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:08.359698 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:08.359698 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:08.359698 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:08.359698 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:08.359698 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:08.359698 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:08.359698 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:08.359698 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:08.359698 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:08.359698 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:08.359698 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:22:08.359698 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:22:08.359698 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:22:08.361663 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:22:08.361663 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:08.361663 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:08.361663 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:08.361663 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:08.361663 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:08.361663 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:08.361663 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:08.361663 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:08.361663 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:08.361663 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:08.361663 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:08.361663 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:08.361663 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:08.361663 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:08.361663 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:08.361663 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:08.363698 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:22:08.363698 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:22:08.363698 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:08.363698 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:08.368347 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 264/553] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:22:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:08.374169 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a832da3-91f5-4639-8bd2-6e1772496d1a None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:08.488795 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:08.498613 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ac3646-a2ba-43dc-b780-710273b3e5e8 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:08.510682 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a832da3-91f5-4639-8bd2-6e1772496d1a None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:08.554816 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed145237-6ba5-41e2-b12c-77be52d87f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:08.555420 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed145237-6ba5-41e2-b12c-77be52d87f19 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:08.555764 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed145237-6ba5-41e2-b12c-77be52d87f19 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:08.556047 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed145237-6ba5-41e2-b12c-77be52d87f19 None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:08.556777 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed145237-6ba5-41e2-b12c-77be52d87f19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:08.557099 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed145237-6ba5-41e2-b12c-77be52d87f19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:08.558349 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26199d-9a49-4693-b97e-2cb223f7d4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:08.558510 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed145237-6ba5-41e2-b12c-77be52d87f19 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:08.559806 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26199d-9a49-4693-b97e-2cb223f7d4f0 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:08.560672 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26199d-9a49-4693-b97e-2cb223f7d4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:08.561506 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26199d-9a49-4693-b97e-2cb223f7d4f0 None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:08.563105 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e26199d-9a49-4693-b97e-2cb223f7d4f0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:08.563847 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e26199d-9a49-4693-b97e-2cb223f7d4f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:08.566555 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e26199d-9a49-4693-b97e-2cb223f7d4f0 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:08.579082 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 265/554] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Jul 1 19:22:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:22:08.579082 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e008a-1c99-4165-8ed5-9ded6690250f None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:08.579082 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e008a-1c99-4165-8ed5-9ded6690250f None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:08.579082 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e008a-1c99-4165-8ed5-9ded6690250f None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:08.579082 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 266/555] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:22:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:22:08.581167 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e008a-1c99-4165-8ed5-9ded6690250f None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:08.610834 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 290/556] 10.222.0.26 () {56 vars in 1133 bytes} [Fri Jul 1 19:22:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:08.611635 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:08.615096 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c810c-e6fb-4815-926e-cc49b4d7bf1e None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:08.615816 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c810c-e6fb-4815-926e-cc49b4d7bf1e None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:08.616555 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c810c-e6fb-4815-926e-cc49b4d7bf1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:08.654797 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-878c810c-e6fb-4815-926e-cc49b4d7bf1e None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:22:08.657638 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-878c810c-e6fb-4815-926e-cc49b4d7bf1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:22:08.706628 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e008a-1c99-4165-8ed5-9ded6690250f None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:08.750635 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be53b703-c6cb-4ca2-8106-b910c918fd69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:08.751713 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53b703-c6cb-4ca2-8106-b910c918fd69 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:08.752002 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53b703-c6cb-4ca2-8106-b910c918fd69 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:08.752282 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53b703-c6cb-4ca2-8106-b910c918fd69 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:08.761033 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be53b703-c6cb-4ca2-8106-b910c918fd69 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:08.761924 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 291/557] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:22:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:22:08.764068 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878c810c-e6fb-4815-926e-cc49b4d7bf1e None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:08.768459 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be53b703-c6cb-4ca2-8106-b910c918fd69 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:08.800394 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-be53b703-c6cb-4ca2-8106-b910c918fd69 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 01 19:22:08.800394 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:08.800394 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:08.800394 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:08.800394 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:08.800394 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:08.800394 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:08.800394 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:08.800394 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:08.800394 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:08.800394 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:08.800394 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:08.800394 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 19:22:08.800394 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 19:22:08.800394 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 19:22:08.800394 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 19:22:08.802002 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:08.802002 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:08.802002 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 19:22:08.802002 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:22:08.802002 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 19:22:08.802002 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:22:08.802002 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:08.802002 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:08.802002 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:08.802002 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:08.802002 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:08.802002 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:08.802002 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:08.802002 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:08.802002 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:08.802002 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:08.802002 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:08.802002 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:08.802931 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:08.802931 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:08.802931 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 19:22:08.802931 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 19:22:08.802931 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 19:22:08.802931 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 19:22:08.802931 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 19:22:08.802931 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 19:22:08.802931 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 01 19:22:08.802931 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:08.802931 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 267/558] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Jul 1 19:22:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:08.802931 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be53b703-c6cb-4ca2-8106-b910c918fd69 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:08.901197 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:08.905658 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:08.925413 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be53b703-c6cb-4ca2-8106-b910c918fd69 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:08.927682 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878c810c-e6fb-4815-926e-cc49b4d7bf1e None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:08.965217 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a504a65b-2bec-45fe-b6cb-0c249c88a36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:08.966536 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a504a65b-2bec-45fe-b6cb-0c249c88a36f None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:08.967593 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a504a65b-2bec-45fe-b6cb-0c249c88a36f None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:08.968077 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a504a65b-2bec-45fe-b6cb-0c249c88a36f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:08.979245 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d7564f-b9b1-497a-bdab-0f24f968254b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:08.980063 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d7564f-b9b1-497a-bdab-0f24f968254b None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:08.980349 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d7564f-b9b1-497a-bdab-0f24f968254b None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:08.980626 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d7564f-b9b1-497a-bdab-0f24f968254b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:08.982642 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a504a65b-2bec-45fe-b6cb-0c249c88a36f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:22:08.991440 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-a504a65b-2bec-45fe-b6cb-0c249c88a36f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:22:08.991440 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:08.991440 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:08.991440 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:08.991440 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:08.991440 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:08.991440 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:08.991440 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:08.991440 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:08.991440 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:08.991440 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:08.991440 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:08.991440 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:22:08.991440 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:22:08.991440 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:22:08.991440 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:22:08.992502 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:22:08.992502 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:22:08.992502 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:22:08.992502 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:22:08.992502 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:08.992502 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:08.992502 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:08.992502 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:08.992502 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:08.992502 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:08.992502 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:08.992502 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:08.992502 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:08.992502 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:08.992502 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:08.992502 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:08.993401 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:08.993401 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:08.993401 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:08.993401 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:08.993401 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:22:08.993401 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:22:08.993401 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:22:08.993401 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:22:08.993401 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:22:08.993401 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:22:08.993401 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:22:08.993401 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:08.994317 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d7564f-b9b1-497a-bdab-0f24f968254b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:08.994317 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d7564f-b9b1-497a-bdab-0f24f968254b None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:09.001562 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 268/559] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Jul 1 19:22:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:09.003113 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a504a65b-2bec-45fe-b6cb-0c249c88a36f None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:09.016206 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-b8d7564f-b9b1-497a-bdab-0f24f968254b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:09.016206 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:09.016206 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:09.016206 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:09.016206 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:09.016206 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:09.016206 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:09.016206 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:09.016206 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:09.016206 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:09.016206 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:09.016206 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:09.016206 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:22:09.016206 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:22:09.016206 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:22:09.017892 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:22:09.017892 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:09.017892 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:09.017892 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:09.017892 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:09.017892 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:09.017892 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:09.017892 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:09.017892 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:09.017892 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:09.017892 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:09.017892 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:09.017892 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:09.017892 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:09.017892 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:09.017892 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:09.017892 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:09.018825 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:22:09.018825 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:22:09.018825 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:09.018825 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:09.018825 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 292/560] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:22:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:09.018825 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d7564f-b9b1-497a-bdab-0f24f968254b None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:09.140711 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a504a65b-2bec-45fe-b6cb-0c249c88a36f None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:09.157907 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d7564f-b9b1-497a-bdab-0f24f968254b None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:09.182591 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da524176-9a22-46b9-8e1e-701fd733c8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:09.183270 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da524176-9a22-46b9-8e1e-701fd733c8aa None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:09.183556 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da524176-9a22-46b9-8e1e-701fd733c8aa None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:09.183834 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da524176-9a22-46b9-8e1e-701fd733c8aa None admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:09.184850 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da524176-9a22-46b9-8e1e-701fd733c8aa None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:09.185165 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da524176-9a22-46b9-8e1e-701fd733c8aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:09.187430 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da524176-9a22-46b9-8e1e-701fd733c8aa None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:09.198785 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:09.202649 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee6b73-39ad-4e01-b4f5-abf94c80815e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:09.203331 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee6b73-39ad-4e01-b4f5-abf94c80815e None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:09.203617 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee6b73-39ad-4e01-b4f5-abf94c80815e None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:09.203897 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee6b73-39ad-4e01-b4f5-abf94c80815e None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:09.204655 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aee6b73-39ad-4e01-b4f5-abf94c80815e None admin] RBAC: Adding query filter params (name=service) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:09.204971 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aee6b73-39ad-4e01-b4f5-abf94c80815e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:09.206899 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aee6b73-39ad-4e01-b4f5-abf94c80815e None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:09.210332 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:09.218047 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 269/561] 10.222.0.26 () {56 vars in 1135 bytes} [Fri Jul 1 19:22:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:09.218047 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da524176-9a22-46b9-8e1e-701fd733c8aa None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:09.228492 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 293/562] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Jul 1 19:22:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:09.230476 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6b1a77-8138-48ac-9ae5-7f2e243e9f48 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:09.231126 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6b1a77-8138-48ac-9ae5-7f2e243e9f48 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:09.231788 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6b1a77-8138-48ac-9ae5-7f2e243e9f48 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:09.233150 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 294/563] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:22:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:22:09.233896 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6b1a77-8138-48ac-9ae5-7f2e243e9f48 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:09.365031 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da524176-9a22-46b9-8e1e-701fd733c8aa None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:09.380778 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6b1a77-8138-48ac-9ae5-7f2e243e9f48 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:09.418313 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c05ac5-a666-4466-b813-37a8ea2b30dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:09.419304 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c05ac5-a666-4466-b813-37a8ea2b30dc None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:09.419790 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c05ac5-a666-4466-b813-37a8ea2b30dc None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:09.420209 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c05ac5-a666-4466-b813-37a8ea2b30dc None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:09.421587 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c05ac5-a666-4466-b813-37a8ea2b30dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:09.422116 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c05ac5-a666-4466-b813-37a8ea2b30dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:09.424274 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c05ac5-a666-4466-b813-37a8ea2b30dc None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:09.436444 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ec584f-b9d9-480b-9c68-61d081e4aad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:09.436896 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec584f-b9d9-480b-9c68-61d081e4aad9 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:09.437190 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec584f-b9d9-480b-9c68-61d081e4aad9 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:09.437693 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec584f-b9d9-480b-9c68-61d081e4aad9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:09.449281 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 270/564] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Jul 1 19:22:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:09.449281 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c05ac5-a666-4466-b813-37a8ea2b30dc None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:09.520575 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:09.521927 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:09.525393 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ec584f-b9d9-480b-9c68-61d081e4aad9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:09.527794 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ec584f-b9d9-480b-9c68-61d081e4aad9 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:09.597151 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c05ac5-a666-4466-b813-37a8ea2b30dc None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:09.647198 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 295/565] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Jul 1 19:22:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 19:22:09.648522 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c976b980-7f48-41f8-b4c6-f5363195cfbb None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:09.648812 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c976b980-7f48-41f8-b4c6-f5363195cfbb None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:09.649095 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c976b980-7f48-41f8-b4c6-f5363195cfbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:09.659071 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca11b37a-6901-4a69-88d4-9f34a3680104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:09.660321 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca11b37a-6901-4a69-88d4-9f34a3680104 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:09.660764 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca11b37a-6901-4a69-88d4-9f34a3680104 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:09.661193 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca11b37a-6901-4a69-88d4-9f34a3680104 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:09.665988 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-c976b980-7f48-41f8-b4c6-f5363195cfbb None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:22:09.667181 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-c976b980-7f48-41f8-b4c6-f5363195cfbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:22:09.678890 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca11b37a-6901-4a69-88d4-9f34a3680104 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:09.681169 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca11b37a-6901-4a69-88d4-9f34a3680104 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:09.704626 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-ca11b37a-6901-4a69-88d4-9f34a3680104 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:09.704626 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:09.704626 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:09.704626 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:09.704626 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:09.704626 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:09.704626 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:09.704626 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:09.704626 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:09.704626 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:09.704626 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:09.704626 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:09.704626 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:22:09.704626 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:22:09.704626 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:22:09.705610 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:22:09.705610 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:09.705610 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:09.705610 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:09.705610 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:09.705610 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:09.705610 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:09.705610 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:09.705610 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:09.705610 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:09.705610 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:09.705610 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:09.705610 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:09.705610 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:09.705610 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:09.705610 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:09.705610 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:09.706526 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:22:09.706526 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:22:09.706526 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:09.706526 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:09.709425 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 271/566] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:22:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:09.711019 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca11b37a-6901-4a69-88d4-9f34a3680104 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:09.768542 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 296/567] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:22:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:22:09.770223 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c976b980-7f48-41f8-b4c6-f5363195cfbb None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:09.816934 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:09.842407 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca11b37a-6901-4a69-88d4-9f34a3680104 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:09.856382 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:09.892904 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fdbd9f-1851-4fa8-b0a5-28e49c3c177d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:09.894230 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fdbd9f-1851-4fa8-b0a5-28e49c3c177d None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:09.894701 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fdbd9f-1851-4fa8-b0a5-28e49c3c177d None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:09.895173 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fdbd9f-1851-4fa8-b0a5-28e49c3c177d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:09.905986 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fdbd9f-1851-4fa8-b0a5-28e49c3c177d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:09.907816 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fdbd9f-1851-4fa8-b0a5-28e49c3c177d None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:09.917163 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c976b980-7f48-41f8-b4c6-f5363195cfbb None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:09.928638 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-c8fdbd9f-1851-4fa8-b0a5-28e49c3c177d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:22:09.928638 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:09.928638 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:09.928638 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:09.928638 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:09.928638 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:09.928638 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:09.928638 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:09.928638 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:09.928638 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:09.928638 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:09.928638 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:09.928638 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 19:22:09.928638 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 19:22:09.928638 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 19:22:09.930709 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 19:22:09.930709 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:09.930709 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:09.930709 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:09.930709 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:09.930709 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:09.930709 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:09.930709 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:09.930709 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:09.930709 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:09.930709 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:09.930709 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:09.930709 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:09.930709 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:09.930709 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:09.930709 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:09.930709 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:09.932500 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 19:22:09.932500 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 19:22:09.932500 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 19:22:09.932500 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 19:22:09.932500 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 19:22:09.932500 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 19:22:09.932500 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:22:09.932500 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:09.932500 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 272/568] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Jul 1 19:22:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:09.932500 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fdbd9f-1851-4fa8-b0a5-28e49c3c177d None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:09.974504 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da727de-f106-4783-a1ff-97936c0f699f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:09.975772 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da727de-f106-4783-a1ff-97936c0f699f None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:09.976327 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da727de-f106-4783-a1ff-97936c0f699f None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:09.976794 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da727de-f106-4783-a1ff-97936c0f699f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:09.994219 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da727de-f106-4783-a1ff-97936c0f699f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:09.996707 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da727de-f106-4783-a1ff-97936c0f699f None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:10.026818 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-6da727de-f106-4783-a1ff-97936c0f699f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:10.026818 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:10.026818 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:10.026818 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:10.026818 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:10.026818 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:10.026818 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:10.026818 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:10.026818 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:10.026818 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:10.026818 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:10.026818 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:10.026818 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:22:10.026818 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:22:10.026818 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:22:10.028248 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:22:10.028248 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:10.028248 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:10.028248 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:10.028248 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:10.028248 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:10.028248 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:10.028248 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:10.028248 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:10.028248 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:10.028248 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:10.028248 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:10.028248 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:10.028248 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:10.028248 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:10.028248 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:10.028248 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:10.029933 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:22:10.029933 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:22:10.029933 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:10.029933 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:10.035938 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 297/569] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:22:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:10.037366 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da727de-f106-4783-a1ff-97936c0f699f None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:10.090908 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fdbd9f-1851-4fa8-b0a5-28e49c3c177d None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:10.127612 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6227d58-b098-4b0d-983c-ece0cc2e050c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:10.128274 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6227d58-b098-4b0d-983c-ece0cc2e050c None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:10.128560 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6227d58-b098-4b0d-983c-ece0cc2e050c None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:10.128838 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6227d58-b098-4b0d-983c-ece0cc2e050c None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:10.130199 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6227d58-b098-4b0d-983c-ece0cc2e050c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:10.130199 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6227d58-b098-4b0d-983c-ece0cc2e050c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:10.131299 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6227d58-b098-4b0d-983c-ece0cc2e050c None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:10.135807 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:10.143661 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 273/570] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Jul 1 19:22:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:10.144594 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6227d58-b098-4b0d-983c-ece0cc2e050c None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:10.163632 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da727de-f106-4783-a1ff-97936c0f699f None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:10.177123 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:10.202491 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72da62f5-442a-4e11-b7df-964c66855dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:10.203176 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da62f5-442a-4e11-b7df-964c66855dce None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:10.203467 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da62f5-442a-4e11-b7df-964c66855dce None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:10.203743 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da62f5-442a-4e11-b7df-964c66855dce None admin] PATH_INFO: `/v3/roles/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:10.214846 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72da62f5-442a-4e11-b7df-964c66855dce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:22:10.223253 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-72da62f5-442a-4e11-b7df-964c66855dce None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:22:10.223253 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:10.223253 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:10.223253 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:10.223253 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:10.223253 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:10.223253 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:10.223253 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:10.223253 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:10.223253 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:10.223253 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:10.223253 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:10.223253 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:22:10.223253 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:22:10.223253 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:22:10.223253 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:22:10.224551 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:22:10.224551 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:22:10.224551 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:22:10.224551 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:22:10.224551 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:10.224551 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:10.224551 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:10.224551 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:10.224551 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:10.224551 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:10.224551 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:10.224551 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:10.224551 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:10.224551 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:10.224551 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:10.224551 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:10.226817 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:10.226817 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:10.226817 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:10.226817 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:10.226817 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:22:10.226817 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:22:10.226817 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:22:10.226817 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:22:10.226817 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:22:10.226817 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:22:10.226817 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:22:10.226817 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:10.226817 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 298/571] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Jul 1 19:22:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:10.226817 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72da62f5-442a-4e11-b7df-964c66855dce None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:10.257801 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6227d58-b098-4b0d-983c-ece0cc2e050c None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:10.295906 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c5d88-1475-4132-baa8-143526029178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:10.296956 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c5d88-1475-4132-baa8-143526029178 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:10.297465 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c5d88-1475-4132-baa8-143526029178 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:10.297943 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c5d88-1475-4132-baa8-143526029178 None admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:10.299272 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6c5d88-1475-4132-baa8-143526029178 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:10.299788 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6c5d88-1475-4132-baa8-143526029178 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:10.302378 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6c5d88-1475-4132-baa8-143526029178 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:10.320038 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 274/572] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Jul 1 19:22:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:10.321439 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd4a167-7310-4ccb-a716-c9a0ce919c6a None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:10.321738 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd4a167-7310-4ccb-a716-c9a0ce919c6a None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:10.322018 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd4a167-7310-4ccb-a716-c9a0ce919c6a None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:10.325422 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 275/573] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:22:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:22:10.325422 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd4a167-7310-4ccb-a716-c9a0ce919c6a None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:10.346486 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72da62f5-442a-4e11-b7df-964c66855dce None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:10.383016 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef35a1a-5e93-40a1-a1e1-4e4ae40293bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:10.383691 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef35a1a-5e93-40a1-a1e1-4e4ae40293bd None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:10.383972 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef35a1a-5e93-40a1-a1e1-4e4ae40293bd None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:10.384256 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef35a1a-5e93-40a1-a1e1-4e4ae40293bd None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:10.384987 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef35a1a-5e93-40a1-a1e1-4e4ae40293bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:10.385323 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef35a1a-5e93-40a1-a1e1-4e4ae40293bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:10.386708 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef35a1a-5e93-40a1-a1e1-4e4ae40293bd None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:10.395901 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:10.400191 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 299/574] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Jul 1 19:22:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:10.401788 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef35a1a-5e93-40a1-a1e1-4e4ae40293bd None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:10.430560 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:10.442833 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd4a167-7310-4ccb-a716-c9a0ce919c6a None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:10.478170 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d102397d-3306-4623-a5a3-de6248893f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:10.478880 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d102397d-3306-4623-a5a3-de6248893f84 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:10.479157 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d102397d-3306-4623-a5a3-de6248893f84 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:10.479427 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d102397d-3306-4623-a5a3-de6248893f84 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:10.487260 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d102397d-3306-4623-a5a3-de6248893f84 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:10.488722 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d102397d-3306-4623-a5a3-de6248893f84 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:10.513294 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-d102397d-3306-4623-a5a3-de6248893f84 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 01 19:22:10.513294 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:10.513294 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:10.513294 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:10.513294 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:10.513294 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:10.513294 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:10.513294 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:10.513294 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:10.513294 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:10.513294 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:10.513294 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:10.513294 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 19:22:10.513294 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 19:22:10.513294 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 19:22:10.513294 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 19:22:10.515264 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:10.515264 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:10.515264 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 19:22:10.515264 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:22:10.515264 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 19:22:10.515264 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:22:10.515264 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:10.515264 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:10.515264 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:10.515264 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:10.515264 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:10.515264 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:10.515264 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:10.515264 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:10.515264 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:10.515264 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:10.515264 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:10.515264 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:10.518084 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:10.518084 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:10.518084 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 19:22:10.518084 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 19:22:10.518084 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 19:22:10.518084 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 19:22:10.518084 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 19:22:10.518084 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 19:22:10.518084 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 01 19:22:10.518084 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:10.518084 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 276/575] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Jul 1 19:22:10 2022] GET /identity/v3/users/glance => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:10.520464 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef35a1a-5e93-40a1-a1e1-4e4ae40293bd None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:10.520703 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d102397d-3306-4623-a5a3-de6248893f84 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:10.555010 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909600f6-b8d9-4365-b931-db94536d4305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:10.555678 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909600f6-b8d9-4365-b931-db94536d4305 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:10.555963 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909600f6-b8d9-4365-b931-db94536d4305 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:10.556242 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909600f6-b8d9-4365-b931-db94536d4305 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:10.556998 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909600f6-b8d9-4365-b931-db94536d4305 None admin] RBAC: Adding query filter params (name=service) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:10.557339 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909600f6-b8d9-4365-b931-db94536d4305 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:10.558733 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909600f6-b8d9-4365-b931-db94536d4305 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:10.567696 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 300/576] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Jul 1 19:22:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:10.569039 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96525ad-3621-4527-a69a-d6d012c69cb6 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:10.569320 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96525ad-3621-4527-a69a-d6d012c69cb6 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:10.569571 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96525ad-3621-4527-a69a-d6d012c69cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:10.587681 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-a96525ad-3621-4527-a69a-d6d012c69cb6 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:22:10.588939 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-a96525ad-3621-4527-a69a-d6d012c69cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:22:10.625577 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d102397d-3306-4623-a5a3-de6248893f84 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:10.656898 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:10.666132 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc4aeaf-d9cf-46d0-bf5e-7cc660b3f7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:10.667207 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4aeaf-d9cf-46d0-bf5e-7cc660b3f7d8 None admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:10.667577 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4aeaf-d9cf-46d0-bf5e-7cc660b3f7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:10.667940 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4aeaf-d9cf-46d0-bf5e-7cc660b3f7d8 None admin] PATH_INFO: `/v3/projects/69c523a41f4048cfb7df553b6feb6310/users/13fd76fc7dd1410b9cde5adbaa6cb2e5/roles/35ca0f0b9a964300a63780ec435e730b` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:10.669631 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 301/577] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:22:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:22:10.671227 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96525ad-3621-4527-a69a-d6d012c69cb6 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:10.688079 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc4aeaf-d9cf-46d0-bf5e-7cc660b3f7d8 None admin] RBAC: Authorizing `identity:create_grant(project_id=69c523a41f4048cfb7df553b6feb6310, user_id=13fd76fc7dd1410b9cde5adbaa6cb2e5, role_id=35ca0f0b9a964300a63780ec435e730b)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:10.689601 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc4aeaf-d9cf-46d0-bf5e-7cc660b3f7d8 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:10.699665 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:10.704723 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 277/578] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Jul 1 19:22:10 2022] PUT /identity/v3/projects/69c523a41f4048cfb7df553b6feb6310/users/13fd76fc7dd1410b9cde5adbaa6cb2e5/roles/35ca0f0b9a964300a63780ec435e730b => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:22:10.705589 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc4aeaf-d9cf-46d0-bf5e-7cc660b3f7d8 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:10.824987 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96525ad-3621-4527-a69a-d6d012c69cb6 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:10.855458 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc4aeaf-d9cf-46d0-bf5e-7cc660b3f7d8 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:10.871059 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a092c91-25be-4b3d-81df-b72616b20a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:10.874167 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a092c91-25be-4b3d-81df-b72616b20a96 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:10.875264 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a092c91-25be-4b3d-81df-b72616b20a96 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:10.875743 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a092c91-25be-4b3d-81df-b72616b20a96 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:10.886236 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a092c91-25be-4b3d-81df-b72616b20a96 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:10.888285 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a092c91-25be-4b3d-81df-b72616b20a96 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:10.904107 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e271d202-b374-4ccc-aca8-00ac84218586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:10.904704 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-4a092c91-25be-4b3d-81df-b72616b20a96 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:22:10.904704 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:10.904704 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:10.904704 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:10.904704 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:10.904704 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:10.904704 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:10.904704 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:10.904704 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:10.904704 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:10.904704 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:10.904704 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:10.904704 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 19:22:10.904704 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 19:22:10.904704 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 19:22:10.906398 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 19:22:10.906398 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:10.906398 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:10.906398 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:10.906398 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:10.906398 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:10.906398 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:10.906398 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:10.906398 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:10.906398 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:10.906398 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:10.906398 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:10.906398 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:10.906398 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:10.906398 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:10.906398 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:10.906398 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:10.908173 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 19:22:10.908173 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 19:22:10.908173 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 19:22:10.908173 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 19:22:10.908173 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 19:22:10.908173 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 19:22:10.908173 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:22:10.908173 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:10.909001 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271d202-b374-4ccc-aca8-00ac84218586 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:10.909001 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271d202-b374-4ccc-aca8-00ac84218586 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:10.909001 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271d202-b374-4ccc-aca8-00ac84218586 None admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:10.909001 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e271d202-b374-4ccc-aca8-00ac84218586 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:10.909001 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e271d202-b374-4ccc-aca8-00ac84218586 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:10.910731 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e271d202-b374-4ccc-aca8-00ac84218586 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:10.911001 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 302/579] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Jul 1 19:22:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:10.911831 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a092c91-25be-4b3d-81df-b72616b20a96 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:10.938529 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 278/580] 10.222.0.26 () {56 vars in 1137 bytes} [Fri Jul 1 19:22:10 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:10.938529 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e271d202-b374-4ccc-aca8-00ac84218586 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:10.991029 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:11.024858 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:11.072019 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a092c91-25be-4b3d-81df-b72616b20a96 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:11.095183 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e271d202-b374-4ccc-aca8-00ac84218586 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:11.124453 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0f5f10-6826-4836-858f-be3e7f64c934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:11.125756 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f5f10-6826-4836-858f-be3e7f64c934 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:11.126228 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f5f10-6826-4836-858f-be3e7f64c934 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:11.126693 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f5f10-6826-4836-858f-be3e7f64c934 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:11.140493 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0f5f10-6826-4836-858f-be3e7f64c934 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:11.142125 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0f5f10-6826-4836-858f-be3e7f64c934 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:11.145405 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10231e9a-ab31-4195-88d6-9d7076ff11d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:11.146409 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10231e9a-ab31-4195-88d6-9d7076ff11d0 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:11.146699 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10231e9a-ab31-4195-88d6-9d7076ff11d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:11.146981 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10231e9a-ab31-4195-88d6-9d7076ff11d0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:11.160825 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10231e9a-ab31-4195-88d6-9d7076ff11d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:22:11.161772 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-de0f5f10-6826-4836-858f-be3e7f64c934 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:11.161772 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:11.161772 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:11.161772 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:11.161772 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:11.161772 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:11.161772 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:11.161772 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:11.161772 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:11.161772 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:11.161772 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:11.161772 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:11.161772 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:22:11.161772 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:22:11.161772 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:22:11.170249 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:22:11.170249 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:11.170249 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:11.170249 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:11.170249 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:11.170249 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:11.170249 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:11.170249 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:11.170249 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:11.170249 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:11.170249 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:11.170249 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:11.170249 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:11.170249 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:11.170249 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:11.170249 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:11.170249 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:11.171741 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:22:11.171741 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:22:11.171741 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:11.171741 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:11.171741 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 303/581] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:22:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:11.171741 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0f5f10-6826-4836-858f-be3e7f64c934 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:11.172958 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-10231e9a-ab31-4195-88d6-9d7076ff11d0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:22:11.172958 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:11.172958 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:11.172958 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:11.172958 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:11.172958 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:11.172958 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:11.172958 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:11.172958 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:11.172958 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:11.172958 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:11.172958 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:11.172958 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:22:11.172958 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:22:11.172958 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:22:11.172958 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:22:11.177430 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:22:11.177430 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:22:11.177430 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:22:11.177430 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:22:11.177430 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:11.177430 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:11.177430 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:11.177430 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:11.177430 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:11.177430 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:11.177430 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:11.177430 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:11.177430 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:11.177430 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:11.177430 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:11.177430 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:11.181467 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:11.181467 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:11.181467 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:11.181467 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:11.181467 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:22:11.181467 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:22:11.181467 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:22:11.181467 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:22:11.181467 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:22:11.181467 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:22:11.181467 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:22:11.181467 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:11.181467 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 279/582] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Jul 1 19:22:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:11.181467 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10231e9a-ab31-4195-88d6-9d7076ff11d0 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:11.305090 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0f5f10-6826-4836-858f-be3e7f64c934 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:11.308890 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10231e9a-ab31-4195-88d6-9d7076ff11d0 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:11.309095 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:11.332049 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:11.352891 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5756b3f-4e69-4520-ad7f-81856ac6b714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:11.353323 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9919e9-ac11-4170-988f-4a5c8619a85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:11.353920 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5756b3f-4e69-4520-ad7f-81856ac6b714 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:11.354189 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9919e9-ac11-4170-988f-4a5c8619a85e None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:11.354346 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5756b3f-4e69-4520-ad7f-81856ac6b714 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:11.354563 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5756b3f-4e69-4520-ad7f-81856ac6b714 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:11.354711 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9919e9-ac11-4170-988f-4a5c8619a85e None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:11.355071 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9919e9-ac11-4170-988f-4a5c8619a85e None admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:11.356078 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9919e9-ac11-4170-988f-4a5c8619a85e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:11.356497 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9919e9-ac11-4170-988f-4a5c8619a85e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:11.358776 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9919e9-ac11-4170-988f-4a5c8619a85e None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:11.369153 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5756b3f-4e69-4520-ad7f-81856ac6b714 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:11.370767 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5756b3f-4e69-4520-ad7f-81856ac6b714 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:11.380344 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 304/583] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Jul 1 19:22:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:11.380344 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9919e9-ac11-4170-988f-4a5c8619a85e None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:11.393917 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-c5756b3f-4e69-4520-ad7f-81856ac6b714 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:11.393917 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:11.393917 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:11.393917 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:11.393917 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:11.393917 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:11.393917 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:11.393917 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:11.393917 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:11.393917 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:11.393917 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:11.393917 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:11.393917 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:22:11.393917 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:22:11.393917 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:22:11.395220 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:22:11.395220 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:11.395220 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:11.395220 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:11.395220 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:11.395220 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:11.395220 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:11.395220 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:11.395220 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:11.395220 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:11.395220 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:11.395220 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:11.395220 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:11.395220 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:11.395220 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:11.395220 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:11.395220 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:11.396116 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:22:11.396116 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:22:11.396116 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:11.396116 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:11.400127 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 280/584] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:22:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:11.401326 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5756b3f-4e69-4520-ad7f-81856ac6b714 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:11.527438 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9919e9-ac11-4170-988f-4a5c8619a85e None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:11.532727 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5756b3f-4e69-4520-ad7f-81856ac6b714 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:11.571881 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ea1998-0d6c-42ff-a536-74193d2c72be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:11.572546 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea1998-0d6c-42ff-a536-74193d2c72be None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:11.572832 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea1998-0d6c-42ff-a536-74193d2c72be None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:11.573115 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea1998-0d6c-42ff-a536-74193d2c72be None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:11.573865 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ea1998-0d6c-42ff-a536-74193d2c72be None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:11.574318 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ea1998-0d6c-42ff-a536-74193d2c72be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:11.575687 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ea1998-0d6c-42ff-a536-74193d2c72be None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:11.576878 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a972ab-f810-40fe-993e-3bece2ae32bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:11.577863 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a972ab-f810-40fe-993e-3bece2ae32bb None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:11.578246 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a972ab-f810-40fe-993e-3bece2ae32bb None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:11.578571 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a972ab-f810-40fe-993e-3bece2ae32bb None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:11.579420 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a972ab-f810-40fe-993e-3bece2ae32bb None admin] RBAC: Adding query filter params (name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:11.579937 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a972ab-f810-40fe-993e-3bece2ae32bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:11.581461 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a972ab-f810-40fe-993e-3bece2ae32bb None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:11.590545 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 281/585] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Jul 1 19:22:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:11.591367 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a972ab-f810-40fe-993e-3bece2ae32bb None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:11.592402 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 305/586] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Jul 1 19:22:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:11.593577 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ea1998-0d6c-42ff-a536-74193d2c72be None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:11.627840 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:11.648721 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:11.733323 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a972ab-f810-40fe-993e-3bece2ae32bb None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:11.738235 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ea1998-0d6c-42ff-a536-74193d2c72be None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:11.770174 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c53db2-3d4f-4fba-8c61-a4a920b18c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:11.770830 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c53db2-3d4f-4fba-8c61-a4a920b18c84 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:11.771116 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c53db2-3d4f-4fba-8c61-a4a920b18c84 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:11.771394 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c53db2-3d4f-4fba-8c61-a4a920b18c84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:11.772222 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c53db2-3d4f-4fba-8c61-a4a920b18c84 None admin] RBAC: Adding query filter params (role.id=35ca0f0b9a964300a63780ec435e730b, scope.project.id=69c523a41f4048cfb7df553b6feb6310, user.id=e958c5b03a9346d59c32675c5271bf3b) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:11.772540 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c53db2-3d4f-4fba-8c61-a4a920b18c84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:11.774009 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c53db2-3d4f-4fba-8c61-a4a920b18c84 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:11.789275 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 282/587] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Jul 1 19:22:11 2022] GET /identity/v3/role_assignments?user.id=e958c5b03a9346d59c32675c5271bf3b&scope.project.id=69c523a41f4048cfb7df553b6feb6310&role.id=35ca0f0b9a964300a63780ec435e730b => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:11.789275 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c53db2-3d4f-4fba-8c61-a4a920b18c84 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:11.800090 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962110d0-8897-4389-a2a6-451949bbcb56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:11.801102 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962110d0-8897-4389-a2a6-451949bbcb56 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:11.801647 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962110d0-8897-4389-a2a6-451949bbcb56 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:11.802091 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962110d0-8897-4389-a2a6-451949bbcb56 None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:11.803546 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962110d0-8897-4389-a2a6-451949bbcb56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:11.804022 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962110d0-8897-4389-a2a6-451949bbcb56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:11.806314 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962110d0-8897-4389-a2a6-451949bbcb56 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:11.830759 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 306/588] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Jul 1 19:22:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:11.832516 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962110d0-8897-4389-a2a6-451949bbcb56 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:11.914634 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:11.928690 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c53db2-3d4f-4fba-8c61-a4a920b18c84 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:11.974757 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:11.986738 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f3e8d6-699a-4357-b665-2fabb4b8078a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:11.988060 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3e8d6-699a-4357-b665-2fabb4b8078a None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:11.988659 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3e8d6-699a-4357-b665-2fabb4b8078a None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:11.989108 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3e8d6-699a-4357-b665-2fabb4b8078a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:11.998935 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962110d0-8897-4389-a2a6-451949bbcb56 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:12.006714 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f3e8d6-699a-4357-b665-2fabb4b8078a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:12.008232 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f3e8d6-699a-4357-b665-2fabb4b8078a None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:12.024535 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-46f3e8d6-699a-4357-b665-2fabb4b8078a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 01 19:22:12.024535 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:12.024535 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:12.024535 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:12.024535 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:12.024535 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:12.024535 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:12.024535 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:12.024535 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:12.024535 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:12.024535 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:12.024535 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:12.024535 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 19:22:12.024535 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 19:22:12.024535 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 19:22:12.024535 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 19:22:12.025609 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:12.025609 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:12.025609 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 19:22:12.025609 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:22:12.025609 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 19:22:12.025609 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:22:12.025609 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:12.025609 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:12.025609 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:12.025609 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:12.025609 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:12.025609 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:12.025609 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:12.025609 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:12.025609 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:12.025609 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:12.025609 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:12.025609 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:12.026568 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:12.026568 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:12.026568 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 19:22:12.026568 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 19:22:12.026568 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 19:22:12.026568 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 19:22:12.026568 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 19:22:12.026568 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 19:22:12.026568 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 01 19:22:12.026568 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:12.026568 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 283/589] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Jul 1 19:22:11 2022] GET /identity/v3/users/neutron => generated 85 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:12.027346 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f3e8d6-699a-4357-b665-2fabb4b8078a None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:12.046299 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1806ee-b9b1-4864-ab1f-79a03dd4730e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:12.047460 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1806ee-b9b1-4864-ab1f-79a03dd4730e None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:12.047989 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1806ee-b9b1-4864-ab1f-79a03dd4730e None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:12.048371 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1806ee-b9b1-4864-ab1f-79a03dd4730e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:12.061879 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1806ee-b9b1-4864-ab1f-79a03dd4730e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:12.063334 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1806ee-b9b1-4864-ab1f-79a03dd4730e None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:12.084522 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-0f1806ee-b9b1-4864-ab1f-79a03dd4730e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:12.084522 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:12.084522 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:12.084522 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:12.084522 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:12.084522 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:12.084522 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:12.084522 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:12.084522 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:12.084522 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:12.084522 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:12.084522 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:12.084522 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:22:12.084522 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:22:12.084522 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:22:12.086196 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:22:12.086196 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:12.086196 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:12.086196 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:12.086196 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:12.086196 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:12.086196 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:12.086196 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:12.086196 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:12.086196 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:12.086196 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:12.086196 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:12.086196 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:12.086196 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:12.086196 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:12.086196 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:12.086196 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:12.087493 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:22:12.087493 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:22:12.087493 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:12.087493 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:12.087493 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 307/590] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:22:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:12.087493 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1806ee-b9b1-4864-ab1f-79a03dd4730e None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:12.163428 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f3e8d6-699a-4357-b665-2fabb4b8078a None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:12.198945 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1806ee-b9b1-4864-ab1f-79a03dd4730e None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:12.203870 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b076c-c027-4343-8626-0d6dfc54ce95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:12.204955 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b076c-c027-4343-8626-0d6dfc54ce95 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:12.205476 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b076c-c027-4343-8626-0d6dfc54ce95 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:12.205957 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b076c-c027-4343-8626-0d6dfc54ce95 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:12.214197 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10b076c-c027-4343-8626-0d6dfc54ce95 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:12.216219 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10b076c-c027-4343-8626-0d6dfc54ce95 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:12.234380 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-e10b076c-c027-4343-8626-0d6dfc54ce95 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:22:12.234380 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:12.234380 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:12.234380 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:12.234380 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:12.234380 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:12.234380 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:12.234380 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:12.234380 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:12.234380 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:12.234380 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:12.234380 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:12.234380 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 19:22:12.234380 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 19:22:12.234380 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 19:22:12.235327 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 19:22:12.235327 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:12.235327 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:12.235327 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:12.235327 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:12.235327 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:12.235327 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:12.235327 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:12.235327 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:12.235327 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:12.235327 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:12.235327 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:12.235327 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:12.235327 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:12.235327 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:12.235327 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:12.235327 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:12.236217 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 19:22:12.236217 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 19:22:12.236217 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 19:22:12.236217 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 19:22:12.236217 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 19:22:12.236217 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 19:22:12.236217 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:22:12.236217 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:12.241347 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d9a8b0-8283-4e8e-a35d-5d7481cd4c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:12.241347 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9a8b0-8283-4e8e-a35d-5d7481cd4c63 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:12.241347 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9a8b0-8283-4e8e-a35d-5d7481cd4c63 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:12.241347 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9a8b0-8283-4e8e-a35d-5d7481cd4c63 None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:12.241890 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d9a8b0-8283-4e8e-a35d-5d7481cd4c63 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:12.242396 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d9a8b0-8283-4e8e-a35d-5d7481cd4c63 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:12.243692 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 284/591] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Jul 1 19:22:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:12.244153 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d9a8b0-8283-4e8e-a35d-5d7481cd4c63 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:12.244783 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b076c-c027-4343-8626-0d6dfc54ce95 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:12.247948 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:12.266210 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 308/592] 10.222.0.26 () {56 vars in 1139 bytes} [Fri Jul 1 19:22:12 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:12.267148 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d9a8b0-8283-4e8e-a35d-5d7481cd4c63 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:12.269516 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:12.370461 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b076c-c027-4343-8626-0d6dfc54ce95 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:12.376106 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d9a8b0-8283-4e8e-a35d-5d7481cd4c63 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:12.412410 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78ae22e-ead3-4037-8e44-11ec979edcae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:12.413590 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ae22e-ead3-4037-8e44-11ec979edcae None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:12.414126 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ae22e-ead3-4037-8e44-11ec979edcae None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:12.414537 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6473c7-61ef-4e3c-9906-3bfc26de1d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:12.414818 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ae22e-ead3-4037-8e44-11ec979edcae None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:12.415361 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6473c7-61ef-4e3c-9906-3bfc26de1d52 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:12.415721 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6473c7-61ef-4e3c-9906-3bfc26de1d52 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:12.416075 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6473c7-61ef-4e3c-9906-3bfc26de1d52 None admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:12.416463 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78ae22e-ead3-4037-8e44-11ec979edcae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:12.416969 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78ae22e-ead3-4037-8e44-11ec979edcae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:12.417072 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6473c7-61ef-4e3c-9906-3bfc26de1d52 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:12.417405 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6473c7-61ef-4e3c-9906-3bfc26de1d52 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:12.418883 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78ae22e-ead3-4037-8e44-11ec979edcae None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:12.419011 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6473c7-61ef-4e3c-9906-3bfc26de1d52 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:12.437874 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 309/593] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Jul 1 19:22:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:12.437874 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6473c7-61ef-4e3c-9906-3bfc26de1d52 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:12.440781 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 285/594] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Jul 1 19:22:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:12.441709 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78ae22e-ead3-4037-8e44-11ec979edcae None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:12.509783 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:12.536914 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:12.562796 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78ae22e-ead3-4037-8e44-11ec979edcae None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:12.570218 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6473c7-61ef-4e3c-9906-3bfc26de1d52 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:12.601550 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee00d7f-8302-4e08-a6c4-fe2e4e48a352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:12.602475 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee00d7f-8302-4e08-a6c4-fe2e4e48a352 None admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:12.602766 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee00d7f-8302-4e08-a6c4-fe2e4e48a352 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:12.603033 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee00d7f-8302-4e08-a6c4-fe2e4e48a352 None admin] PATH_INFO: `/v3/projects/69c523a41f4048cfb7df553b6feb6310/users/5bbcb2463f9c46ddaaa247e4876aca48/roles/35ca0f0b9a964300a63780ec435e730b` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:12.614293 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b0006-2302-445a-aaa1-f25df5b3fdd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:12.615414 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b0006-2302-445a-aaa1-f25df5b3fdd3 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:12.616002 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b0006-2302-445a-aaa1-f25df5b3fdd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:12.616508 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b0006-2302-445a-aaa1-f25df5b3fdd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:12.619980 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee00d7f-8302-4e08-a6c4-fe2e4e48a352 None admin] RBAC: Authorizing `identity:create_grant(project_id=69c523a41f4048cfb7df553b6feb6310, user_id=5bbcb2463f9c46ddaaa247e4876aca48, role_id=35ca0f0b9a964300a63780ec435e730b)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:12.621382 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee00d7f-8302-4e08-a6c4-fe2e4e48a352 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:12.645268 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 286/595] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Jul 1 19:22:12 2022] PUT /identity/v3/projects/69c523a41f4048cfb7df553b6feb6310/users/5bbcb2463f9c46ddaaa247e4876aca48/roles/35ca0f0b9a964300a63780ec435e730b => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:22:12.645268 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee00d7f-8302-4e08-a6c4-fe2e4e48a352 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:12.645589 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8b0006-2302-445a-aaa1-f25df5b3fdd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:12.645589 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8b0006-2302-445a-aaa1-f25df5b3fdd3 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:12.693703 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-8d8b0006-2302-445a-aaa1-f25df5b3fdd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:12.693703 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:12.693703 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:12.693703 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:12.693703 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:12.693703 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:12.693703 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:12.693703 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:12.693703 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:12.693703 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:12.693703 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:12.693703 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:12.693703 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:22:12.693703 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:22:12.693703 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:22:12.695095 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:22:12.695095 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:12.695095 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:12.695095 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:12.695095 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:12.695095 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:12.695095 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:12.695095 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:12.695095 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:12.695095 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:12.695095 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:12.695095 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:12.695095 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:12.695095 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:12.695095 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:12.695095 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:12.695095 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:12.696586 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:22:12.696586 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:22:12.696586 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:12.696586 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:12.696586 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 310/596] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:22:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:12.706361 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b0006-2302-445a-aaa1-f25df5b3fdd3 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:12.852613 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee00d7f-8302-4e08-a6c4-fe2e4e48a352 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:12.885858 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:12.898681 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b0006-2302-445a-aaa1-f25df5b3fdd3 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:12.900778 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b900f5-32da-436f-81b2-a3258ffb0d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:12.901660 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b900f5-32da-436f-81b2-a3258ffb0d56 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:12.901953 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b900f5-32da-436f-81b2-a3258ffb0d56 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:12.902233 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b900f5-32da-436f-81b2-a3258ffb0d56 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:12.907285 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:12.913583 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b900f5-32da-436f-81b2-a3258ffb0d56 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:12.915178 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b900f5-32da-436f-81b2-a3258ffb0d56 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:12.931795 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-f5b900f5-32da-436f-81b2-a3258ffb0d56 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 01 19:22:12.931795 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:12.931795 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:12.931795 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:12.931795 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:12.931795 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:12.931795 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:12.931795 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:12.931795 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:12.931795 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:12.931795 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:12.931795 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:12.931795 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 19:22:12.931795 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 19:22:12.931795 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 19:22:12.931795 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 19:22:12.932830 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:12.932830 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:12.932830 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 19:22:12.932830 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:22:12.932830 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 19:22:12.932830 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:22:12.932830 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:12.932830 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:12.932830 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:12.932830 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:12.932830 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:12.932830 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:12.932830 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:12.932830 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:12.932830 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:12.932830 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:12.932830 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:12.932830 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:12.933817 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:12.933817 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:12.933817 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 19:22:12.933817 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 19:22:12.933817 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 19:22:12.933817 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 19:22:12.933817 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 19:22:12.933817 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 19:22:12.933817 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 01 19:22:12.933817 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:12.933817 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 287/597] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Jul 1 19:22:12 2022] GET /identity/v3/users/cinder => generated 84 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:12.935689 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff82f0-13f1-48b3-9376-7d73bd61294f None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:12.936044 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff82f0-13f1-48b3-9376-7d73bd61294f None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:12.936393 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff82f0-13f1-48b3-9376-7d73bd61294f None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:12.938003 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 288/598] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:22:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:22:12.940407 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ff82f0-13f1-48b3-9376-7d73bd61294f None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:12.944298 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f793f447-4f75-4d12-8c48-bbb6da9d1da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:12.946233 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793f447-4f75-4d12-8c48-bbb6da9d1da4 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:12.946678 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793f447-4f75-4d12-8c48-bbb6da9d1da4 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:12.947109 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793f447-4f75-4d12-8c48-bbb6da9d1da4 None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:12.947997 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f793f447-4f75-4d12-8c48-bbb6da9d1da4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:12.948462 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f793f447-4f75-4d12-8c48-bbb6da9d1da4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:12.950114 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f793f447-4f75-4d12-8c48-bbb6da9d1da4 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:12.969008 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 311/599] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Jul 1 19:22:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:12.971231 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a95b1-4de1-41ef-8ab2-4de06f9fddfe None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:12.971690 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a95b1-4de1-41ef-8ab2-4de06f9fddfe None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:12.972171 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a95b1-4de1-41ef-8ab2-4de06f9fddfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:12.993039 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-682a95b1-4de1-41ef-8ab2-4de06f9fddfe None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:22:12.994608 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-682a95b1-4de1-41ef-8ab2-4de06f9fddfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:22:13.062079 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ff82f0-13f1-48b3-9376-7d73bd61294f None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:13.068388 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 312/600] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:22:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:22:13.069563 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a95b1-4de1-41ef-8ab2-4de06f9fddfe None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:13.107880 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d967839-13f8-4c7c-aaf1-facdacd204a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:13.108630 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d967839-13f8-4c7c-aaf1-facdacd204a0 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:13.109037 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d967839-13f8-4c7c-aaf1-facdacd204a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:13.109592 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d967839-13f8-4c7c-aaf1-facdacd204a0 None admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:13.111205 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d967839-13f8-4c7c-aaf1-facdacd204a0 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:13.111848 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d967839-13f8-4c7c-aaf1-facdacd204a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:13.114090 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d967839-13f8-4c7c-aaf1-facdacd204a0 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:13.134623 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 289/601] 10.222.0.26 () {56 vars in 1137 bytes} [Fri Jul 1 19:22:12 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:13.135452 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d967839-13f8-4c7c-aaf1-facdacd204a0 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:13.179223 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:13.183615 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:13.189091 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a95b1-4de1-41ef-8ab2-4de06f9fddfe None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:13.229275 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac791878-5c0f-445e-98f8-15f27b05f1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:13.230381 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac791878-5c0f-445e-98f8-15f27b05f1ae None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:13.230814 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac791878-5c0f-445e-98f8-15f27b05f1ae None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:13.231341 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac791878-5c0f-445e-98f8-15f27b05f1ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:13.239568 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac791878-5c0f-445e-98f8-15f27b05f1ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:13.240924 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d967839-13f8-4c7c-aaf1-facdacd204a0 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:13.241517 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac791878-5c0f-445e-98f8-15f27b05f1ae None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:13.257205 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-ac791878-5c0f-445e-98f8-15f27b05f1ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:22:13.257205 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:13.257205 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:13.257205 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:13.257205 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:13.257205 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:13.257205 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:13.257205 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:13.257205 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:13.257205 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:13.257205 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:13.257205 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:13.257205 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 19:22:13.257205 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 19:22:13.257205 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 19:22:13.258438 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 19:22:13.258438 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:13.258438 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:13.258438 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:13.258438 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:13.258438 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:13.258438 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:13.258438 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:13.258438 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:13.258438 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:13.258438 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:13.258438 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:13.258438 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:13.258438 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:13.258438 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:13.258438 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:13.258438 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:13.259533 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 19:22:13.259533 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 19:22:13.259533 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 19:22:13.259533 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 19:22:13.259533 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 19:22:13.259533 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 19:22:13.259533 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:22:13.259533 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:13.262035 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 313/602] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Jul 1 19:22:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:13.263097 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac791878-5c0f-445e-98f8-15f27b05f1ae None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:13.288231 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9ed715-ea29-4acf-a65f-fc165c1296ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:13.289049 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ed715-ea29-4acf-a65f-fc165c1296ca None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:13.289445 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ed715-ea29-4acf-a65f-fc165c1296ca None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:13.289640 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ed715-ea29-4acf-a65f-fc165c1296ca None admin] PATH_INFO: `/v3/roles/service` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:13.301560 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9ed715-ea29-4acf-a65f-fc165c1296ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:22:13.310354 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-fe9ed715-ea29-4acf-a65f-fc165c1296ca None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:22:13.310354 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:13.310354 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:13.310354 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:13.310354 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:13.310354 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:13.310354 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:13.310354 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:13.310354 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:13.310354 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:13.310354 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:13.310354 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:13.310354 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:22:13.310354 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:22:13.310354 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:22:13.310354 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:22:13.312160 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:22:13.312160 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:22:13.312160 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:22:13.312160 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:22:13.312160 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:13.312160 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:13.312160 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:13.312160 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:13.312160 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:13.312160 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:13.312160 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:13.312160 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:13.312160 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:13.312160 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:13.312160 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:13.312160 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:13.313797 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:13.313797 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:13.313797 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:13.313797 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:13.313797 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:22:13.313797 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:22:13.313797 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:22:13.313797 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:22:13.313797 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:22:13.313797 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:22:13.313797 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:22:13.313797 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:13.313797 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 290/603] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Jul 1 19:22:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:13.313797 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9ed715-ea29-4acf-a65f-fc165c1296ca None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:13.387659 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac791878-5c0f-445e-98f8-15f27b05f1ae None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:13.426243 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5386b83d-e8c3-477c-8f7e-885b1a434a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:13.427132 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386b83d-e8c3-477c-8f7e-885b1a434a80 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:13.427425 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386b83d-e8c3-477c-8f7e-885b1a434a80 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:13.427705 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386b83d-e8c3-477c-8f7e-885b1a434a80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:13.432749 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9ed715-ea29-4acf-a65f-fc165c1296ca None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:13.435318 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:13.440781 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5386b83d-e8c3-477c-8f7e-885b1a434a80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:13.442623 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5386b83d-e8c3-477c-8f7e-885b1a434a80 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:13.463259 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-5386b83d-e8c3-477c-8f7e-885b1a434a80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:13.463259 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:13.463259 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:13.463259 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:13.463259 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:13.463259 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:13.463259 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:13.463259 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:13.463259 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:13.463259 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:13.463259 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:13.463259 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:13.463259 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:22:13.463259 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:22:13.463259 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:22:13.464435 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:22:13.464435 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:13.464435 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:13.464435 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:13.464435 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:13.464435 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:13.464435 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:13.464435 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:13.464435 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:13.464435 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:13.464435 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:13.464435 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:13.464435 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:13.464435 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:13.464435 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:13.464435 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:13.464435 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:13.465516 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:22:13.465516 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:22:13.465516 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:13.465516 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:13.467883 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 314/604] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:22:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:13.468835 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5386b83d-e8c3-477c-8f7e-885b1a434a80 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:13.470730 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e379919-8b09-459a-a5d9-db41f2b23fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:13.471451 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e379919-8b09-459a-a5d9-db41f2b23fb9 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:13.471784 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e379919-8b09-459a-a5d9-db41f2b23fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:13.472069 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e379919-8b09-459a-a5d9-db41f2b23fb9 None admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:13.472982 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e379919-8b09-459a-a5d9-db41f2b23fb9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:13.473323 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e379919-8b09-459a-a5d9-db41f2b23fb9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:13.474953 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e379919-8b09-459a-a5d9-db41f2b23fb9 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:13.482691 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:13.495881 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 291/605] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Jul 1 19:22:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:13.497182 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e379919-8b09-459a-a5d9-db41f2b23fb9 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:13.595955 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5386b83d-e8c3-477c-8f7e-885b1a434a80 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:13.610814 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e379919-8b09-459a-a5d9-db41f2b23fb9 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:13.644689 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac150e22-abf9-498e-9f7b-f3277aa18b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:13.645398 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac150e22-abf9-498e-9f7b-f3277aa18b39 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:13.645745 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac150e22-abf9-498e-9f7b-f3277aa18b39 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:13.645967 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac150e22-abf9-498e-9f7b-f3277aa18b39 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:13.646825 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac150e22-abf9-498e-9f7b-f3277aa18b39 None admin] RBAC: Adding query filter params (name=service) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:13.647148 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac150e22-abf9-498e-9f7b-f3277aa18b39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:13.648533 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac150e22-abf9-498e-9f7b-f3277aa18b39 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:13.650411 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09896334-88c6-408b-9167-b39b7618d8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:13.651360 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09896334-88c6-408b-9167-b39b7618d8bb None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:13.651799 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09896334-88c6-408b-9167-b39b7618d8bb None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:13.652389 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09896334-88c6-408b-9167-b39b7618d8bb None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:13.653347 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09896334-88c6-408b-9167-b39b7618d8bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:13.653802 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09896334-88c6-408b-9167-b39b7618d8bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:13.656007 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09896334-88c6-408b-9167-b39b7618d8bb None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:13.664040 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 315/606] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Jul 1 19:22:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:13.664040 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac150e22-abf9-498e-9f7b-f3277aa18b39 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:13.672605 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 292/607] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Jul 1 19:22:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:13.673754 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09896334-88c6-408b-9167-b39b7618d8bb None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:13.708218 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:13.752686 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:13.796330 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac150e22-abf9-498e-9f7b-f3277aa18b39 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:13.807650 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09896334-88c6-408b-9167-b39b7618d8bb None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:13.842389 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2634bd-159c-400b-8656-e6647a1c274d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:13.844118 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2634bd-159c-400b-8656-e6647a1c274d None admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:13.844573 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2634bd-159c-400b-8656-e6647a1c274d None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:13.845111 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2634bd-159c-400b-8656-e6647a1c274d None admin] PATH_INFO: `/v3/projects/69c523a41f4048cfb7df553b6feb6310/users/4557d17438a249ee8f75927449a1a059/roles/35ca0f0b9a964300a63780ec435e730b` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:13.848187 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28a6b7c-407b-4868-99ea-79987ac07488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:13.849042 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a6b7c-407b-4868-99ea-79987ac07488 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:13.850133 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a6b7c-407b-4868-99ea-79987ac07488 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:13.850133 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a6b7c-407b-4868-99ea-79987ac07488 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:13.864941 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28a6b7c-407b-4868-99ea-79987ac07488 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:13.866387 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2634bd-159c-400b-8656-e6647a1c274d None admin] RBAC: Authorizing `identity:create_grant(project_id=69c523a41f4048cfb7df553b6feb6310, user_id=4557d17438a249ee8f75927449a1a059, role_id=35ca0f0b9a964300a63780ec435e730b)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:13.866898 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28a6b7c-407b-4868-99ea-79987ac07488 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:13.868051 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2634bd-159c-400b-8656-e6647a1c274d None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:13.892775 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 316/608] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Jul 1 19:22:13 2022] PUT /identity/v3/projects/69c523a41f4048cfb7df553b6feb6310/users/4557d17438a249ee8f75927449a1a059/roles/35ca0f0b9a964300a63780ec435e730b => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:22:13.892775 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2634bd-159c-400b-8656-e6647a1c274d None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:13.893052 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-a28a6b7c-407b-4868-99ea-79987ac07488 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:13.893052 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:13.893052 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:13.893052 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:13.893052 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:13.893052 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:13.893052 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:13.893052 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:13.893052 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:13.893052 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:13.893052 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:13.893052 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:13.893052 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:22:13.893052 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:22:13.893052 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:22:13.894034 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:22:13.894034 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:13.894034 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:13.894034 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:13.894034 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:13.894034 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:13.894034 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:13.894034 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:13.894034 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:13.894034 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:13.894034 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:13.894034 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:13.894034 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:13.894034 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:13.894034 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:13.894034 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:13.894034 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:13.894977 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:22:13.894977 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:22:13.894977 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:13.894977 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:13.894977 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 293/609] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:22:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:13.904790 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28a6b7c-407b-4868-99ea-79987ac07488 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:14.056891 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:14.099496 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28a6b7c-407b-4868-99ea-79987ac07488 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:14.117832 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2634bd-159c-400b-8656-e6647a1c274d None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:14.145100 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:14.151934 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e389b2-87c6-45a7-ac23-67d08f35e569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:14.153315 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e389b2-87c6-45a7-ac23-67d08f35e569 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:14.154710 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e389b2-87c6-45a7-ac23-67d08f35e569 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:14.155400 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e389b2-87c6-45a7-ac23-67d08f35e569 None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:14.156899 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e389b2-87c6-45a7-ac23-67d08f35e569 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:14.157561 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e389b2-87c6-45a7-ac23-67d08f35e569 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:14.159196 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e389b2-87c6-45a7-ac23-67d08f35e569 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:14.161863 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794f65b9-fb16-4252-8f91-2603f3e57292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:14.163151 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f65b9-fb16-4252-8f91-2603f3e57292 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:14.163446 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f65b9-fb16-4252-8f91-2603f3e57292 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:14.163728 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f65b9-fb16-4252-8f91-2603f3e57292 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:14.171852 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794f65b9-fb16-4252-8f91-2603f3e57292 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:14.173968 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794f65b9-fb16-4252-8f91-2603f3e57292 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:14.176496 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 294/610] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Jul 1 19:22:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:14.185856 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e389b2-87c6-45a7-ac23-67d08f35e569 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:14.194563 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-794f65b9-fb16-4252-8f91-2603f3e57292 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:22:14.194563 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:14.194563 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:14.194563 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:14.194563 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:14.194563 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:14.194563 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:14.194563 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:14.194563 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:14.194563 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:14.194563 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:14.194563 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:14.194563 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 19:22:14.194563 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 19:22:14.194563 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 19:22:14.195480 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 19:22:14.195480 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:14.195480 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:14.195480 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:14.195480 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:14.195480 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:14.195480 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:14.195480 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:14.195480 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:14.195480 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:14.195480 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:14.195480 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:14.195480 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:14.195480 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:14.195480 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:14.195480 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:14.195480 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:14.196373 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 19:22:14.196373 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 19:22:14.196373 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 19:22:14.196373 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 19:22:14.196373 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 19:22:14.196373 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 19:22:14.196373 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:22:14.196373 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:14.196373 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 317/611] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Jul 1 19:22:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:14.207050 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794f65b9-fb16-4252-8f91-2603f3e57292 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:14.364535 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794f65b9-fb16-4252-8f91-2603f3e57292 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:14.372505 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e389b2-87c6-45a7-ac23-67d08f35e569 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:14.410860 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddd6f2b-35d2-492d-a794-240f3f48f439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:14.411632 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd6f2b-35d2-492d-a794-240f3f48f439 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:14.411922 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd6f2b-35d2-492d-a794-240f3f48f439 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:14.412203 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd6f2b-35d2-492d-a794-240f3f48f439 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:14.415507 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:14.421303 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddd6f2b-35d2-492d-a794-240f3f48f439 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:14.421836 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89e962a-d3d6-4930-a56a-f0d042ae23bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:14.422756 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e962a-d3d6-4930-a56a-f0d042ae23bf None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:14.422872 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddd6f2b-35d2-492d-a794-240f3f48f439 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:14.423455 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e962a-d3d6-4930-a56a-f0d042ae23bf None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:14.423941 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e962a-d3d6-4930-a56a-f0d042ae23bf None admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:14.425041 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89e962a-d3d6-4930-a56a-f0d042ae23bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:14.425591 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89e962a-d3d6-4930-a56a-f0d042ae23bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:14.427313 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89e962a-d3d6-4930-a56a-f0d042ae23bf None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:14.441447 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 318/612] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Jul 1 19:22:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:14.441637 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-cddd6f2b-35d2-492d-a794-240f3f48f439 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 01 19:22:14.441637 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:14.441637 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:14.441637 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:14.441637 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:14.441637 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:14.441637 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:14.441637 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:14.441637 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:14.441637 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:14.441637 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:14.441637 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:14.441637 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 19:22:14.441637 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 19:22:14.441637 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 19:22:14.441637 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 19:22:14.442559 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:14.442559 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:14.442559 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 19:22:14.442559 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:22:14.442559 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 19:22:14.442559 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:22:14.442559 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:14.442559 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:14.442559 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:14.442559 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:14.442559 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:14.442559 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:14.442559 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:14.442559 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:14.442559 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:14.442559 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:14.442559 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:14.442559 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:14.443509 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:14.443509 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:14.443509 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 19:22:14.443509 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 19:22:14.443509 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 19:22:14.443509 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 19:22:14.443509 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 19:22:14.443509 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 19:22:14.443509 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 01 19:22:14.443509 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:14.443509 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 295/613] 10.222.0.26 () {56 vars in 1093 bytes} [Fri Jul 1 19:22:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:14.444625 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25e42a-bd33-474e-9398-20f33114eb17 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:14.444625 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25e42a-bd33-474e-9398-20f33114eb17 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:14.444791 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25e42a-bd33-474e-9398-20f33114eb17 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:14.449378 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89e962a-d3d6-4930-a56a-f0d042ae23bf None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:14.451672 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 296/614] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:22:14 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:22:14.452492 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac25e42a-bd33-474e-9398-20f33114eb17 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:14.496947 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:14.575607 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89e962a-d3d6-4930-a56a-f0d042ae23bf None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:14.577117 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac25e42a-bd33-474e-9398-20f33114eb17 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:14.622170 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d1ce18-2919-45b3-930b-adeb72572d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:14.623171 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d1ce18-2919-45b3-930b-adeb72572d03 None admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:14.623504 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d1ce18-2919-45b3-930b-adeb72572d03 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:14.624224 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1652d8-c347-4054-81c4-0d788d994ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:14.625001 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1652d8-c347-4054-81c4-0d788d994ea1 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:14.625426 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1652d8-c347-4054-81c4-0d788d994ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:14.625806 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1652d8-c347-4054-81c4-0d788d994ea1 None admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:14.626030 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d1ce18-2919-45b3-930b-adeb72572d03 None admin] PATH_INFO: `/v3/projects/69c523a41f4048cfb7df553b6feb6310/users/9a3ed285ee4c4d04abf7daf0aeb9fb7c/roles/35ca0f0b9a964300a63780ec435e730b` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:14.626920 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1652d8-c347-4054-81c4-0d788d994ea1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:14.627340 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1652d8-c347-4054-81c4-0d788d994ea1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:14.629246 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1652d8-c347-4054-81c4-0d788d994ea1 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:14.646427 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d1ce18-2919-45b3-930b-adeb72572d03 None admin] RBAC: Authorizing `identity:create_grant(project_id=69c523a41f4048cfb7df553b6feb6310, user_id=9a3ed285ee4c4d04abf7daf0aeb9fb7c, role_id=35ca0f0b9a964300a63780ec435e730b)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:14.648047 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d1ce18-2919-45b3-930b-adeb72572d03 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:14.654855 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 297/615] 10.222.0.26 () {56 vars in 1133 bytes} [Fri Jul 1 19:22:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:14.656390 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872ca26-1ea2-42e8-8f5c-719496a7bafd None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:14.656920 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872ca26-1ea2-42e8-8f5c-719496a7bafd None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:14.657480 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872ca26-1ea2-42e8-8f5c-719496a7bafd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:14.672908 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 319/616] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Jul 1 19:22:14 2022] PUT /identity/v3/projects/69c523a41f4048cfb7df553b6feb6310/users/9a3ed285ee4c4d04abf7daf0aeb9fb7c/roles/35ca0f0b9a964300a63780ec435e730b => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:22:14.673945 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d1ce18-2919-45b3-930b-adeb72572d03 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:14.678482 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-a872ca26-1ea2-42e8-8f5c-719496a7bafd None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:22:14.680240 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-a872ca26-1ea2-42e8-8f5c-719496a7bafd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:22:14.765356 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:14.807622 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 298/617] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:22:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:22:14.830575 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a872ca26-1ea2-42e8-8f5c-719496a7bafd None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:14.865630 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:14.882708 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d1ce18-2919-45b3-930b-adeb72572d03 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:14.926407 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33edd658-ae65-4ee3-80bf-2048124d48e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:14.927074 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33edd658-ae65-4ee3-80bf-2048124d48e0 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:14.927299 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33edd658-ae65-4ee3-80bf-2048124d48e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:14.927585 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33edd658-ae65-4ee3-80bf-2048124d48e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:14.986911 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a872ca26-1ea2-42e8-8f5c-719496a7bafd None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:15.024467 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e1c059-2919-46e3-b6ff-c94cbd21d0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:15.026317 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1c059-2919-46e3-b6ff-c94cbd21d0ef None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:15.027062 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1c059-2919-46e3-b6ff-c94cbd21d0ef None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:15.027755 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1c059-2919-46e3-b6ff-c94cbd21d0ef None admin] PATH_INFO: `/v3/roles/service` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:15.030554 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33edd658-ae65-4ee3-80bf-2048124d48e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:15.032003 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33edd658-ae65-4ee3-80bf-2048124d48e0 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:15.040787 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e1c059-2919-46e3-b6ff-c94cbd21d0ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:22:15.049755 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-91e1c059-2919-46e3-b6ff-c94cbd21d0ef None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:22:15.049755 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:15.049755 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:15.049755 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:15.049755 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:15.049755 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:15.049755 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:15.049755 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:15.049755 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:15.049755 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:15.049755 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:15.049755 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:15.049755 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:22:15.049755 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:22:15.049755 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:22:15.049755 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:22:15.050747 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:22:15.050747 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:22:15.050747 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:22:15.050747 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:22:15.050747 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:15.050747 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:15.050747 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:15.050747 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:15.050747 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:15.050747 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:15.050747 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:15.050747 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:15.050747 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:15.050747 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:15.050747 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:15.050747 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:15.051754 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:15.051754 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:15.051754 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:15.051754 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:15.051754 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:22:15.051754 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:22:15.051754 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:22:15.051754 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:22:15.051754 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:22:15.051754 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:22:15.051754 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:22:15.051754 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:15.055416 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 299/618] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Jul 1 19:22:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:22:15.061780 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e1c059-2919-46e3-b6ff-c94cbd21d0ef None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:15.117636 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:15.175199 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e1c059-2919-46e3-b6ff-c94cbd21d0ef None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:15.196626 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:15.215289 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 320/619] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Jul 1 19:22:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 19:22:15.221514 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33edd658-ae65-4ee3-80bf-2048124d48e0 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:15.243500 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae428374-601c-4fb4-a062-e7a8af9dd577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:15.244902 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae428374-601c-4fb4-a062-e7a8af9dd577 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:15.245427 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae428374-601c-4fb4-a062-e7a8af9dd577 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:15.245906 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae428374-601c-4fb4-a062-e7a8af9dd577 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:15.247019 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae428374-601c-4fb4-a062-e7a8af9dd577 None admin] RBAC: Adding query filter params (name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:15.248479 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae428374-601c-4fb4-a062-e7a8af9dd577 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:15.250147 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae428374-601c-4fb4-a062-e7a8af9dd577 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:15.270328 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 300/620] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Jul 1 19:22:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:22:15.276720 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae428374-601c-4fb4-a062-e7a8af9dd577 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:15.387658 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae428374-601c-4fb4-a062-e7a8af9dd577 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:15.405745 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:15.440002 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78637b0a-5103-422a-aaa1-b76402626a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:15.440810 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78637b0a-5103-422a-aaa1-b76402626a96 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:15.441095 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78637b0a-5103-422a-aaa1-b76402626a96 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:15.441399 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78637b0a-5103-422a-aaa1-b76402626a96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:15.454320 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78637b0a-5103-422a-aaa1-b76402626a96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:15.455717 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78637b0a-5103-422a-aaa1-b76402626a96 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:15.456121 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33edd658-ae65-4ee3-80bf-2048124d48e0 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:15.474686 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-78637b0a-5103-422a-aaa1-b76402626a96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:15.474686 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:15.474686 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:15.474686 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:15.474686 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:15.474686 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:15.474686 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:15.474686 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:15.474686 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:15.474686 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:15.474686 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:15.474686 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:15.474686 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:22:15.474686 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:22:15.474686 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:22:15.475670 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:22:15.475670 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:15.475670 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:15.475670 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:15.475670 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:15.475670 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:15.475670 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:15.475670 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:15.475670 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:15.475670 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:15.475670 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:15.475670 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:15.475670 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:15.475670 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:15.475670 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:15.475670 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:15.475670 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:15.476639 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:22:15.476639 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:22:15.476639 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:15.476639 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:15.476639 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 301/621] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:22:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:15.477770 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd73aa4d-0f33-47aa-9393-5fb842239bd7 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:15.480978 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd73aa4d-0f33-47aa-9393-5fb842239bd7 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:15.480978 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd73aa4d-0f33-47aa-9393-5fb842239bd7 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:15.484782 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 302/622] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:22:15 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:22:15.485699 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd73aa4d-0f33-47aa-9393-5fb842239bd7 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:15.500151 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28578c13-d1f2-47ac-9283-f15f53c227aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:15.501285 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28578c13-d1f2-47ac-9283-f15f53c227aa None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:15.501589 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28578c13-d1f2-47ac-9283-f15f53c227aa None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:15.501876 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28578c13-d1f2-47ac-9283-f15f53c227aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:15.515339 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28578c13-d1f2-47ac-9283-f15f53c227aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:15.517256 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28578c13-d1f2-47ac-9283-f15f53c227aa None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:15.539526 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-28578c13-d1f2-47ac-9283-f15f53c227aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:15.539526 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:15.539526 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:15.539526 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:15.539526 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:15.539526 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:15.539526 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:15.539526 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:15.539526 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:15.539526 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:15.539526 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:15.539526 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:15.539526 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:22:15.539526 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:22:15.539526 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:22:15.540656 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:22:15.540656 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:15.540656 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:15.540656 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:15.540656 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:15.540656 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:15.540656 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:15.540656 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:15.540656 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:15.540656 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:15.540656 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:15.540656 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:15.540656 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:15.540656 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:15.540656 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:15.540656 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:15.540656 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:15.541756 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:22:15.541756 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:22:15.541756 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:15.541756 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:15.541756 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 321/623] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:22:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:15.545254 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4251796-c335-4022-a87c-06d6fe76894c None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:15.545254 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4251796-c335-4022-a87c-06d6fe76894c None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:15.545254 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4251796-c335-4022-a87c-06d6fe76894c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:15.568810 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-f4251796-c335-4022-a87c-06d6fe76894c None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:22:15.570427 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-f4251796-c335-4022-a87c-06d6fe76894c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:22:15.614262 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd73aa4d-0f33-47aa-9393-5fb842239bd7 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:15.624619 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:15.665091 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2173bdbf-d4ca-4dac-b6a8-a0da4e3cbd6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:15.666074 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2173bdbf-d4ca-4dac-b6a8-a0da4e3cbd6b None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:15.666521 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2173bdbf-d4ca-4dac-b6a8-a0da4e3cbd6b None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:15.667079 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2173bdbf-d4ca-4dac-b6a8-a0da4e3cbd6b None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:15.668223 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2173bdbf-d4ca-4dac-b6a8-a0da4e3cbd6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:15.668752 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2173bdbf-d4ca-4dac-b6a8-a0da4e3cbd6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:15.675335 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2173bdbf-d4ca-4dac-b6a8-a0da4e3cbd6b None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:15.675516 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 322/624] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:22:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:22:15.675516 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4251796-c335-4022-a87c-06d6fe76894c None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:15.710181 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 303/625] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Jul 1 19:22:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:15.715380 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2173bdbf-d4ca-4dac-b6a8-a0da4e3cbd6b None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:15.748905 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:15.780369 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4251796-c335-4022-a87c-06d6fe76894c None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:15.819925 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e182e7da-9482-4dbc-a0f5-e472153a3104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:15.820994 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e182e7da-9482-4dbc-a0f5-e472153a3104 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:15.821648 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e182e7da-9482-4dbc-a0f5-e472153a3104 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:15.821937 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e182e7da-9482-4dbc-a0f5-e472153a3104 None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:15.822679 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e182e7da-9482-4dbc-a0f5-e472153a3104 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:15.822988 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e182e7da-9482-4dbc-a0f5-e472153a3104 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:15.824360 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e182e7da-9482-4dbc-a0f5-e472153a3104 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:15.838007 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 323/626] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Jul 1 19:22:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:15.838706 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e182e7da-9482-4dbc-a0f5-e472153a3104 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:15.849470 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2173bdbf-d4ca-4dac-b6a8-a0da4e3cbd6b None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:15.875635 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:15.900426 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7594704-4da7-4483-be08-9acdc95d5cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:15.901381 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7594704-4da7-4483-be08-9acdc95d5cfc None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:15.901677 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7594704-4da7-4483-be08-9acdc95d5cfc None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:15.902069 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7594704-4da7-4483-be08-9acdc95d5cfc None admin] PATH_INFO: `/v3/users/swift` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:15.910835 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7594704-4da7-4483-be08-9acdc95d5cfc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:15.912495 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7594704-4da7-4483-be08-9acdc95d5cfc None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:15.929744 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-f7594704-4da7-4483-be08-9acdc95d5cfc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 01 19:22:15.929744 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:15.929744 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:15.929744 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:15.929744 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:15.929744 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:15.929744 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:15.929744 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:15.929744 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:15.929744 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:15.929744 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:15.929744 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:15.929744 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 19:22:15.929744 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 19:22:15.929744 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 19:22:15.929744 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 19:22:15.931001 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:15.931001 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:15.931001 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 19:22:15.931001 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:22:15.931001 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 19:22:15.931001 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:22:15.931001 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:15.931001 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:15.931001 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:15.931001 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:15.931001 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:15.931001 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:15.931001 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:15.931001 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:15.931001 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:15.931001 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:15.931001 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:15.931001 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:15.932225 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:15.932225 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:15.932225 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 19:22:15.932225 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 19:22:15.932225 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 19:22:15.932225 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 19:22:15.932225 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 19:22:15.932225 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 19:22:15.932225 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 01 19:22:15.932225 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:15.932225 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 304/627] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Jul 1 19:22:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:22:15.932225 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7594704-4da7-4483-be08-9acdc95d5cfc None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:15.971229 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e182e7da-9482-4dbc-a0f5-e472153a3104 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:16.008398 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7498ac84-ddcb-4962-81e7-b1fb77d54668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:16.009551 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7498ac84-ddcb-4962-81e7-b1fb77d54668 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:16.009937 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7498ac84-ddcb-4962-81e7-b1fb77d54668 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:16.010311 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7498ac84-ddcb-4962-81e7-b1fb77d54668 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:16.021786 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7498ac84-ddcb-4962-81e7-b1fb77d54668 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:22:16.027062 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:16.034931 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-7498ac84-ddcb-4962-81e7-b1fb77d54668 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:22:16.034931 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:16.034931 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:16.034931 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:16.034931 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:16.034931 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:16.034931 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:16.034931 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:16.034931 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:16.034931 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:16.034931 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:16.034931 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:16.034931 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:22:16.034931 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:22:16.034931 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:22:16.034931 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:22:16.035896 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:22:16.035896 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:22:16.035896 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:22:16.035896 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:22:16.035896 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:16.035896 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:16.035896 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:16.035896 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:16.035896 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:16.035896 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:16.035896 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:16.035896 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:16.035896 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:16.035896 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:16.035896 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:16.035896 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:16.036826 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:16.036826 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:16.036826 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:16.036826 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:16.036826 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:22:16.036826 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:22:16.036826 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:22:16.036826 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:22:16.036826 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:22:16.036826 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:22:16.036826 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:22:16.036826 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:16.036826 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 324/628] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Jul 1 19:22:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:16.037573 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7498ac84-ddcb-4962-81e7-b1fb77d54668 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:16.063883 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7594704-4da7-4483-be08-9acdc95d5cfc None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:16.102479 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f5d65b-3d42-4af6-ab77-b921bc022301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:16.103429 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f5d65b-3d42-4af6-ab77-b921bc022301 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:16.103730 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f5d65b-3d42-4af6-ab77-b921bc022301 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:16.104011 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f5d65b-3d42-4af6-ab77-b921bc022301 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:16.112946 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f5d65b-3d42-4af6-ab77-b921bc022301 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:16.114531 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f5d65b-3d42-4af6-ab77-b921bc022301 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:16.130312 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-81f5d65b-3d42-4af6-ab77-b921bc022301 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:22:16.130312 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:16.130312 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:16.130312 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:16.130312 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:16.130312 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:16.130312 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:16.130312 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:16.130312 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:16.130312 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:16.130312 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:16.130312 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:16.130312 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 19:22:16.130312 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 19:22:16.130312 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 19:22:16.131299 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 19:22:16.131299 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:16.131299 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:16.131299 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:16.131299 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:16.131299 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:16.131299 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:16.131299 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:16.131299 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:16.131299 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:16.131299 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:16.131299 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:16.131299 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:16.131299 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:16.131299 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:16.131299 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:16.131299 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:16.132225 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 19:22:16.132225 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 19:22:16.132225 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 19:22:16.132225 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 19:22:16.132225 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 19:22:16.132225 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 19:22:16.132225 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:22:16.132225 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:16.136597 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 305/629] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Jul 1 19:22:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:16.137778 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f5d65b-3d42-4af6-ab77-b921bc022301 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:16.149470 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:16.160118 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7498ac84-ddcb-4962-81e7-b1fb77d54668 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:16.198790 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841a0da2-3c90-4959-9a5f-1112118e258d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:16.199630 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a0da2-3c90-4959-9a5f-1112118e258d None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:16.200115 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a0da2-3c90-4959-9a5f-1112118e258d None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:16.200499 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a0da2-3c90-4959-9a5f-1112118e258d None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:16.202112 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841a0da2-3c90-4959-9a5f-1112118e258d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:16.202531 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841a0da2-3c90-4959-9a5f-1112118e258d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:16.204096 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841a0da2-3c90-4959-9a5f-1112118e258d None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:16.224796 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 325/630] 10.222.0.26 () {56 vars in 1135 bytes} [Fri Jul 1 19:22:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:16.225991 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841a0da2-3c90-4959-9a5f-1112118e258d None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:16.261203 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f5d65b-3d42-4af6-ab77-b921bc022301 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:16.299677 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792036a4-6a65-472e-9863-7d0c1bfa4d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:16.300349 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792036a4-6a65-472e-9863-7d0c1bfa4d18 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:16.300636 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792036a4-6a65-472e-9863-7d0c1bfa4d18 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:16.300924 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792036a4-6a65-472e-9863-7d0c1bfa4d18 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:16.301712 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792036a4-6a65-472e-9863-7d0c1bfa4d18 None admin] RBAC: Adding query filter params (name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:16.302029 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792036a4-6a65-472e-9863-7d0c1bfa4d18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:16.303707 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792036a4-6a65-472e-9863-7d0c1bfa4d18 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:16.309147 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:16.317546 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 306/631] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Jul 1 19:22:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:16.318268 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792036a4-6a65-472e-9863-7d0c1bfa4d18 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:16.335833 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841a0da2-3c90-4959-9a5f-1112118e258d None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:16.374400 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f3bdd-c0a9-4ce5-b3fd-239449fddee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:16.375185 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f3bdd-c0a9-4ce5-b3fd-239449fddee7 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:16.375474 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f3bdd-c0a9-4ce5-b3fd-239449fddee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:16.375814 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f3bdd-c0a9-4ce5-b3fd-239449fddee7 None admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:16.376782 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1f3bdd-c0a9-4ce5-b3fd-239449fddee7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:16.377105 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1f3bdd-c0a9-4ce5-b3fd-239449fddee7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:16.378693 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1f3bdd-c0a9-4ce5-b3fd-239449fddee7 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:16.397573 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 326/632] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Jul 1 19:22:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:16.399355 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0173d76-48e3-4fa1-a780-575943597c92 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:16.399646 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0173d76-48e3-4fa1-a780-575943597c92 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:16.399931 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0173d76-48e3-4fa1-a780-575943597c92 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:16.405872 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 327/633] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:22:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:22:16.405872 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0173d76-48e3-4fa1-a780-575943597c92 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:16.417667 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:16.427599 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792036a4-6a65-472e-9863-7d0c1bfa4d18 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:16.466466 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88190f5d-038c-40bd-aabc-bfdd0d91207b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:16.468266 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88190f5d-038c-40bd-aabc-bfdd0d91207b None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:16.468874 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88190f5d-038c-40bd-aabc-bfdd0d91207b None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:16.469400 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88190f5d-038c-40bd-aabc-bfdd0d91207b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:16.482823 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88190f5d-038c-40bd-aabc-bfdd0d91207b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:16.484524 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88190f5d-038c-40bd-aabc-bfdd0d91207b None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:16.504589 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-88190f5d-038c-40bd-aabc-bfdd0d91207b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:16.504589 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:16.504589 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:16.504589 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:16.504589 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:16.504589 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:16.504589 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:16.504589 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:16.504589 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:16.504589 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:16.504589 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:16.504589 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:16.504589 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:22:16.504589 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:22:16.504589 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:22:16.505765 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:22:16.505765 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:16.505765 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:16.505765 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:16.505765 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:16.505765 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:16.505765 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:16.505765 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:16.505765 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:16.505765 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:16.505765 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:16.505765 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:16.505765 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:16.505765 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:16.505765 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:16.505765 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:16.505765 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:16.506939 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:22:16.506939 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:22:16.506939 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:16.506939 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:16.510598 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 307/634] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:22:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:16.511456 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88190f5d-038c-40bd-aabc-bfdd0d91207b None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:16.513964 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0173d76-48e3-4fa1-a780-575943597c92 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:16.549973 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd124ba6-c57d-4e05-a8e4-756e6de6af8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:16.550768 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd124ba6-c57d-4e05-a8e4-756e6de6af8a None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:16.551049 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd124ba6-c57d-4e05-a8e4-756e6de6af8a None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:16.551326 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd124ba6-c57d-4e05-a8e4-756e6de6af8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:16.563981 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd124ba6-c57d-4e05-a8e4-756e6de6af8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:16.565454 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd124ba6-c57d-4e05-a8e4-756e6de6af8a None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:16.569740 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:16.585573 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-dd124ba6-c57d-4e05-a8e4-756e6de6af8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:16.585573 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:16.585573 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:16.585573 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:16.585573 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:16.585573 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:16.585573 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:16.585573 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:16.585573 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:16.585573 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:16.585573 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:16.585573 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:16.585573 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:22:16.585573 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:22:16.585573 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:22:16.586765 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:22:16.586765 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:16.586765 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:16.586765 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:16.586765 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:16.586765 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:16.586765 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:16.586765 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:16.586765 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:16.586765 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:16.586765 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:16.586765 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:16.586765 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:16.586765 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:16.586765 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:16.586765 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:16.586765 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:16.587893 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:22:16.587893 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:22:16.587893 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:16.587893 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:16.591368 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 328/635] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:22:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:16.593323 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e4008-84f7-40d4-9a1b-f635fdb72cbe None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:16.593615 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e4008-84f7-40d4-9a1b-f635fdb72cbe None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:16.593908 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e4008-84f7-40d4-9a1b-f635fdb72cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:16.610801 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-ff8e4008-84f7-40d4-9a1b-f635fdb72cbe None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:22:16.611991 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-ff8e4008-84f7-40d4-9a1b-f635fdb72cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:22:16.629173 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88190f5d-038c-40bd-aabc-bfdd0d91207b None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:16.667380 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9306dcac-7114-4f5c-a12b-be000bcd840a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:16.668341 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306dcac-7114-4f5c-a12b-be000bcd840a None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:16.668829 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306dcac-7114-4f5c-a12b-be000bcd840a None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:16.669323 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306dcac-7114-4f5c-a12b-be000bcd840a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:16.670796 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9306dcac-7114-4f5c-a12b-be000bcd840a None admin] RBAC: Adding query filter params (role.id=35ca0f0b9a964300a63780ec435e730b, scope.project.id=69c523a41f4048cfb7df553b6feb6310, user.id=13fd76fc7dd1410b9cde5adbaa6cb2e5) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:16.671189 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9306dcac-7114-4f5c-a12b-be000bcd840a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:16.672795 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9306dcac-7114-4f5c-a12b-be000bcd840a None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:16.681346 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:16.685892 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 308/636] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Jul 1 19:22:16 2022] GET /identity/v3/role_assignments?user.id=13fd76fc7dd1410b9cde5adbaa6cb2e5&scope.project.id=69c523a41f4048cfb7df553b6feb6310&role.id=35ca0f0b9a964300a63780ec435e730b => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:16.687344 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9306dcac-7114-4f5c-a12b-be000bcd840a None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:16.699258 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 329/637] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:22:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:22:16.701898 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8e4008-84f7-40d4-9a1b-f635fdb72cbe None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:16.830608 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9306dcac-7114-4f5c-a12b-be000bcd840a None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:16.854680 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:16.856854 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8e4008-84f7-40d4-9a1b-f635fdb72cbe None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:16.882711 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ac57d-d406-457d-82f8-638c1c728409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:16.883357 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ac57d-d406-457d-82f8-638c1c728409 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:16.883643 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ac57d-d406-457d-82f8-638c1c728409 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:16.883928 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ac57d-d406-457d-82f8-638c1c728409 None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:16.884755 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9ac57d-d406-457d-82f8-638c1c728409 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:16.885063 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9ac57d-d406-457d-82f8-638c1c728409 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:16.887344 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9ac57d-d406-457d-82f8-638c1c728409 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:16.901007 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 309/638] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Jul 1 19:22:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:16.901963 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ac57d-d406-457d-82f8-638c1c728409 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:16.906103 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41581f0d-2d65-45e5-a016-4723ec0dc236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:16.906888 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41581f0d-2d65-45e5-a016-4723ec0dc236 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:16.907343 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41581f0d-2d65-45e5-a016-4723ec0dc236 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:16.907595 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41581f0d-2d65-45e5-a016-4723ec0dc236 None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:16.908407 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41581f0d-2d65-45e5-a016-4723ec0dc236 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:16.908789 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41581f0d-2d65-45e5-a016-4723ec0dc236 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:16.910217 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41581f0d-2d65-45e5-a016-4723ec0dc236 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:16.923704 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 330/639] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Jul 1 19:22:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:16.925584 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41581f0d-2d65-45e5-a016-4723ec0dc236 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:17.003488 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:17.028124 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ac57d-d406-457d-82f8-638c1c728409 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:17.067406 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc81e37-3ccf-4155-93e8-7668f66678dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:17.068267 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc81e37-3ccf-4155-93e8-7668f66678dc None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:17.068551 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc81e37-3ccf-4155-93e8-7668f66678dc None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:17.068880 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc81e37-3ccf-4155-93e8-7668f66678dc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:17.070298 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41581f0d-2d65-45e5-a016-4723ec0dc236 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:17.081044 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc81e37-3ccf-4155-93e8-7668f66678dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:22:17.089032 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-9fc81e37-3ccf-4155-93e8-7668f66678dc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:22:17.089032 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:17.089032 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:17.089032 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:17.089032 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:17.089032 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:17.089032 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:17.089032 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:17.089032 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:17.089032 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:17.089032 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:17.089032 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:17.089032 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:22:17.089032 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:22:17.089032 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:22:17.089032 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:22:17.090017 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:22:17.090017 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:22:17.090017 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:22:17.090017 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:22:17.090017 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:17.090017 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:17.090017 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:17.090017 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:17.090017 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:17.090017 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:17.090017 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:17.090017 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:17.090017 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:17.090017 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:17.090017 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:17.090017 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:17.090915 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:17.090915 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:17.090915 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:17.090915 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:17.090915 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:22:17.090915 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:22:17.090915 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:22:17.090915 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:22:17.090915 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:22:17.090915 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:22:17.090915 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:22:17.090915 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:17.090915 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 310/640] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Jul 1 19:22:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:17.092283 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc81e37-3ccf-4155-93e8-7668f66678dc None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:17.112192 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e132b3-ea09-4811-a73f-f19628e2842b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:17.112993 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e132b3-ea09-4811-a73f-f19628e2842b None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:17.113322 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e132b3-ea09-4811-a73f-f19628e2842b None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:17.113602 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e132b3-ea09-4811-a73f-f19628e2842b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:17.120984 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e132b3-ea09-4811-a73f-f19628e2842b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:17.122476 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e132b3-ea09-4811-a73f-f19628e2842b None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:17.134254 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:17.137208 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-f2e132b3-ea09-4811-a73f-f19628e2842b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:22:17.137208 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:17.137208 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:17.137208 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:17.137208 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:17.137208 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:17.137208 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:17.137208 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:17.137208 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:17.137208 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:17.137208 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:17.137208 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:17.137208 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 19:22:17.137208 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 19:22:17.137208 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 19:22:17.138196 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 19:22:17.138196 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:17.138196 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:17.138196 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:17.138196 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:17.138196 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:17.138196 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:17.138196 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:17.138196 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:17.138196 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:17.138196 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:17.138196 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:17.138196 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:17.138196 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:17.138196 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:17.138196 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:17.138196 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:17.139649 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 19:22:17.139649 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 19:22:17.139649 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 19:22:17.139649 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 19:22:17.139649 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 19:22:17.139649 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 19:22:17.139649 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:22:17.139649 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:17.141561 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 331/641] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Jul 1 19:22:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:17.143003 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e132b3-ea09-4811-a73f-f19628e2842b None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:17.208860 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc81e37-3ccf-4155-93e8-7668f66678dc None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:17.244640 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585e4c96-51db-4006-bccd-5f66f9443135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:17.245475 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e4c96-51db-4006-bccd-5f66f9443135 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:17.245746 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e4c96-51db-4006-bccd-5f66f9443135 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:17.246012 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e4c96-51db-4006-bccd-5f66f9443135 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:17.255762 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585e4c96-51db-4006-bccd-5f66f9443135 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:17.257227 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585e4c96-51db-4006-bccd-5f66f9443135 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:17.258584 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e132b3-ea09-4811-a73f-f19628e2842b None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:17.271875 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-585e4c96-51db-4006-bccd-5f66f9443135 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 01 19:22:17.271875 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:17.271875 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:17.271875 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:17.271875 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:17.271875 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:17.271875 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:17.271875 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:17.271875 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:17.271875 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:17.271875 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:17.271875 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:17.271875 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 19:22:17.271875 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 19:22:17.271875 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 19:22:17.271875 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 19:22:17.273531 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:17.273531 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:17.273531 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 19:22:17.273531 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:22:17.273531 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 19:22:17.273531 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:22:17.273531 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:17.273531 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:17.273531 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:17.273531 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:17.273531 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:17.273531 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:17.273531 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:17.273531 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:17.273531 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:17.273531 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:17.273531 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:17.273531 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:17.274873 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:17.274873 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:17.274873 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 19:22:17.274873 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 19:22:17.274873 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 19:22:17.274873 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 19:22:17.274873 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 19:22:17.274873 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 19:22:17.274873 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 01 19:22:17.274873 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:17.277873 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 311/642] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Jul 1 19:22:17 2022] GET /identity/v3/users/glance => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:17.278937 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb34b2d-2d4c-4502-aafe-43b0ce27cb56 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:17.279230 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb34b2d-2d4c-4502-aafe-43b0ce27cb56 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:17.279507 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb34b2d-2d4c-4502-aafe-43b0ce27cb56 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:17.279601 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:17.281090 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 312/643] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:22:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:22:17.282082 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb34b2d-2d4c-4502-aafe-43b0ce27cb56 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:17.308544 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f65d77-a0ef-406e-98a1-40555744d5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:17.309553 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f65d77-a0ef-406e-98a1-40555744d5bc None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:17.309819 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f65d77-a0ef-406e-98a1-40555744d5bc None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:17.310128 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f65d77-a0ef-406e-98a1-40555744d5bc None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:17.311573 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f65d77-a0ef-406e-98a1-40555744d5bc None admin] RBAC: Adding query filter params (name=service) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:17.312223 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f65d77-a0ef-406e-98a1-40555744d5bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:17.313889 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f65d77-a0ef-406e-98a1-40555744d5bc None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:17.329841 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 332/644] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Jul 1 19:22:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:17.330636 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f65d77-a0ef-406e-98a1-40555744d5bc None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:17.393420 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:17.401391 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb34b2d-2d4c-4502-aafe-43b0ce27cb56 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:17.440097 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958345c1-48b7-47df-bf62-04a6a013a581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:17.440851 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958345c1-48b7-47df-bf62-04a6a013a581 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:17.441201 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958345c1-48b7-47df-bf62-04a6a013a581 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:17.441588 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958345c1-48b7-47df-bf62-04a6a013a581 None admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:17.442098 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f65d77-a0ef-406e-98a1-40555744d5bc None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:17.442501 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958345c1-48b7-47df-bf62-04a6a013a581 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:17.442875 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958345c1-48b7-47df-bf62-04a6a013a581 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:17.444383 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958345c1-48b7-47df-bf62-04a6a013a581 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:17.457448 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 313/645] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Jul 1 19:22:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:17.458804 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9607040b-7270-46f7-8ece-ff5286f685db None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:17.459150 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9607040b-7270-46f7-8ece-ff5286f685db None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:17.459490 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9607040b-7270-46f7-8ece-ff5286f685db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:17.476575 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-9607040b-7270-46f7-8ece-ff5286f685db None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:22:17.477931 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-9607040b-7270-46f7-8ece-ff5286f685db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:22:17.487008 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa96fbe-9f79-4e0a-9ffa-c88fce4b8c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:17.487684 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa96fbe-9f79-4e0a-9ffa-c88fce4b8c77 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:17.487972 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa96fbe-9f79-4e0a-9ffa-c88fce4b8c77 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:17.488252 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa96fbe-9f79-4e0a-9ffa-c88fce4b8c77 None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:17.489137 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa96fbe-9f79-4e0a-9ffa-c88fce4b8c77 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:17.489487 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa96fbe-9f79-4e0a-9ffa-c88fce4b8c77 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:17.491154 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa96fbe-9f79-4e0a-9ffa-c88fce4b8c77 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:17.511436 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 333/646] 10.222.0.26 () {56 vars in 1137 bytes} [Fri Jul 1 19:22:17 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:17.512293 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa96fbe-9f79-4e0a-9ffa-c88fce4b8c77 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:17.545832 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:17.565384 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 314/647] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:22:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:22:17.566255 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9607040b-7270-46f7-8ece-ff5286f685db None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:17.638299 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa96fbe-9f79-4e0a-9ffa-c88fce4b8c77 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:17.663845 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:17.683323 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9607040b-7270-46f7-8ece-ff5286f685db None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:17.686026 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd5083-e0b9-4f9a-9b9d-b86fe291cde4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:17.687371 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd5083-e0b9-4f9a-9b9d-b86fe291cde4 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:17.687872 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd5083-e0b9-4f9a-9b9d-b86fe291cde4 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:17.688362 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd5083-e0b9-4f9a-9b9d-b86fe291cde4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:17.707528 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cd5083-e0b9-4f9a-9b9d-b86fe291cde4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:17.710501 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cd5083-e0b9-4f9a-9b9d-b86fe291cde4 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:17.725670 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa84088-3edc-405f-a4de-0bb2c1dc06ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:17.727235 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa84088-3edc-405f-a4de-0bb2c1dc06ad None admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:17.727736 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa84088-3edc-405f-a4de-0bb2c1dc06ad None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:17.728234 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa84088-3edc-405f-a4de-0bb2c1dc06ad None admin] PATH_INFO: `/v3/projects/69c523a41f4048cfb7df553b6feb6310/users/e958c5b03a9346d59c32675c5271bf3b/roles/35ca0f0b9a964300a63780ec435e730b` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:17.730343 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-f8cd5083-e0b9-4f9a-9b9d-b86fe291cde4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:17.730343 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:17.730343 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:17.730343 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:17.730343 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:17.730343 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:17.730343 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:17.730343 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:17.730343 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:17.730343 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:17.730343 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:17.730343 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:17.730343 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:22:17.730343 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:22:17.730343 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:22:17.731206 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:22:17.731206 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:17.731206 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:17.731206 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:17.731206 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:17.731206 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:17.731206 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:17.731206 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:17.731206 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:17.731206 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:17.731206 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:17.731206 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:17.731206 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:17.731206 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:17.731206 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:17.731206 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:17.731206 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:17.737044 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:22:17.737044 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:22:17.737044 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:17.737044 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:17.737044 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 334/648] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:22:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:17.737044 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd5083-e0b9-4f9a-9b9d-b86fe291cde4 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:17.749999 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa84088-3edc-405f-a4de-0bb2c1dc06ad None admin] RBAC: Authorizing `identity:create_grant(project_id=69c523a41f4048cfb7df553b6feb6310, user_id=e958c5b03a9346d59c32675c5271bf3b, role_id=35ca0f0b9a964300a63780ec435e730b)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:17.751395 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa84088-3edc-405f-a4de-0bb2c1dc06ad None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:17.765356 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 315/649] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Jul 1 19:22:17 2022] PUT /identity/v3/projects/69c523a41f4048cfb7df553b6feb6310/users/e958c5b03a9346d59c32675c5271bf3b/roles/35ca0f0b9a964300a63780ec435e730b => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:22:17.766124 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa84088-3edc-405f-a4de-0bb2c1dc06ad None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:17.873355 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:17.892010 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa84088-3edc-405f-a4de-0bb2c1dc06ad None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:17.898978 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd5083-e0b9-4f9a-9b9d-b86fe291cde4 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:17.939627 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dce00c-af9b-41c2-882e-7b1451cdf771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:17.940609 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dce00c-af9b-41c2-882e-7b1451cdf771 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:17.941042 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dce00c-af9b-41c2-882e-7b1451cdf771 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:17.941427 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dce00c-af9b-41c2-882e-7b1451cdf771 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:17.946011 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:17.950080 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a174340-1b87-4efb-b652-062d44601c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:17.951247 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a174340-1b87-4efb-b652-062d44601c7a None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:17.951536 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a174340-1b87-4efb-b652-062d44601c7a None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:17.951810 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a174340-1b87-4efb-b652-062d44601c7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:17.956634 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dce00c-af9b-41c2-882e-7b1451cdf771 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:22:17.965350 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-a0dce00c-af9b-41c2-882e-7b1451cdf771 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:22:17.965350 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:17.965350 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:17.965350 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:17.965350 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:17.965350 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:17.965350 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:17.965350 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:17.965350 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:17.965350 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:17.965350 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:17.965350 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:17.965350 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:22:17.965350 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:22:17.965350 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:22:17.965350 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:22:17.966416 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:22:17.966416 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:22:17.966416 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:22:17.966416 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:22:17.966416 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:17.966416 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:17.966416 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:17.966416 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:17.966416 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:17.966416 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:17.966416 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:17.966416 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:17.966416 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:17.966416 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:17.966416 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:17.966416 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:17.967764 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:17.967764 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:17.967764 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:17.967764 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:17.967764 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:22:17.967764 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:22:17.967764 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:22:17.967764 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:22:17.967764 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:22:17.967764 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:22:17.967764 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:22:17.967764 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:17.970635 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 316/650] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Jul 1 19:22:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:17.971762 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dce00c-af9b-41c2-882e-7b1451cdf771 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:18.055023 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a174340-1b87-4efb-b652-062d44601c7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:18.057468 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a174340-1b87-4efb-b652-062d44601c7a None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:18.099614 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dce00c-af9b-41c2-882e-7b1451cdf771 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:18.148949 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:18.150814 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5af685-90f8-46db-8a9f-f53c6fd1819b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:18.153818 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5af685-90f8-46db-8a9f-f53c6fd1819b None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:18.153818 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5af685-90f8-46db-8a9f-f53c6fd1819b None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:18.153818 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5af685-90f8-46db-8a9f-f53c6fd1819b None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:18.153818 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5af685-90f8-46db-8a9f-f53c6fd1819b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:18.153818 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5af685-90f8-46db-8a9f-f53c6fd1819b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:18.156523 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5af685-90f8-46db-8a9f-f53c6fd1819b None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:18.173442 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 335/651] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Jul 1 19:22:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 19:22:18.173774 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 317/652] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Jul 1 19:22:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:18.174525 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5af685-90f8-46db-8a9f-f53c6fd1819b None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:18.175807 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a174340-1b87-4efb-b652-062d44601c7a None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:18.254345 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:18.289620 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a174340-1b87-4efb-b652-062d44601c7a None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:18.314014 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5af685-90f8-46db-8a9f-f53c6fd1819b None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:18.325378 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367068e9-1e4b-4462-880b-5a2314ed5d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:18.327107 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367068e9-1e4b-4462-880b-5a2314ed5d03 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:18.327487 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367068e9-1e4b-4462-880b-5a2314ed5d03 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:18.327866 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367068e9-1e4b-4462-880b-5a2314ed5d03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:18.338435 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367068e9-1e4b-4462-880b-5a2314ed5d03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:18.340143 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367068e9-1e4b-4462-880b-5a2314ed5d03 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:18.356363 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6706b1f-f2c5-4eb9-bf3b-5ce4f4d48a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:18.357081 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6706b1f-f2c5-4eb9-bf3b-5ce4f4d48a72 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:18.357403 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6706b1f-f2c5-4eb9-bf3b-5ce4f4d48a72 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:18.357688 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6706b1f-f2c5-4eb9-bf3b-5ce4f4d48a72 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:18.358439 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6706b1f-f2c5-4eb9-bf3b-5ce4f4d48a72 None admin] RBAC: Adding query filter params (name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:18.358752 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6706b1f-f2c5-4eb9-bf3b-5ce4f4d48a72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:18.358924 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-367068e9-1e4b-4462-880b-5a2314ed5d03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:18.358924 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:18.358924 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:18.358924 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:18.358924 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:18.358924 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:18.358924 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:18.358924 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:18.358924 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:18.358924 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:18.358924 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:18.358924 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:18.358924 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:22:18.358924 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:22:18.358924 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:22:18.359967 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:22:18.359967 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:18.359967 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:18.359967 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:18.359967 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:18.359967 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:18.359967 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:18.359967 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:18.359967 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:18.359967 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:18.359967 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:18.359967 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:18.359967 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:18.359967 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:18.359967 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:18.359967 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:18.359967 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:18.361156 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:22:18.361156 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:22:18.361156 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:18.361156 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:18.361461 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6706b1f-f2c5-4eb9-bf3b-5ce4f4d48a72 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:18.362771 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 336/653] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:22:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:22:18.363961 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367068e9-1e4b-4462-880b-5a2314ed5d03 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:18.370553 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 318/654] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Jul 1 19:22:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:18.371634 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6706b1f-f2c5-4eb9-bf3b-5ce4f4d48a72 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:18.486119 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6706b1f-f2c5-4eb9-bf3b-5ce4f4d48a72 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:18.489595 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:18.502286 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367068e9-1e4b-4462-880b-5a2314ed5d03 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:18.508579 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:18.532820 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4950e4c-ad4f-4ac6-8ee4-e0abd2dd3f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:18.534879 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4950e4c-ad4f-4ac6-8ee4-e0abd2dd3f14 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:18.535539 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4950e4c-ad4f-4ac6-8ee4-e0abd2dd3f14 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:18.536081 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4950e4c-ad4f-4ac6-8ee4-e0abd2dd3f14 None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:18.537346 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4950e4c-ad4f-4ac6-8ee4-e0abd2dd3f14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:18.537968 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4950e4c-ad4f-4ac6-8ee4-e0abd2dd3f14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:18.540297 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4950e4c-ad4f-4ac6-8ee4-e0abd2dd3f14 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:18.548717 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf02ee95-9863-478b-a7e8-5d1ac4371702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:18.549555 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02ee95-9863-478b-a7e8-5d1ac4371702 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:18.549844 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02ee95-9863-478b-a7e8-5d1ac4371702 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:18.550123 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02ee95-9863-478b-a7e8-5d1ac4371702 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:18.559740 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf02ee95-9863-478b-a7e8-5d1ac4371702 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:18.561827 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf02ee95-9863-478b-a7e8-5d1ac4371702 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:18.561949 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 319/655] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Jul 1 19:22:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:18.563263 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4950e4c-ad4f-4ac6-8ee4-e0abd2dd3f14 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:18.583639 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-cf02ee95-9863-478b-a7e8-5d1ac4371702 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 01 19:22:18.583639 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:18.583639 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:18.583639 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:18.583639 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:18.583639 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:18.583639 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:18.583639 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:18.583639 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:18.583639 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:18.583639 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:18.583639 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:18.583639 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 19:22:18.583639 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 19:22:18.583639 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 19:22:18.583639 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 19:22:18.584814 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:18.584814 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:18.584814 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 19:22:18.584814 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:22:18.584814 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 19:22:18.584814 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:22:18.584814 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:18.584814 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:18.584814 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:18.584814 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:18.584814 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:18.584814 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:18.584814 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:18.584814 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:18.584814 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:18.584814 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:18.584814 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:18.584814 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:18.585904 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:18.585904 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:18.585904 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 19:22:18.585904 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 19:22:18.585904 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 19:22:18.585904 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 19:22:18.585904 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 19:22:18.585904 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 19:22:18.585904 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 01 19:22:18.585904 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:18.585904 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 337/656] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Jul 1 19:22:18 2022] GET /identity/v3/users/neutron => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:18.586670 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf02ee95-9863-478b-a7e8-5d1ac4371702 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:18.714156 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:18.722630 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf02ee95-9863-478b-a7e8-5d1ac4371702 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:18.736042 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4950e4c-ad4f-4ac6-8ee4-e0abd2dd3f14 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:18.766661 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c653189-7f6e-4889-bb57-d23398319c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:18.767713 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c653189-7f6e-4889-bb57-d23398319c6b None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:18.768147 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c653189-7f6e-4889-bb57-d23398319c6b None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:18.768570 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c653189-7f6e-4889-bb57-d23398319c6b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:18.780762 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c653189-7f6e-4889-bb57-d23398319c6b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:18.783247 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c653189-7f6e-4889-bb57-d23398319c6b None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:18.787660 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936c2347-c4fc-4e4c-8b2e-ddf05427b4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:18.788676 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936c2347-c4fc-4e4c-8b2e-ddf05427b4ed None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:18.789156 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936c2347-c4fc-4e4c-8b2e-ddf05427b4ed None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:18.789593 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936c2347-c4fc-4e4c-8b2e-ddf05427b4ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:18.801569 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936c2347-c4fc-4e4c-8b2e-ddf05427b4ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:18.803496 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936c2347-c4fc-4e4c-8b2e-ddf05427b4ed None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:18.807939 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-2c653189-7f6e-4889-bb57-d23398319c6b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:22:18.807939 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:18.807939 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:18.807939 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:18.807939 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:18.807939 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:18.807939 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:18.807939 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:18.807939 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:18.807939 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:18.807939 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:18.807939 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:18.807939 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 19:22:18.807939 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 19:22:18.807939 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 19:22:18.809058 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 19:22:18.809058 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:18.809058 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:18.809058 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:18.809058 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:18.809058 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:18.809058 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:18.809058 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:18.809058 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:18.809058 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:18.809058 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:18.809058 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:18.809058 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:18.809058 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:18.809058 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:18.809058 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:18.809058 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:18.810727 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 19:22:18.810727 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 19:22:18.810727 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 19:22:18.810727 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 19:22:18.810727 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 19:22:18.810727 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 19:22:18.810727 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:22:18.810727 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:18.813375 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 338/657] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Jul 1 19:22:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:18.815119 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c653189-7f6e-4889-bb57-d23398319c6b None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:18.832895 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-936c2347-c4fc-4e4c-8b2e-ddf05427b4ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:18.832895 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:18.832895 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:18.832895 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:18.832895 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:18.832895 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:18.832895 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:18.832895 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:18.832895 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:18.832895 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:18.832895 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:18.832895 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:18.832895 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:22:18.832895 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:22:18.832895 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:22:18.833976 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:22:18.833976 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:18.833976 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:18.833976 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:18.833976 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:18.833976 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:18.833976 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:18.833976 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:18.833976 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:18.833976 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:18.833976 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:18.833976 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:18.833976 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:18.833976 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:18.833976 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:18.833976 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:18.833976 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:18.834872 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:22:18.834872 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:22:18.834872 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:18.834872 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:18.835692 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 320/658] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:22:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:18.837167 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936c2347-c4fc-4e4c-8b2e-ddf05427b4ed None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:18.886129 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:18.945872 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c653189-7f6e-4889-bb57-d23398319c6b None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:18.989795 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d92ddd6-599f-4d04-b41b-0716bedab7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:18.990830 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92ddd6-599f-4d04-b41b-0716bedab7bc None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:18.991238 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92ddd6-599f-4d04-b41b-0716bedab7bc None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:18.991659 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92ddd6-599f-4d04-b41b-0716bedab7bc None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:18.993069 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d92ddd6-599f-4d04-b41b-0716bedab7bc None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:18.994944 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d92ddd6-599f-4d04-b41b-0716bedab7bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:18.997352 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d92ddd6-599f-4d04-b41b-0716bedab7bc None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:19.006179 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936c2347-c4fc-4e4c-8b2e-ddf05427b4ed None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:19.025356 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 339/659] 10.222.0.26 () {56 vars in 1139 bytes} [Fri Jul 1 19:22:18 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:19.025524 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d92ddd6-599f-4d04-b41b-0716bedab7bc None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:19.047283 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:19.047602 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245073ae-001f-485e-8b2f-c63d91329de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:19.048268 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245073ae-001f-485e-8b2f-c63d91329de8 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:19.048557 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245073ae-001f-485e-8b2f-c63d91329de8 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:19.048865 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245073ae-001f-485e-8b2f-c63d91329de8 None admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:19.049837 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245073ae-001f-485e-8b2f-c63d91329de8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:19.050163 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245073ae-001f-485e-8b2f-c63d91329de8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:19.051734 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245073ae-001f-485e-8b2f-c63d91329de8 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:19.069153 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 321/660] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Jul 1 19:22:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:19.070646 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8c0e3c-88f4-41b7-8614-a0e6cd7652cf None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:19.070946 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8c0e3c-88f4-41b7-8614-a0e6cd7652cf None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:19.071233 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8c0e3c-88f4-41b7-8614-a0e6cd7652cf None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:19.076829 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 322/661] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:22:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:22:19.076829 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8c0e3c-88f4-41b7-8614-a0e6cd7652cf None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:19.144304 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d92ddd6-599f-4d04-b41b-0716bedab7bc None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:19.172695 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:19.190948 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8c0e3c-88f4-41b7-8614-a0e6cd7652cf None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:19.192658 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94467671-8e8c-4362-bcdc-d6c3406062ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:19.194207 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94467671-8e8c-4362-bcdc-d6c3406062ec None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:19.194506 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94467671-8e8c-4362-bcdc-d6c3406062ec None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:19.194788 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94467671-8e8c-4362-bcdc-d6c3406062ec None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:19.195530 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94467671-8e8c-4362-bcdc-d6c3406062ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:19.195844 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94467671-8e8c-4362-bcdc-d6c3406062ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:19.197298 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94467671-8e8c-4362-bcdc-d6c3406062ec None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:19.215987 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 340/662] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Jul 1 19:22:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:19.215987 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94467671-8e8c-4362-bcdc-d6c3406062ec None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:19.238180 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a009e071-35ee-4a8e-a3f8-4072351494ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:19.239100 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009e071-35ee-4a8e-a3f8-4072351494ec None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:19.239593 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009e071-35ee-4a8e-a3f8-4072351494ec None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:19.239969 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009e071-35ee-4a8e-a3f8-4072351494ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:19.327334 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:19.346552 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a009e071-35ee-4a8e-a3f8-4072351494ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:19.348867 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a009e071-35ee-4a8e-a3f8-4072351494ec None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:19.358820 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94467671-8e8c-4362-bcdc-d6c3406062ec None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:19.398365 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db27036-d766-4cee-83fb-1e74d6516e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:19.399020 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db27036-d766-4cee-83fb-1e74d6516e2f None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:19.399306 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db27036-d766-4cee-83fb-1e74d6516e2f None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:19.399586 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db27036-d766-4cee-83fb-1e74d6516e2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:19.400418 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db27036-d766-4cee-83fb-1e74d6516e2f None admin] RBAC: Adding query filter params (role.id=35ca0f0b9a964300a63780ec435e730b, scope.project.id=69c523a41f4048cfb7df553b6feb6310, user.id=5bbcb2463f9c46ddaaa247e4876aca48) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:19.400734 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db27036-d766-4cee-83fb-1e74d6516e2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:19.402201 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db27036-d766-4cee-83fb-1e74d6516e2f None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:19.408849 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 341/663] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Jul 1 19:22:19 2022] GET /identity/v3/role_assignments?user.id=5bbcb2463f9c46ddaaa247e4876aca48&scope.project.id=69c523a41f4048cfb7df553b6feb6310&role.id=35ca0f0b9a964300a63780ec435e730b => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:19.419226 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ce1489-cc1d-4bff-ad03-230cdb579e0f None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:19.419880 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ce1489-cc1d-4bff-ad03-230cdb579e0f None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:19.420663 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ce1489-cc1d-4bff-ad03-230cdb579e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:19.445019 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-d1ce1489-cc1d-4bff-ad03-230cdb579e0f None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:22:19.447068 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-d1ce1489-cc1d-4bff-ad03-230cdb579e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:22:19.496223 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:19.520427 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 323/664] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Jul 1 19:22:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 19:22:19.520427 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a009e071-35ee-4a8e-a3f8-4072351494ec None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:19.549933 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 342/665] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:22:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:22:19.551202 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ce1489-cc1d-4bff-ad03-230cdb579e0f None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:19.642756 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:19.684921 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a009e071-35ee-4a8e-a3f8-4072351494ec None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:19.697173 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ce1489-cc1d-4bff-ad03-230cdb579e0f None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:19.734553 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a827e41-898e-4330-b9ff-526220e25d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:19.736270 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a827e41-898e-4330-b9ff-526220e25d7f None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:19.736270 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a827e41-898e-4330-b9ff-526220e25d7f None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:19.736270 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a827e41-898e-4330-b9ff-526220e25d7f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:19.751579 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a827e41-898e-4330-b9ff-526220e25d7f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:19.753768 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e37823d-033b-4068-8b0c-a9b83430e700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:19.754051 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a827e41-898e-4330-b9ff-526220e25d7f None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:19.754707 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37823d-033b-4068-8b0c-a9b83430e700 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:19.755017 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37823d-033b-4068-8b0c-a9b83430e700 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:19.755266 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37823d-033b-4068-8b0c-a9b83430e700 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:19.768914 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e37823d-033b-4068-8b0c-a9b83430e700 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:19.770452 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e37823d-033b-4068-8b0c-a9b83430e700 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:19.780174 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-4a827e41-898e-4330-b9ff-526220e25d7f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 01 19:22:19.780174 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:19.780174 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:19.780174 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:19.780174 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:19.780174 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:19.780174 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:19.780174 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:19.780174 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:19.780174 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:19.780174 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:19.780174 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:19.780174 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 19:22:19.780174 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 19:22:19.780174 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 19:22:19.780174 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 19:22:19.781162 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:19.781162 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:19.781162 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 19:22:19.781162 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:22:19.781162 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 19:22:19.781162 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:22:19.781162 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:19.781162 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:19.781162 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:19.781162 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:19.781162 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:19.781162 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:19.781162 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:19.781162 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:19.781162 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:19.781162 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:19.781162 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:19.781162 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:19.782180 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:19.782180 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:19.782180 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 19:22:19.782180 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 19:22:19.782180 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 19:22:19.782180 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 19:22:19.782180 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 19:22:19.782180 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 19:22:19.782180 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 01 19:22:19.782180 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:19.782739 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 324/666] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Jul 1 19:22:19 2022] GET /identity/v3/users/cinder => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:19.783613 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a827e41-898e-4330-b9ff-526220e25d7f None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:19.790294 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-4e37823d-033b-4068-8b0c-a9b83430e700 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:19.790294 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:19.790294 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:19.790294 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:19.790294 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:19.790294 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:19.790294 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:19.790294 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:19.790294 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:19.790294 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:19.790294 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:19.790294 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:19.790294 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:22:19.790294 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:22:19.790294 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:22:19.792356 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:22:19.792356 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:19.792356 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:19.792356 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:19.792356 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:19.792356 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:19.792356 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:19.792356 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:19.792356 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:19.792356 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:19.792356 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:19.792356 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:19.792356 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:19.792356 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:19.792356 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:19.792356 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:19.792356 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:19.794650 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:22:19.794650 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:22:19.794650 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:19.794650 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:19.794650 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 343/667] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:22:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:19.794650 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e37823d-033b-4068-8b0c-a9b83430e700 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:19.862816 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:19.913313 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e37823d-033b-4068-8b0c-a9b83430e700 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:19.937695 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:19.945492 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a827e41-898e-4330-b9ff-526220e25d7f None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:19.957760 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bbb032-4b2c-4260-9990-e3112abc81e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:19.959173 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bbb032-4b2c-4260-9990-e3112abc81e5 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:19.959463 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bbb032-4b2c-4260-9990-e3112abc81e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:19.959745 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bbb032-4b2c-4260-9990-e3112abc81e5 None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:19.960608 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bbb032-4b2c-4260-9990-e3112abc81e5 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:19.960923 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bbb032-4b2c-4260-9990-e3112abc81e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:19.962936 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bbb032-4b2c-4260-9990-e3112abc81e5 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:19.986127 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 344/668] 10.222.0.26 () {56 vars in 1137 bytes} [Fri Jul 1 19:22:19 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:19.986991 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bbb032-4b2c-4260-9990-e3112abc81e5 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:20.010869 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01939176-1e43-4a6f-8f34-e9b40741f3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:20.012361 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01939176-1e43-4a6f-8f34-e9b40741f3c6 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:20.012800 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01939176-1e43-4a6f-8f34-e9b40741f3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:20.013526 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01939176-1e43-4a6f-8f34-e9b40741f3c6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:20.033575 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01939176-1e43-4a6f-8f34-e9b40741f3c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:22:20.047898 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-01939176-1e43-4a6f-8f34-e9b40741f3c6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:22:20.047898 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:20.047898 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:20.047898 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:20.047898 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:20.047898 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:20.047898 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:20.047898 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:20.047898 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:20.047898 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:20.047898 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:20.047898 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:20.047898 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:22:20.047898 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:22:20.047898 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:22:20.047898 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:22:20.048892 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:22:20.048892 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:22:20.048892 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:22:20.048892 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:22:20.048892 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:20.048892 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:20.048892 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:20.048892 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:20.048892 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:20.048892 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:20.048892 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:20.048892 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:20.048892 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:20.048892 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:20.048892 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:20.048892 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:20.049794 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:20.049794 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:20.049794 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:20.049794 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:20.049794 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:22:20.049794 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:22:20.049794 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:22:20.049794 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:22:20.049794 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:22:20.049794 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:22:20.049794 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:22:20.049794 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:20.051277 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 325/669] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Jul 1 19:22:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:20.052650 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5bdf5a-a1f6-4c79-a00b-3ef4c7a3b7a3 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:20.052946 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5bdf5a-a1f6-4c79-a00b-3ef4c7a3b7a3 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:20.053878 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5bdf5a-a1f6-4c79-a00b-3ef4c7a3b7a3 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:20.057417 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 326/670] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:22:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:22:20.057417 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5bdf5a-a1f6-4c79-a00b-3ef4c7a3b7a3 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:20.124055 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bbb032-4b2c-4260-9990-e3112abc81e5 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:20.169122 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5bdf5a-a1f6-4c79-a00b-3ef4c7a3b7a3 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:20.176181 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c758a89b-ed0e-447e-989a-56b04d9b9638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:20.177417 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758a89b-ed0e-447e-989a-56b04d9b9638 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:20.178028 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758a89b-ed0e-447e-989a-56b04d9b9638 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:20.178871 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758a89b-ed0e-447e-989a-56b04d9b9638 None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:20.180229 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c758a89b-ed0e-447e-989a-56b04d9b9638 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:20.180909 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c758a89b-ed0e-447e-989a-56b04d9b9638 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:20.181308 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:20.183127 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c758a89b-ed0e-447e-989a-56b04d9b9638 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:20.207706 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 345/671] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Jul 1 19:22:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:20.207706 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c758a89b-ed0e-447e-989a-56b04d9b9638 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:20.212712 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0375d00a-8594-4949-9188-5d2b15943a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:20.213651 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375d00a-8594-4949-9188-5d2b15943a05 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:20.214062 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375d00a-8594-4949-9188-5d2b15943a05 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:20.214563 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375d00a-8594-4949-9188-5d2b15943a05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:20.273999 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:20.323968 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0375d00a-8594-4949-9188-5d2b15943a05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:20.326626 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0375d00a-8594-4949-9188-5d2b15943a05 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:20.370268 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c758a89b-ed0e-447e-989a-56b04d9b9638 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:20.408971 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e690726-7a74-4c5c-892b-ce8043f2e20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:20.410131 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e690726-7a74-4c5c-892b-ce8043f2e20f None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:20.410428 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e690726-7a74-4c5c-892b-ce8043f2e20f None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:20.410856 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e690726-7a74-4c5c-892b-ce8043f2e20f None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:20.411903 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e690726-7a74-4c5c-892b-ce8043f2e20f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:20.412213 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e690726-7a74-4c5c-892b-ce8043f2e20f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:20.414552 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e690726-7a74-4c5c-892b-ce8043f2e20f None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:20.429006 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 346/672] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Jul 1 19:22:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:20.430317 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16b705-d202-48b8-aeae-a6258af2ed2d None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:20.430608 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16b705-d202-48b8-aeae-a6258af2ed2d None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:20.430888 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16b705-d202-48b8-aeae-a6258af2ed2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:20.452201 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 327/673] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Jul 1 19:22:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 19:22:20.452201 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0375d00a-8594-4949-9188-5d2b15943a05 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:20.453888 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-4d16b705-d202-48b8-aeae-a6258af2ed2d None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:22:20.455135 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-4d16b705-d202-48b8-aeae-a6258af2ed2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:22:20.463626 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:20.525470 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 347/674] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:22:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:22:20.526325 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d16b705-d202-48b8-aeae-a6258af2ed2d None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:20.568822 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:20.581986 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0375d00a-8594-4949-9188-5d2b15943a05 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:20.629529 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e9ea45-7079-4a41-b4fb-cd7cc4dfb798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:20.630251 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9ea45-7079-4a41-b4fb-cd7cc4dfb798 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:20.630543 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9ea45-7079-4a41-b4fb-cd7cc4dfb798 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:20.630825 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9ea45-7079-4a41-b4fb-cd7cc4dfb798 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:20.641502 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e9ea45-7079-4a41-b4fb-cd7cc4dfb798 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:20.642615 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d16b705-d202-48b8-aeae-a6258af2ed2d None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:20.643435 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e9ea45-7079-4a41-b4fb-cd7cc4dfb798 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:20.661617 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-b8e9ea45-7079-4a41-b4fb-cd7cc4dfb798 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:22:20.661617 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:20.661617 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:20.661617 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:20.661617 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:20.661617 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:20.661617 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:20.661617 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:20.661617 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:20.661617 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:20.661617 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:20.661617 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:20.661617 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 19:22:20.661617 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 19:22:20.661617 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 19:22:20.662571 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 19:22:20.662571 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:20.662571 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:20.662571 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:20.662571 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:20.662571 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:20.662571 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:20.662571 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:20.662571 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:20.662571 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:20.662571 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:20.662571 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:20.662571 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:20.662571 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:20.662571 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:20.662571 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:20.662571 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:20.663491 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 19:22:20.663491 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 19:22:20.663491 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 19:22:20.663491 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 19:22:20.663491 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 19:22:20.663491 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 19:22:20.663491 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:22:20.663491 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:20.664785 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 328/675] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Jul 1 19:22:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:20.665435 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e9ea45-7079-4a41-b4fb-cd7cc4dfb798 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:20.680240 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc0424b-aa1e-42d4-bed7-7d589fad3473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:20.680967 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc0424b-aa1e-42d4-bed7-7d589fad3473 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:20.681286 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc0424b-aa1e-42d4-bed7-7d589fad3473 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:20.681563 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc0424b-aa1e-42d4-bed7-7d589fad3473 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:20.694900 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc0424b-aa1e-42d4-bed7-7d589fad3473 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:20.696549 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc0424b-aa1e-42d4-bed7-7d589fad3473 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:20.721006 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-8dc0424b-aa1e-42d4-bed7-7d589fad3473 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:20.721006 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:20.721006 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:20.721006 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:20.721006 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:20.721006 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:20.721006 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:20.721006 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:20.721006 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:20.721006 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:20.721006 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:20.721006 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:20.721006 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:22:20.721006 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:22:20.721006 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:22:20.722194 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:22:20.722194 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:20.722194 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:20.722194 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:20.722194 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:20.722194 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:20.722194 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:20.722194 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:20.722194 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:20.722194 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:20.722194 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:20.722194 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:20.722194 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:20.722194 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:20.722194 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:20.722194 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:20.722194 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:20.728201 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:22:20.728201 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:22:20.728201 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:20.728201 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:20.728201 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 348/676] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:22:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:20.728201 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc0424b-aa1e-42d4-bed7-7d589fad3473 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:20.742774 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:20.777269 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e9ea45-7079-4a41-b4fb-cd7cc4dfb798 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:20.814222 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ff764e-ab9f-4712-8f10-98544512437b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:20.815021 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff764e-ab9f-4712-8f10-98544512437b None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:20.815301 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff764e-ab9f-4712-8f10-98544512437b None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:20.815577 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff764e-ab9f-4712-8f10-98544512437b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:20.823315 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:20.827835 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ff764e-ab9f-4712-8f10-98544512437b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:20.829402 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ff764e-ab9f-4712-8f10-98544512437b None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:20.843921 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc0424b-aa1e-42d4-bed7-7d589fad3473 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:20.847784 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-d6ff764e-ab9f-4712-8f10-98544512437b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:20.847784 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:20.847784 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:20.847784 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:20.847784 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:20.847784 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:20.847784 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:20.847784 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:20.847784 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:20.847784 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:20.847784 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:20.847784 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:20.847784 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:22:20.847784 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:22:20.847784 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:22:20.848862 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:22:20.848862 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:20.848862 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:20.848862 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:20.848862 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:20.848862 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:20.848862 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:20.848862 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:20.848862 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:20.848862 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:20.848862 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:20.848862 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:20.848862 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:20.848862 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:20.848862 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:20.848862 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:20.848862 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:20.850110 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:22:20.850110 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:22:20.850110 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:20.850110 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:20.853972 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 329/677] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:22:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:20.854856 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ff764e-ab9f-4712-8f10-98544512437b None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:20.883674 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041bf81e-e2f5-4dff-830b-231108980a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:20.884474 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041bf81e-e2f5-4dff-830b-231108980a55 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:20.884767 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041bf81e-e2f5-4dff-830b-231108980a55 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:20.885052 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041bf81e-e2f5-4dff-830b-231108980a55 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:20.897076 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041bf81e-e2f5-4dff-830b-231108980a55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:22:20.904741 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-041bf81e-e2f5-4dff-830b-231108980a55 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:22:20.904741 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:20.904741 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:20.904741 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:20.904741 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:20.904741 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:20.904741 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:20.904741 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:20.904741 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:20.904741 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:20.904741 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:20.904741 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:20.904741 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:22:20.904741 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:22:20.904741 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:22:20.904741 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:22:20.906296 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:22:20.906296 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:22:20.906296 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:22:20.906296 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:22:20.906296 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:20.906296 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:20.906296 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:20.906296 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:20.906296 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:20.906296 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:20.906296 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:20.906296 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:20.906296 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:20.906296 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:20.906296 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:20.906296 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:20.907192 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:20.907192 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:20.907192 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:20.907192 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:20.907192 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:22:20.907192 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:22:20.907192 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:22:20.907192 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:22:20.907192 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:22:20.907192 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:22:20.907192 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:22:20.907192 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:20.907192 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 349/678] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Jul 1 19:22:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:20.907192 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041bf81e-e2f5-4dff-830b-231108980a55 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:20.980365 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ff764e-ab9f-4712-8f10-98544512437b None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:21.005897 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:21.019272 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cad800-1ef4-4047-8dac-cccb06983ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:21.019986 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cad800-1ef4-4047-8dac-cccb06983ed2 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:21.020267 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cad800-1ef4-4047-8dac-cccb06983ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:21.020503 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cad800-1ef4-4047-8dac-cccb06983ed2 None admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:21.021314 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cad800-1ef4-4047-8dac-cccb06983ed2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:21.021633 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cad800-1ef4-4047-8dac-cccb06983ed2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:21.023079 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cad800-1ef4-4047-8dac-cccb06983ed2 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:21.040677 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 330/679] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Jul 1 19:22:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:21.041651 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cad800-1ef4-4047-8dac-cccb06983ed2 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:21.047279 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041bf81e-e2f5-4dff-830b-231108980a55 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:21.099701 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edddbcb0-38b6-40a9-a2c3-4e033471f560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:21.100653 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edddbcb0-38b6-40a9-a2c3-4e033471f560 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:21.101084 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edddbcb0-38b6-40a9-a2c3-4e033471f560 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:21.101539 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edddbcb0-38b6-40a9-a2c3-4e033471f560 None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:21.102672 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edddbcb0-38b6-40a9-a2c3-4e033471f560 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:21.103141 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edddbcb0-38b6-40a9-a2c3-4e033471f560 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:21.105362 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edddbcb0-38b6-40a9-a2c3-4e033471f560 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:21.124674 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 350/680] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Jul 1 19:22:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:21.125952 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edddbcb0-38b6-40a9-a2c3-4e033471f560 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:21.129899 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:21.179197 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cad800-1ef4-4047-8dac-cccb06983ed2 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:21.225335 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fecf471-a2d3-459f-a807-e974751113ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:21.226314 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fecf471-a2d3-459f-a807-e974751113ac None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:21.226990 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fecf471-a2d3-459f-a807-e974751113ac None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:21.227169 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fecf471-a2d3-459f-a807-e974751113ac None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:21.228279 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fecf471-a2d3-459f-a807-e974751113ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:21.228747 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fecf471-a2d3-459f-a807-e974751113ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:21.231016 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fecf471-a2d3-459f-a807-e974751113ac None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:21.244350 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edddbcb0-38b6-40a9-a2c3-4e033471f560 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:21.255291 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 331/681] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Jul 1 19:22:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:21.255291 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fecf471-a2d3-459f-a807-e974751113ac None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:21.287471 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51701c5-d03d-4feb-a964-19da9296c256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:21.288148 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51701c5-d03d-4feb-a964-19da9296c256 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:21.288431 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51701c5-d03d-4feb-a964-19da9296c256 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:21.288705 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51701c5-d03d-4feb-a964-19da9296c256 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:21.289486 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51701c5-d03d-4feb-a964-19da9296c256 None admin] RBAC: Adding query filter params (name=service) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:21.289794 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51701c5-d03d-4feb-a964-19da9296c256 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:21.291222 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51701c5-d03d-4feb-a964-19da9296c256 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:21.300642 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 351/682] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Jul 1 19:22:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:21.301672 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51701c5-d03d-4feb-a964-19da9296c256 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:21.328117 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:21.372883 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:21.413297 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51701c5-d03d-4feb-a964-19da9296c256 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:21.419170 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fecf471-a2d3-459f-a807-e974751113ac None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:21.449371 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529a92a0-41ca-4acc-a74c-f1dc6495f62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:21.450161 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a92a0-41ca-4acc-a74c-f1dc6495f62f None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:21.450520 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a92a0-41ca-4acc-a74c-f1dc6495f62f None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:21.451238 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a92a0-41ca-4acc-a74c-f1dc6495f62f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:21.459266 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529a92a0-41ca-4acc-a74c-f1dc6495f62f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:21.460707 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529a92a0-41ca-4acc-a74c-f1dc6495f62f None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:21.472134 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf1baf8-7977-4f76-bb74-86f8c7dce48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:21.473177 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf1baf8-7977-4f76-bb74-86f8c7dce48c None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:21.473715 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf1baf8-7977-4f76-bb74-86f8c7dce48c None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:21.474217 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf1baf8-7977-4f76-bb74-86f8c7dce48c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:21.475554 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-529a92a0-41ca-4acc-a74c-f1dc6495f62f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 01 19:22:21.475554 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:21.475554 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:21.475554 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:21.475554 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:21.475554 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:21.475554 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:21.475554 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:21.475554 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:21.475554 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:21.475554 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:21.475554 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:21.475554 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 19:22:21.475554 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 19:22:21.475554 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 19:22:21.475554 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 19:22:21.476672 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:21.476672 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:21.476672 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 19:22:21.476672 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:22:21.476672 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 19:22:21.476672 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:22:21.476672 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:21.476672 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:21.476672 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:21.476672 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:21.476672 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:21.476672 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:21.476672 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:21.476672 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:21.476672 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:21.476672 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:21.476672 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:21.476672 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:21.478077 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:21.478077 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:21.478077 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 19:22:21.478077 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 19:22:21.478077 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 19:22:21.478077 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 19:22:21.478077 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 19:22:21.478077 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 19:22:21.478077 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 01 19:22:21.478077 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:21.478773 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf1baf8-7977-4f76-bb74-86f8c7dce48c None admin] RBAC: Adding query filter params (role.id=35ca0f0b9a964300a63780ec435e730b, scope.project.id=69c523a41f4048cfb7df553b6feb6310, user.id=4557d17438a249ee8f75927449a1a059) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:21.478773 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf1baf8-7977-4f76-bb74-86f8c7dce48c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:21.480456 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf1baf8-7977-4f76-bb74-86f8c7dce48c None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:21.481509 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 352/683] 10.222.0.26 () {56 vars in 1093 bytes} [Fri Jul 1 19:22:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:21.482332 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529a92a0-41ca-4acc-a74c-f1dc6495f62f None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:21.502009 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 332/684] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Jul 1 19:22:21 2022] GET /identity/v3/role_assignments?user.id=4557d17438a249ee8f75927449a1a059&scope.project.id=69c523a41f4048cfb7df553b6feb6310&role.id=35ca0f0b9a964300a63780ec435e730b => generated 608 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:21.502009 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf1baf8-7977-4f76-bb74-86f8c7dce48c None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:21.680945 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529a92a0-41ca-4acc-a74c-f1dc6495f62f None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:21.690678 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf1baf8-7977-4f76-bb74-86f8c7dce48c None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:21.703974 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:21.710616 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:21.723270 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e7798-be37-436a-ab4a-af15578d8224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:21.724029 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e7798-be37-436a-ab4a-af15578d8224 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:21.724317 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e7798-be37-436a-ab4a-af15578d8224 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:21.724651 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e7798-be37-436a-ab4a-af15578d8224 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:21.738945 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974e7798-be37-436a-ab4a-af15578d8224 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:21.740208 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974e7798-be37-436a-ab4a-af15578d8224 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:21.748976 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c247ddd7-1091-491a-a547-dc2c001c5d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:21.749923 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247ddd7-1091-491a-a547-dc2c001c5d6c None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:21.750320 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247ddd7-1091-491a-a547-dc2c001c5d6c None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:21.750602 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247ddd7-1091-491a-a547-dc2c001c5d6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:21.755932 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-974e7798-be37-436a-ab4a-af15578d8224 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:22:21.755932 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:21.755932 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:21.755932 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:21.755932 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:21.755932 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:21.755932 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:21.755932 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:21.755932 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:21.755932 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:21.755932 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:21.755932 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:21.755932 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 19:22:21.755932 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 19:22:21.755932 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 19:22:21.757403 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 19:22:21.757403 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:21.757403 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:21.757403 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:21.757403 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:21.757403 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:21.757403 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:21.757403 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:21.757403 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:21.757403 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:21.757403 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:21.757403 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:21.757403 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:21.757403 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:21.757403 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:21.757403 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:21.757403 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:21.758855 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 19:22:21.758855 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 19:22:21.758855 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 19:22:21.758855 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 19:22:21.758855 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 19:22:21.758855 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 19:22:21.758855 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:22:21.758855 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:21.758855 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 353/685] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Jul 1 19:22:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:21.758855 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e7798-be37-436a-ab4a-af15578d8224 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:21.765916 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c247ddd7-1091-491a-a547-dc2c001c5d6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:21.767403 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c247ddd7-1091-491a-a547-dc2c001c5d6c None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:21.786779 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-c247ddd7-1091-491a-a547-dc2c001c5d6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:21.786779 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:21.786779 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:21.786779 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:21.786779 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:21.786779 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:21.786779 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:21.786779 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:21.786779 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:21.786779 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:21.786779 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:21.786779 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:21.786779 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:22:21.786779 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:22:21.786779 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:22:21.789726 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:22:21.789726 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:21.789726 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:21.789726 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:21.789726 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:21.789726 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:21.789726 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:21.789726 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:21.789726 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:21.789726 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:21.789726 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:21.789726 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:21.789726 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:21.789726 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:21.789726 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:21.789726 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:21.789726 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:21.793011 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:22:21.793011 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:22:21.793011 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:21.793011 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:21.793011 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 333/686] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:22:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:21.793011 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b74ff-7484-42b1-8232-aafe7c23506d None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:21.793011 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b74ff-7484-42b1-8232-aafe7c23506d None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:21.793011 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b74ff-7484-42b1-8232-aafe7c23506d None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:21.793011 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 334/687] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:22:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:22:21.795174 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6b74ff-7484-42b1-8232-aafe7c23506d None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:21.899383 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e7798-be37-436a-ab4a-af15578d8224 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:21.932793 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6b74ff-7484-42b1-8232-aafe7c23506d None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:21.945028 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94edb00a-156c-4b03-bed1-435784828da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:21.945919 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94edb00a-156c-4b03-bed1-435784828da4 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:21.946338 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94edb00a-156c-4b03-bed1-435784828da4 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:21.946753 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94edb00a-156c-4b03-bed1-435784828da4 None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:21.948111 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94edb00a-156c-4b03-bed1-435784828da4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:21.948769 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94edb00a-156c-4b03-bed1-435784828da4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:21.951527 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94edb00a-156c-4b03-bed1-435784828da4 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:21.973006 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f5969d-ecc5-4219-97e4-2c7bf3fd64fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:21.973888 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5969d-ecc5-4219-97e4-2c7bf3fd64fe None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:21.974290 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5969d-ecc5-4219-97e4-2c7bf3fd64fe None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:21.974595 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5969d-ecc5-4219-97e4-2c7bf3fd64fe None admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:21.975428 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f5969d-ecc5-4219-97e4-2c7bf3fd64fe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:21.975945 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f5969d-ecc5-4219-97e4-2c7bf3fd64fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:21.977479 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f5969d-ecc5-4219-97e4-2c7bf3fd64fe None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:21.980916 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 354/688] 10.222.0.26 () {56 vars in 1133 bytes} [Fri Jul 1 19:22:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:21.982483 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94edb00a-156c-4b03-bed1-435784828da4 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:21.993029 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 335/689] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Jul 1 19:22:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:21.994280 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5017c-0faa-4270-87f6-d1a0e21ff468 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:21.994572 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5017c-0faa-4270-87f6-d1a0e21ff468 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:21.994855 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5017c-0faa-4270-87f6-d1a0e21ff468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:22.015675 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-ead5017c-0faa-4270-87f6-d1a0e21ff468 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:22:22.017386 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-ead5017c-0faa-4270-87f6-d1a0e21ff468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:22:22.033769 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:22.043956 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:22.113304 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 336/690] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:22:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:22:22.113304 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead5017c-0faa-4270-87f6-d1a0e21ff468 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:22.119630 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94edb00a-156c-4b03-bed1-435784828da4 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:22.168335 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca62c148-5571-4ab2-8b57-3a237bbdf38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:22.169002 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62c148-5571-4ab2-8b57-3a237bbdf38c None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:22.169341 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62c148-5571-4ab2-8b57-3a237bbdf38c None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:22.170123 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62c148-5571-4ab2-8b57-3a237bbdf38c None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:22.170373 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca62c148-5571-4ab2-8b57-3a237bbdf38c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:22.170640 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca62c148-5571-4ab2-8b57-3a237bbdf38c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:22.172016 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca62c148-5571-4ab2-8b57-3a237bbdf38c None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:22.185446 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 355/691] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Jul 1 19:22:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:22.192363 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca62c148-5571-4ab2-8b57-3a237bbdf38c None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:22.243479 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead5017c-0faa-4270-87f6-d1a0e21ff468 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:22.290829 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fee041-7973-4eba-a862-e319af3e2390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:22.291482 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fee041-7973-4eba-a862-e319af3e2390 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:22.291764 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fee041-7973-4eba-a862-e319af3e2390 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:22.292053 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fee041-7973-4eba-a862-e319af3e2390 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:22.313027 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:22.318748 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca62c148-5571-4ab2-8b57-3a237bbdf38c None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:22.321160 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:22.366614 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8beaae5-709d-4ae9-911c-17148a18523a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:22.367554 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8beaae5-709d-4ae9-911c-17148a18523a None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:22.367983 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8beaae5-709d-4ae9-911c-17148a18523a None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:22.368385 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8beaae5-709d-4ae9-911c-17148a18523a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:22.369569 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8beaae5-709d-4ae9-911c-17148a18523a None admin] RBAC: Adding query filter params (role.id=35ca0f0b9a964300a63780ec435e730b, scope.project.id=69c523a41f4048cfb7df553b6feb6310, user.id=9a3ed285ee4c4d04abf7daf0aeb9fb7c) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:22.370087 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8beaae5-709d-4ae9-911c-17148a18523a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:22.372054 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8beaae5-709d-4ae9-911c-17148a18523a None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:22.373788 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fee041-7973-4eba-a862-e319af3e2390 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:22.375917 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fee041-7973-4eba-a862-e319af3e2390 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:22.380447 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 356/692] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Jul 1 19:22:22 2022] GET /identity/v3/role_assignments?user.id=9a3ed285ee4c4d04abf7daf0aeb9fb7c&scope.project.id=69c523a41f4048cfb7df553b6feb6310&role.id=35ca0f0b9a964300a63780ec435e730b => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:22.381792 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8beaae5-709d-4ae9-911c-17148a18523a None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:22.568509 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8beaae5-709d-4ae9-911c-17148a18523a None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:22.596966 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 337/693] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Jul 1 19:22:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 19:22:22.598835 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fee041-7973-4eba-a862-e319af3e2390 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:22.622663 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68a5337-4da6-44a7-b463-af03370b6b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:22.624387 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a5337-4da6-44a7-b463-af03370b6b41 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:22.625366 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a5337-4da6-44a7-b463-af03370b6b41 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:22.626146 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a5337-4da6-44a7-b463-af03370b6b41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:22.645379 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68a5337-4da6-44a7-b463-af03370b6b41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:22.647387 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68a5337-4da6-44a7-b463-af03370b6b41 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:22.679376 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:22.684326 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-e68a5337-4da6-44a7-b463-af03370b6b41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:22.684326 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:22.684326 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:22.684326 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:22.684326 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:22.684326 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:22.684326 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:22.684326 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:22.684326 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:22.684326 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:22.684326 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:22.684326 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:22.684326 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:22:22.684326 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:22:22.684326 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:22:22.686212 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:22:22.686212 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:22.686212 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:22.686212 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:22.686212 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:22.686212 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:22.686212 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:22.686212 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:22.686212 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:22.686212 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:22.686212 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:22.686212 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:22.686212 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:22.686212 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:22.686212 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:22.686212 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:22.686212 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:22.688273 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:22:22.688273 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:22:22.688273 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:22.688273 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:22.689966 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 357/694] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:22:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:22.693262 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68a5337-4da6-44a7-b463-af03370b6b41 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:22.719963 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:22.776621 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fee041-7973-4eba-a862-e319af3e2390 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:22.834031 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1529b9-82a4-4a22-870d-822c494afdd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:22.835445 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1529b9-82a4-4a22-870d-822c494afdd1 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:22.836063 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1529b9-82a4-4a22-870d-822c494afdd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:22.836657 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1529b9-82a4-4a22-870d-822c494afdd1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:22.843609 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68a5337-4da6-44a7-b463-af03370b6b41 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:22.850358 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1529b9-82a4-4a22-870d-822c494afdd1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:22.853388 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1529b9-82a4-4a22-870d-822c494afdd1 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:22.882563 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-cd1529b9-82a4-4a22-870d-822c494afdd1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 01 19:22:22.882563 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:22.882563 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:22.882563 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:22.882563 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:22.882563 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:22.882563 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:22.882563 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:22.882563 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:22.882563 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:22.882563 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:22.882563 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:22.882563 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 19:22:22.882563 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 19:22:22.882563 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 19:22:22.882563 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 19:22:22.884443 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:22.884443 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:22.884443 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 19:22:22.884443 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:22:22.884443 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 19:22:22.884443 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:22:22.884443 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:22.884443 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:22.884443 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:22.884443 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:22.884443 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:22.884443 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:22.884443 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:22.884443 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:22.884443 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:22.884443 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:22.884443 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:22.884443 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:22.886298 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:22.886298 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:22.886298 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 19:22:22.886298 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 19:22:22.886298 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 19:22:22.886298 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 19:22:22.886298 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 19:22:22.886298 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 19:22:22.886298 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 01 19:22:22.886298 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:22.889300 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48510fe1-abd9-4b54-b59b-dc85f90759f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:22.889300 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48510fe1-abd9-4b54-b59b-dc85f90759f1 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:22.889300 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48510fe1-abd9-4b54-b59b-dc85f90759f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:22.889300 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48510fe1-abd9-4b54-b59b-dc85f90759f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:22.895372 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 338/695] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Jul 1 19:22:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:22.895372 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1529b9-82a4-4a22-870d-822c494afdd1 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:22.901275 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48510fe1-abd9-4b54-b59b-dc85f90759f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:22.901275 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48510fe1-abd9-4b54-b59b-dc85f90759f1 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:22.919369 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-48510fe1-abd9-4b54-b59b-dc85f90759f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:22.919369 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:22.919369 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:22.919369 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:22.919369 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:22.919369 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:22.919369 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:22.919369 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:22.919369 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:22.919369 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:22.919369 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:22.919369 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:22.919369 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:22:22.919369 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:22:22.919369 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:22:22.920337 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:22:22.920337 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:22.920337 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:22.920337 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:22.920337 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:22.920337 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:22.920337 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:22.920337 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:22.920337 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:22.920337 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:22.920337 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:22.920337 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:22.920337 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:22.920337 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:22.920337 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:22.920337 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:22.920337 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:22.921209 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:22:22.921209 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:22:22.921209 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:22.921209 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:22.922881 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 358/696] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:22:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:22.927702 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48510fe1-abd9-4b54-b59b-dc85f90759f1 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:23.016787 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:23.055865 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48510fe1-abd9-4b54-b59b-dc85f90759f1 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:23.085091 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1529b9-82a4-4a22-870d-822c494afdd1 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:23.098098 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bdac09-3f44-4978-8523-069551ecad65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:23.099753 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bdac09-3f44-4978-8523-069551ecad65 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:23.100247 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bdac09-3f44-4978-8523-069551ecad65 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:23.100720 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bdac09-3f44-4978-8523-069551ecad65 None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:23.101831 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bdac09-3f44-4978-8523-069551ecad65 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:23.102403 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bdac09-3f44-4978-8523-069551ecad65 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:23.102826 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:23.105117 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bdac09-3f44-4978-8523-069551ecad65 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:23.128735 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 359/697] 10.222.0.26 () {56 vars in 1135 bytes} [Fri Jul 1 19:22:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:23.130091 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bdac09-3f44-4978-8523-069551ecad65 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:23.156796 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5eae50-ce2f-458a-ae2f-9a268c73aa8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:23.158163 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5eae50-ce2f-458a-ae2f-9a268c73aa8d None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:23.158743 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5eae50-ce2f-458a-ae2f-9a268c73aa8d None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:23.159305 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5eae50-ce2f-458a-ae2f-9a268c73aa8d None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:23.160722 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5eae50-ce2f-458a-ae2f-9a268c73aa8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:23.161341 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5eae50-ce2f-458a-ae2f-9a268c73aa8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:23.164325 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5eae50-ce2f-458a-ae2f-9a268c73aa8d None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:23.182972 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 339/698] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Jul 1 19:22:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:23.183963 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5eae50-ce2f-458a-ae2f-9a268c73aa8d None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:23.307910 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bdac09-3f44-4978-8523-069551ecad65 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:23.330174 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5eae50-ce2f-458a-ae2f-9a268c73aa8d None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:23.342386 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:23.364114 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad418720-bded-4c60-a445-c31b79e49492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:23.366088 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad418720-bded-4c60-a445-c31b79e49492 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:23.367103 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad418720-bded-4c60-a445-c31b79e49492 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:23.368669 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad418720-bded-4c60-a445-c31b79e49492 None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:23.370778 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad418720-bded-4c60-a445-c31b79e49492 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:23.372094 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad418720-bded-4c60-a445-c31b79e49492 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:23.376354 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad418720-bded-4c60-a445-c31b79e49492 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:23.379755 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a7f68-9be7-4c9d-9518-99682dc41973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:23.380511 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a7f68-9be7-4c9d-9518-99682dc41973 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:23.380913 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a7f68-9be7-4c9d-9518-99682dc41973 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:23.381820 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a7f68-9be7-4c9d-9518-99682dc41973 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:23.402322 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 360/699] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Jul 1 19:22:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:23.404979 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad418720-bded-4c60-a445-c31b79e49492 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:23.429654 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:23.471299 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8a7f68-9be7-4c9d-9518-99682dc41973 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:23.473115 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8a7f68-9be7-4c9d-9518-99682dc41973 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:23.565786 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad418720-bded-4c60-a445-c31b79e49492 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:23.617392 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a134be96-1456-4bad-a55a-bee5b001f4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:23.620234 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a134be96-1456-4bad-a55a-bee5b001f4c6 None admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:23.625673 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a134be96-1456-4bad-a55a-bee5b001f4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:23.625673 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a134be96-1456-4bad-a55a-bee5b001f4c6 None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:23.625673 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a134be96-1456-4bad-a55a-bee5b001f4c6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:23.625673 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a134be96-1456-4bad-a55a-bee5b001f4c6 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:23.668601 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 361/700] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Jul 1 19:22:23 2022] POST /identity/v3/users => generated 254 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:22:23.669783 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a134be96-1456-4bad-a55a-bee5b001f4c6 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:23.677870 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 340/701] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Jul 1 19:22:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 19:22:23.682573 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a7f68-9be7-4c9d-9518-99682dc41973 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:23.782629 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:23.787955 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:23.858815 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a7f68-9be7-4c9d-9518-99682dc41973 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:23.862493 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a134be96-1456-4bad-a55a-bee5b001f4c6 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:23.910354 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e012cc95-8a23-4250-a593-86fc8a73cf28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:23.911205 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e012cc95-8a23-4250-a593-86fc8a73cf28 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:23.911494 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e012cc95-8a23-4250-a593-86fc8a73cf28 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:23.911789 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e012cc95-8a23-4250-a593-86fc8a73cf28 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:23.922225 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e012cc95-8a23-4250-a593-86fc8a73cf28 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:23.922742 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b161eb-1520-40cc-af7c-21a2f3e28229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:23.923687 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e012cc95-8a23-4250-a593-86fc8a73cf28 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:23.923964 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b161eb-1520-40cc-af7c-21a2f3e28229 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:23.924367 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b161eb-1520-40cc-af7c-21a2f3e28229 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:23.924929 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b161eb-1520-40cc-af7c-21a2f3e28229 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:23.939705 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-e012cc95-8a23-4250-a593-86fc8a73cf28 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:22:23.939705 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:23.939705 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:23.939705 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:23.939705 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:23.939705 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:23.939705 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:23.939705 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:23.939705 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:23.939705 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:23.939705 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:23.939705 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:23.939705 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 19:22:23.939705 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 19:22:23.939705 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 19:22:23.941675 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 19:22:23.941675 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:23.941675 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:23.941675 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:23.941675 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:23.941675 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:23.941675 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:23.941675 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:23.941675 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:23.941675 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:23.941675 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:23.941675 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:23.941675 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:23.941675 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:23.941675 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:23.941675 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:23.941675 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:23.943572 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 19:22:23.943572 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 19:22:23.943572 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 19:22:23.943572 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 19:22:23.943572 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 19:22:23.943572 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 19:22:23.943572 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:22:23.943572 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:23.943572 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 362/702] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Jul 1 19:22:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:23.946630 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dcc937-a05f-4693-a902-5375fe40b1db None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:23.946928 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dcc937-a05f-4693-a902-5375fe40b1db None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:23.947205 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dcc937-a05f-4693-a902-5375fe40b1db None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:23.948421 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b161eb-1520-40cc-af7c-21a2f3e28229 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:23.948747 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 363/703] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:22:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:22:23.950914 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b161eb-1520-40cc-af7c-21a2f3e28229 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:23.951891 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dcc937-a05f-4693-a902-5375fe40b1db None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:23.985280 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-e8b161eb-1520-40cc-af7c-21a2f3e28229 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:23.985280 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:23.985280 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:23.985280 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:23.985280 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:23.985280 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:23.985280 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:23.985280 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:23.985280 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:23.985280 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:23.985280 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:23.985280 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:23.985280 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:22:23.985280 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:22:23.985280 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:22:23.986918 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:22:23.986918 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:23.986918 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:23.986918 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:23.986918 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:23.986918 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:23.986918 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:23.986918 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:23.986918 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:23.986918 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:23.986918 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:23.986918 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:23.986918 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:23.986918 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:23.986918 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:23.986918 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:23.986918 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:23.988591 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:22:23.988591 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:22:23.988591 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:23.988591 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:23.992770 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 341/704] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:22:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:23.995406 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bef003-d399-4d15-9b2b-7a0fa43d5261 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:23.996202 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bef003-d399-4d15-9b2b-7a0fa43d5261 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:23.997015 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bef003-d399-4d15-9b2b-7a0fa43d5261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:24.026281 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-b7bef003-d399-4d15-9b2b-7a0fa43d5261 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:22:24.028817 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-b7bef003-d399-4d15-9b2b-7a0fa43d5261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:22:24.075074 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dcc937-a05f-4693-a902-5375fe40b1db None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:24.079207 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:24.122783 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f673c741-fbb9-45a8-ac89-671c6334aba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:24.123516 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673c741-fbb9-45a8-ac89-671c6334aba3 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:24.123793 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673c741-fbb9-45a8-ac89-671c6334aba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:24.124124 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673c741-fbb9-45a8-ac89-671c6334aba3 None admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:24.125333 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f673c741-fbb9-45a8-ac89-671c6334aba3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:24.125512 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f673c741-fbb9-45a8-ac89-671c6334aba3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:24.126963 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f673c741-fbb9-45a8-ac89-671c6334aba3 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:24.164135 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 342/706] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:22:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:22:24.164135 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bef003-d399-4d15-9b2b-7a0fa43d5261 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:24.164799 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 364/706] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Jul 1 19:22:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:22:24.167067 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f673c741-fbb9-45a8-ac89-671c6334aba3 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:24.212878 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:24.268817 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bef003-d399-4d15-9b2b-7a0fa43d5261 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:24.307744 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb8c7b6-0e34-493b-a353-201315848fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:24.308415 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb8c7b6-0e34-493b-a353-201315848fd9 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:24.308693 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb8c7b6-0e34-493b-a353-201315848fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:24.308964 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb8c7b6-0e34-493b-a353-201315848fd9 None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:24.309718 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb8c7b6-0e34-493b-a353-201315848fd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:24.310052 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb8c7b6-0e34-493b-a353-201315848fd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:24.311426 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb8c7b6-0e34-493b-a353-201315848fd9 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:24.328545 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 343/707] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Jul 1 19:22:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:24.329526 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb8c7b6-0e34-493b-a353-201315848fd9 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:24.361105 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f673c741-fbb9-45a8-ac89-671c6334aba3 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:24.423268 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d517697-aeab-4c43-8ba4-f3ccdf8175a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:24.425482 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d517697-aeab-4c43-8ba4-f3ccdf8175a0 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:24.426284 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d517697-aeab-4c43-8ba4-f3ccdf8175a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:24.427205 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d517697-aeab-4c43-8ba4-f3ccdf8175a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:24.429042 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d517697-aeab-4c43-8ba4-f3ccdf8175a0 None admin] RBAC: Adding query filter params (role.id=6cb03785fb184ef587509b3174622f69, scope.project.id=69c523a41f4048cfb7df553b6feb6310, user.id=13fd76fc7dd1410b9cde5adbaa6cb2e5) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:24.429807 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d517697-aeab-4c43-8ba4-f3ccdf8175a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:24.432804 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d517697-aeab-4c43-8ba4-f3ccdf8175a0 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:24.435997 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb8c7b6-0e34-493b-a353-201315848fd9 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:24.447006 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:24.449420 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 365/708] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Jul 1 19:22:24 2022] GET /identity/v3/role_assignments?user.id=13fd76fc7dd1410b9cde5adbaa6cb2e5&scope.project.id=69c523a41f4048cfb7df553b6feb6310&role.id=6cb03785fb184ef587509b3174622f69 => generated 259 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:22:24.451850 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d517697-aeab-4c43-8ba4-f3ccdf8175a0 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:24.477784 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab97338-2723-41ad-9ee4-ab10a5c66fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:24.478858 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab97338-2723-41ad-9ee4-ab10a5c66fcd None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:24.479286 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab97338-2723-41ad-9ee4-ab10a5c66fcd None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:24.479742 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab97338-2723-41ad-9ee4-ab10a5c66fcd None admin] PATH_INFO: `/v3/services/network` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:24.480566 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab97338-2723-41ad-9ee4-ab10a5c66fcd None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:24.482367 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab97338-2723-41ad-9ee4-ab10a5c66fcd None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:24.515328 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-fab97338-2723-41ad-9ee4-ab10a5c66fcd None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 01 19:22:24.515328 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:24.515328 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 19:22:24.515328 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 19:22:24.515328 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 19:22:24.515328 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 19:22:24.515328 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 19:22:24.515328 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:22:24.515328 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 01 19:22:24.515328 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:24.515328 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 19:22:24.515328 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:24.515328 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:24.515328 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:24.515328 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:24.515328 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:24.515328 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:24.516440 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:24.516440 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:24.516440 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:24.516440 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:24.516440 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:24.516440 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:24.516440 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 19:22:24.516440 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 19:22:24.516440 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 19:22:24.516440 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 19:22:24.516440 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:24.516440 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:24.516440 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:24.516440 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:24.516440 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:24.516440 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:24.517355 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:24.517355 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:24.517355 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:24.517355 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:24.517355 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:24.517355 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:24.517355 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:24.517355 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:24.517355 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:24.517355 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:24.517355 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 19:22:24.517355 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:22:24.517355 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 01 19:22:24.517355 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:24.520549 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 344/709] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Jul 1 19:22:24 2022] GET /identity/v3/services/network => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:24.526234 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:24.526420 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab97338-2723-41ad-9ee4-ab10a5c66fcd None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:24.610301 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d517697-aeab-4c43-8ba4-f3ccdf8175a0 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:24.661185 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b826f1-0109-44a1-b536-ba34e54f2375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:24.662339 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b826f1-0109-44a1-b536-ba34e54f2375 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:24.662806 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b826f1-0109-44a1-b536-ba34e54f2375 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:24.663284 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b826f1-0109-44a1-b536-ba34e54f2375 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:24.670971 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b826f1-0109-44a1-b536-ba34e54f2375 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:24.672664 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b826f1-0109-44a1-b536-ba34e54f2375 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:24.705023 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-c9b826f1-0109-44a1-b536-ba34e54f2375 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:22:24.705023 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:24.705023 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:24.705023 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:24.705023 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:24.705023 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:24.705023 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:24.705023 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:24.705023 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:24.705023 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:24.705023 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:24.705023 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:24.705023 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 19:22:24.705023 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 19:22:24.705023 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 19:22:24.706021 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 19:22:24.706021 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:24.706021 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:24.706021 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:24.706021 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:24.706021 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:24.706021 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:24.706021 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:24.706021 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:24.706021 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:24.706021 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:24.706021 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:24.706021 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:24.706021 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:24.706021 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:24.706021 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:24.706021 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:24.706940 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 19:22:24.706940 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 19:22:24.706940 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 19:22:24.706940 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 19:22:24.706940 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 19:22:24.706940 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 19:22:24.706940 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:22:24.706940 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:24.717630 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 366/710] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Jul 1 19:22:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:24.718856 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b826f1-0109-44a1-b536-ba34e54f2375 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:24.719891 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab97338-2723-41ad-9ee4-ab10a5c66fcd None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:24.764227 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cd7baf-4f1d-44a2-8b90-837c87c0d72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:24.764908 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd7baf-4f1d-44a2-8b90-837c87c0d72d None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:24.765196 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd7baf-4f1d-44a2-8b90-837c87c0d72d None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:24.765498 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd7baf-4f1d-44a2-8b90-837c87c0d72d None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:24.766220 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cd7baf-4f1d-44a2-8b90-837c87c0d72d None admin] RBAC: Adding query filter params (name=network) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:24.766534 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cd7baf-4f1d-44a2-8b90-837c87c0d72d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:24.767941 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cd7baf-4f1d-44a2-8b90-837c87c0d72d None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:24.776166 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 345/711] 10.222.0.26 () {56 vars in 1112 bytes} [Fri Jul 1 19:22:24 2022] GET /identity/v3/services?name=network => generated 124 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:24.784070 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cd7baf-4f1d-44a2-8b90-837c87c0d72d None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:24.878135 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:24.889264 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:24.914411 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cd7baf-4f1d-44a2-8b90-837c87c0d72d None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:24.930120 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b826f1-0109-44a1-b536-ba34e54f2375 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:24.960685 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f382c28f-6e7a-4e30-8d9b-4adcf87052a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:24.962293 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f382c28f-6e7a-4e30-8d9b-4adcf87052a6 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:24.963184 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f382c28f-6e7a-4e30-8d9b-4adcf87052a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:24.963952 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f382c28f-6e7a-4e30-8d9b-4adcf87052a6 None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:24.965602 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f382c28f-6e7a-4e30-8d9b-4adcf87052a6 None admin] RBAC: Adding query filter params (type=network) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:24.966963 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f382c28f-6e7a-4e30-8d9b-4adcf87052a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:24.971087 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f382c28f-6e7a-4e30-8d9b-4adcf87052a6 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:24.984298 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 346/712] 10.222.0.26 () {56 vars in 1112 bytes} [Fri Jul 1 19:22:24 2022] GET /identity/v3/services?type=network => generated 124 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:22:25.030279 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa115e-8b22-487f-9cf2-5b55067925b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:25.031059 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa115e-8b22-487f-9cf2-5b55067925b9 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:25.031344 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa115e-8b22-487f-9cf2-5b55067925b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:25.031622 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa115e-8b22-487f-9cf2-5b55067925b9 None admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:25.032432 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aa115e-8b22-487f-9cf2-5b55067925b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:25.032745 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aa115e-8b22-487f-9cf2-5b55067925b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:25.035035 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aa115e-8b22-487f-9cf2-5b55067925b9 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:25.059847 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 367/713] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Jul 1 19:22:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:25.069112 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f382c28f-6e7a-4e30-8d9b-4adcf87052a6 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:25.275846 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f382c28f-6e7a-4e30-8d9b-4adcf87052a6 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:25.289574 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:25.303314 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60bbfc-d954-4cfa-adbd-b4619298dab8 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:25.303710 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60bbfc-d954-4cfa-adbd-b4619298dab8 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:25.303864 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60bbfc-d954-4cfa-adbd-b4619298dab8 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:25.309499 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 368/714] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:22:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:22:25.311796 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f58ce-6ed2-41c0-8269-261e48e26fa4 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:25.312086 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f58ce-6ed2-41c0-8269-261e48e26fa4 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:25.312370 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f58ce-6ed2-41c0-8269-261e48e26fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:25.339006 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-513f58ce-6ed2-41c0-8269-261e48e26fa4 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:22:25.340317 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-513f58ce-6ed2-41c0-8269-261e48e26fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:22:25.341137 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59851d6d-672b-4d5c-827b-c2ef1a54ab45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:25.342658 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59851d6d-672b-4d5c-827b-c2ef1a54ab45 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:25.343148 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59851d6d-672b-4d5c-827b-c2ef1a54ab45 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:25.345000 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59851d6d-672b-4d5c-827b-c2ef1a54ab45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:25.346620 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59851d6d-672b-4d5c-827b-c2ef1a54ab45 None admin] RBAC: Adding query filter params (role.id=35ca0f0b9a964300a63780ec435e730b, scope.project.id=69c523a41f4048cfb7df553b6feb6310, user.id=e958c5b03a9346d59c32675c5271bf3b) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:25.347169 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59851d6d-672b-4d5c-827b-c2ef1a54ab45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:25.351791 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59851d6d-672b-4d5c-827b-c2ef1a54ab45 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:25.360810 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 347/715] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Jul 1 19:22:25 2022] GET /identity/v3/role_assignments?user.id=e958c5b03a9346d59c32675c5271bf3b&scope.project.id=69c523a41f4048cfb7df553b6feb6310&role.id=35ca0f0b9a964300a63780ec435e730b => generated 608 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:25.486198 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 369/716] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:22:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:22:25.533458 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59851d6d-672b-4d5c-827b-c2ef1a54ab45 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:25.648909 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59851d6d-672b-4d5c-827b-c2ef1a54ab45 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:25.692157 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e08278-08fd-410a-9670-a12a37800b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:25.692976 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e08278-08fd-410a-9670-a12a37800b7b None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:25.693300 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e08278-08fd-410a-9670-a12a37800b7b None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:25.693560 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e08278-08fd-410a-9670-a12a37800b7b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:25.694226 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e08278-08fd-410a-9670-a12a37800b7b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:25.695621 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e08278-08fd-410a-9670-a12a37800b7b None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:25.708920 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-b2e08278-08fd-410a-9670-a12a37800b7b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 01 19:22:25.708920 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:25.708920 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 19:22:25.708920 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 19:22:25.708920 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 19:22:25.708920 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 19:22:25.708920 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 19:22:25.708920 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:22:25.708920 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 01 19:22:25.708920 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:25.708920 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 19:22:25.708920 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:25.708920 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:25.708920 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:25.708920 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:25.708920 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:25.710601 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:25.710601 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:25.710601 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:25.710601 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:25.710601 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:25.710601 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:25.710601 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:25.710601 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 19:22:25.710601 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 19:22:25.710601 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 19:22:25.710601 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 19:22:25.710601 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:25.710601 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:25.710601 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:25.710601 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:25.710601 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:25.712011 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:25.712011 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:25.712011 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:25.712011 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:25.712011 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:25.712011 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:25.712011 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:25.712011 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:25.712011 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:25.712011 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:25.712011 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:25.712011 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 19:22:25.712011 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:22:25.712011 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 01 19:22:25.712011 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:25.712011 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 348/717] 10.222.0.26 () {56 vars in 1129 bytes} [Fri Jul 1 19:22:25 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:25.717565 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f58ce-6ed2-41c0-8269-261e48e26fa4 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:25.824031 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:25.847961 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f58ce-6ed2-41c0-8269-261e48e26fa4 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:25.893593 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df87be-f37d-4791-94e4-65e0366db517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:25.894522 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df87be-f37d-4791-94e4-65e0366db517 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:25.894960 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df87be-f37d-4791-94e4-65e0366db517 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:25.895453 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df87be-f37d-4791-94e4-65e0366db517 None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:25.896325 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18df87be-f37d-4791-94e4-65e0366db517 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:25.896789 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18df87be-f37d-4791-94e4-65e0366db517 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:25.898428 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18df87be-f37d-4791-94e4-65e0366db517 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:25.904567 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 370/718] 10.222.0.26 () {56 vars in 1124 bytes} [Fri Jul 1 19:22:25 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:22:25.910330 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e08278-08fd-410a-9670-a12a37800b7b None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:25.954421 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:26.103808 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e08278-08fd-410a-9670-a12a37800b7b None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:26.170668 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179dfc4f-6cde-471b-a212-5e4c5a35d0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:26.171802 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179dfc4f-6cde-471b-a212-5e4c5a35d0bd None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:26.172291 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179dfc4f-6cde-471b-a212-5e4c5a35d0bd None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:26.172776 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179dfc4f-6cde-471b-a212-5e4c5a35d0bd None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:26.174084 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179dfc4f-6cde-471b-a212-5e4c5a35d0bd None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:26.174635 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179dfc4f-6cde-471b-a212-5e4c5a35d0bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:26.177177 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179dfc4f-6cde-471b-a212-5e4c5a35d0bd None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:26.185177 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 349/719] 10.222.0.26 () {56 vars in 1124 bytes} [Fri Jul 1 19:22:25 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:22:27.213037 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af4b654-9d31-460b-a449-f46db44009b1 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:27.213843 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af4b654-9d31-460b-a449-f46db44009b1 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:27.213843 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af4b654-9d31-460b-a449-f46db44009b1 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:27.214998 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 371/720] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:22:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:22:27.233352 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f6194-605e-464b-943d-614340beeba7 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:27.234318 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f6194-605e-464b-943d-614340beeba7 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:27.234797 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f6194-605e-464b-943d-614340beeba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:27.259550 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-c78f6194-605e-464b-943d-614340beeba7 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:22:27.261046 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-c78f6194-605e-464b-943d-614340beeba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:22:27.380900 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 350/721] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:22:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:22:27.444065 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af4b654-9d31-460b-a449-f46db44009b1 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:27.463689 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebab185-f37e-4279-818a-87628b7f7e79 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:27.464568 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebab185-f37e-4279-818a-87628b7f7e79 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:27.465336 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebab185-f37e-4279-818a-87628b7f7e79 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:27.468701 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 351/722] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:22:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:22:27.477431 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02663b-a648-4300-a878-5d12775e2bfe None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:27.478232 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02663b-a648-4300-a878-5d12775e2bfe None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:27.478721 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02663b-a648-4300-a878-5d12775e2bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:27.530819 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-1c02663b-a648-4300-a878-5d12775e2bfe None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:22:27.532693 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-1c02663b-a648-4300-a878-5d12775e2bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:22:27.589680 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:27.662164 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af4b654-9d31-460b-a449-f46db44009b1 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:27.734561 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 352/723] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:22:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:22:27.746604 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ddea3d-8fa6-45f3-93f1-b094edcb40c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:27.748889 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ddea3d-8fa6-45f3-93f1-b094edcb40c9 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:27.749703 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ddea3d-8fa6-45f3-93f1-b094edcb40c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:27.750474 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ddea3d-8fa6-45f3-93f1-b094edcb40c9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:27.769443 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ddea3d-8fa6-45f3-93f1-b094edcb40c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:22:27.785161 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-31ddea3d-8fa6-45f3-93f1-b094edcb40c9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:22:27.785161 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:27.785161 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:27.785161 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:27.785161 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:27.785161 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:27.785161 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:27.785161 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:27.785161 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:27.785161 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:27.785161 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:27.785161 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:27.785161 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:22:27.785161 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:22:27.785161 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:22:27.785161 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:22:27.787005 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:22:27.787005 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:22:27.787005 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:22:27.787005 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:22:27.787005 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:27.787005 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:27.787005 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:27.787005 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:27.787005 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:27.787005 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:27.787005 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:27.787005 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:27.787005 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:27.787005 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:27.787005 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:27.787005 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:27.788671 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:27.788671 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:27.788671 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:27.788671 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:27.788671 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:22:27.788671 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:22:27.788671 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:22:27.788671 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:22:27.788671 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:22:27.788671 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:22:27.788671 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:22:27.788671 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:27.793509 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 372/724] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Jul 1 19:22:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:27.802483 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c02663b-a648-4300-a878-5d12775e2bfe None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:27.816169 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ddea3d-8fa6-45f3-93f1-b094edcb40c9 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:27.824118 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:28.005379 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c02663b-a648-4300-a878-5d12775e2bfe None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:28.039105 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe7b88d-df48-43c5-af11-5a39f3eb40a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:28.039791 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7b88d-df48-43c5-af11-5a39f3eb40a6 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:28.040079 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7b88d-df48-43c5-af11-5a39f3eb40a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:28.040358 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7b88d-df48-43c5-af11-5a39f3eb40a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:28.041119 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe7b88d-df48-43c5-af11-5a39f3eb40a6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:28.041619 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe7b88d-df48-43c5-af11-5a39f3eb40a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:28.043019 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe7b88d-df48-43c5-af11-5a39f3eb40a6 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:28.058854 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ddea3d-8fa6-45f3-93f1-b094edcb40c9 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:28.068599 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 353/725] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Jul 1 19:22:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:28.074613 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe7b88d-df48-43c5-af11-5a39f3eb40a6 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:28.126732 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:28.157190 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c9c6b9-1434-4d26-9bf4-8466c6d61f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:28.158437 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9c6b9-1434-4d26-9bf4-8466c6d61f85 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:28.158872 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9c6b9-1434-4d26-9bf4-8466c6d61f85 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:28.159279 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9c6b9-1434-4d26-9bf4-8466c6d61f85 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:28.188814 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c9c6b9-1434-4d26-9bf4-8466c6d61f85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:22:28.197696 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-56c9c6b9-1434-4d26-9bf4-8466c6d61f85 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:22:28.197696 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:28.197696 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:28.197696 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:28.197696 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:28.197696 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:28.197696 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:28.197696 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:28.197696 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:28.197696 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:28.197696 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:28.197696 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:28.197696 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:22:28.197696 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:22:28.197696 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:22:28.197696 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:22:28.199856 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:22:28.199856 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:22:28.199856 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:22:28.199856 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:22:28.199856 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:28.199856 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:28.199856 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:28.199856 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:28.199856 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:28.199856 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:28.199856 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:28.199856 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:28.199856 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:28.199856 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:28.199856 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:28.199856 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:28.202448 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:28.202448 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:28.202448 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:28.202448 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:28.202448 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:22:28.202448 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:22:28.202448 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:22:28.202448 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:22:28.202448 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:22:28.202448 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:22:28.202448 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:22:28.202448 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:28.202448 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 373/726] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Jul 1 19:22:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 392 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:28.208194 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c9c6b9-1434-4d26-9bf4-8466c6d61f85 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:28.353729 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe7b88d-df48-43c5-af11-5a39f3eb40a6 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:28.361698 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:28.464644 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b9f41-ff9b-4672-924e-1c4b4288a95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:28.465478 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b9f41-ff9b-4672-924e-1c4b4288a95b None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:28.465760 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b9f41-ff9b-4672-924e-1c4b4288a95b None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:28.466102 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b9f41-ff9b-4672-924e-1c4b4288a95b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:28.468558 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c9c6b9-1434-4d26-9bf4-8466c6d61f85 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:28.491262 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b9f41-ff9b-4672-924e-1c4b4288a95b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:28.492720 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b9f41-ff9b-4672-924e-1c4b4288a95b None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:28.529674 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-838b9f41-ff9b-4672-924e-1c4b4288a95b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:28.529674 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:28.529674 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:28.529674 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:28.529674 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:28.529674 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:28.529674 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:28.529674 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:28.529674 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:28.529674 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:28.529674 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:28.529674 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:28.529674 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:22:28.529674 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:22:28.529674 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:22:28.531693 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:22:28.531693 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:28.531693 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:28.531693 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:28.531693 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:28.531693 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:28.531693 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:28.531693 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:28.531693 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:28.531693 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:28.531693 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:28.531693 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:28.531693 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:28.531693 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:28.531693 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:28.531693 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:28.531693 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:28.533747 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:22:28.533747 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:22:28.533747 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:28.533747 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:28.535031 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 354/727] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:22:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 461 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:28.536490 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908916c-ebfc-4302-9beb-8c09561d3dfc None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:28.536773 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908916c-ebfc-4302-9beb-8c09561d3dfc None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:28.537046 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908916c-ebfc-4302-9beb-8c09561d3dfc None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:28.538632 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 355/728] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:22:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:22:28.543082 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d908916c-ebfc-4302-9beb-8c09561d3dfc None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:28.543686 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7acf586-0d89-4b25-aa95-0e0e2d2b17cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:28.545098 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7acf586-0d89-4b25-aa95-0e0e2d2b17cb None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:28.546010 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7acf586-0d89-4b25-aa95-0e0e2d2b17cb None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:28.546903 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7acf586-0d89-4b25-aa95-0e0e2d2b17cb None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:28.548406 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7acf586-0d89-4b25-aa95-0e0e2d2b17cb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:28.549178 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7acf586-0d89-4b25-aa95-0e0e2d2b17cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:28.552050 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7acf586-0d89-4b25-aa95-0e0e2d2b17cb None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:28.571052 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 374/729] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Jul 1 19:22:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:22:28.579259 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f76ca-8b83-42e8-8b90-fc6921d1d188 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:28.580106 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f76ca-8b83-42e8-8b90-fc6921d1d188 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:28.580971 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f76ca-8b83-42e8-8b90-fc6921d1d188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:28.614675 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-251f76ca-8b83-42e8-8b90-fc6921d1d188 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:22:28.616664 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:28.619187 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-251f76ca-8b83-42e8-8b90-fc6921d1d188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:22:28.664579 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d908916c-ebfc-4302-9beb-8c09561d3dfc None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:28.702828 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d37e2a-965d-45b9-ac68-0e5a03470e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:28.703335 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d37e2a-965d-45b9-ac68-0e5a03470e43 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:28.703618 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d37e2a-965d-45b9-ac68-0e5a03470e43 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:28.703892 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d37e2a-965d-45b9-ac68-0e5a03470e43 None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:28.704722 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d37e2a-965d-45b9-ac68-0e5a03470e43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:28.704964 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d37e2a-965d-45b9-ac68-0e5a03470e43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:28.706437 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d37e2a-965d-45b9-ac68-0e5a03470e43 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:28.712438 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 375/730] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:22:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:22:28.713598 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251f76ca-8b83-42e8-8b90-fc6921d1d188 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:28.734419 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 356/731] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Jul 1 19:22:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:28.742314 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d37e2a-965d-45b9-ac68-0e5a03470e43 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:28.780485 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:28.830820 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251f76ca-8b83-42e8-8b90-fc6921d1d188 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:28.854212 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d37e2a-965d-45b9-ac68-0e5a03470e43 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:28.869852 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de059e28-8b0e-4120-8412-99725dc930c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:28.871123 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de059e28-8b0e-4120-8412-99725dc930c7 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:28.871623 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de059e28-8b0e-4120-8412-99725dc930c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:28.872093 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de059e28-8b0e-4120-8412-99725dc930c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:28.884029 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de059e28-8b0e-4120-8412-99725dc930c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:28.885833 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de059e28-8b0e-4120-8412-99725dc930c7 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:28.897166 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:28.908364 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-de059e28-8b0e-4120-8412-99725dc930c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:28.908364 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:28.908364 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:28.908364 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:28.908364 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:28.908364 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:28.908364 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:28.908364 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:28.908364 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:28.908364 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:28.908364 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:28.908364 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:28.908364 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:22:28.908364 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:22:28.908364 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:22:28.909341 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:22:28.909341 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:28.909341 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:28.909341 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:28.909341 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:28.909341 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:28.909341 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:28.909341 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:28.909341 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:28.909341 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:28.909341 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:28.909341 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:28.909341 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:28.909341 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:28.909341 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:28.909341 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:28.909341 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:28.910233 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:22:28.910233 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:22:28.910233 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:28.910233 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:28.910464 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1398d129-d04a-4137-888e-39cca626ca58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:28.910464 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1398d129-d04a-4137-888e-39cca626ca58 None admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:28.911056 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1398d129-d04a-4137-888e-39cca626ca58 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:28.911269 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1398d129-d04a-4137-888e-39cca626ca58 None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:28.912610 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1398d129-d04a-4137-888e-39cca626ca58 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:28.917720 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1398d129-d04a-4137-888e-39cca626ca58 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:28.917908 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 376/732] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:22:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:28.919117 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de059e28-8b0e-4120-8412-99725dc930c7 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:28.945804 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 357/733] 10.222.0.26 () {60 vars in 1141 bytes} [Fri Jul 1 19:22:28 2022] POST /identity/v3/services => generated 240 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:22:28.947643 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1398d129-d04a-4137-888e-39cca626ca58 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:29.089531 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de059e28-8b0e-4120-8412-99725dc930c7 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:29.101397 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:29.147260 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af9eba-bbc7-4dfd-958f-7fc79fbce693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:29.148414 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af9eba-bbc7-4dfd-958f-7fc79fbce693 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:29.148905 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af9eba-bbc7-4dfd-958f-7fc79fbce693 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:29.149434 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af9eba-bbc7-4dfd-958f-7fc79fbce693 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:29.158281 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5af9eba-bbc7-4dfd-958f-7fc79fbce693 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:29.160094 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5af9eba-bbc7-4dfd-958f-7fc79fbce693 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:29.165459 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1398d129-d04a-4137-888e-39cca626ca58 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:29.178970 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-e5af9eba-bbc7-4dfd-958f-7fc79fbce693 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 01 19:22:29.178970 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:29.178970 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:29.178970 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:29.178970 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:29.178970 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:29.178970 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:29.178970 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:29.178970 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:29.178970 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:29.178970 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:29.178970 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:29.178970 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 19:22:29.178970 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 19:22:29.178970 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 19:22:29.178970 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 19:22:29.180722 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:29.180722 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:29.180722 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 19:22:29.180722 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:22:29.180722 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 19:22:29.180722 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:22:29.180722 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:29.180722 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:29.180722 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:29.180722 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:29.180722 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:29.180722 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:29.180722 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:29.180722 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:29.180722 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:29.180722 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:29.180722 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:29.180722 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:29.182735 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:29.182735 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:29.182735 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 19:22:29.182735 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 19:22:29.182735 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 19:22:29.182735 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 19:22:29.182735 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 19:22:29.182735 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 19:22:29.182735 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 01 19:22:29.182735 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:29.182735 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 377/734] 10.222.0.26 () {56 vars in 1117 bytes} [Fri Jul 1 19:22:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:29.186523 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d00ecb-0168-4802-a209-f171791e5a89 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:29.186523 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d00ecb-0168-4802-a209-f171791e5a89 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:29.186523 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d00ecb-0168-4802-a209-f171791e5a89 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:29.188165 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 378/735] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:22:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:22:29.189708 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d00ecb-0168-4802-a209-f171791e5a89 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:29.217260 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca9582b-c7cc-4789-b712-d8236f915f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:29.217260 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca9582b-c7cc-4789-b712-d8236f915f86 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:29.217260 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca9582b-c7cc-4789-b712-d8236f915f86 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:29.217260 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca9582b-c7cc-4789-b712-d8236f915f86 None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:29.217775 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca9582b-c7cc-4789-b712-d8236f915f86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:29.217775 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca9582b-c7cc-4789-b712-d8236f915f86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:29.217775 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca9582b-c7cc-4789-b712-d8236f915f86 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:29.230106 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 358/736] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Jul 1 19:22:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:29.231410 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef121ec2-7bf8-49d6-9e6c-bdbada8a00fe None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:29.236835 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef121ec2-7bf8-49d6-9e6c-bdbada8a00fe None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:29.237165 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef121ec2-7bf8-49d6-9e6c-bdbada8a00fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:29.257100 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-ef121ec2-7bf8-49d6-9e6c-bdbada8a00fe None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:22:29.258373 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-ef121ec2-7bf8-49d6-9e6c-bdbada8a00fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:22:29.321070 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:29.337736 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d00ecb-0168-4802-a209-f171791e5a89 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:29.369261 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 359/737] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:22:29 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:22:29.369261 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef121ec2-7bf8-49d6-9e6c-bdbada8a00fe None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:29.391053 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca651e3a-f2ab-45d1-833c-cd323c70fe91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:29.392183 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca651e3a-f2ab-45d1-833c-cd323c70fe91 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:29.392881 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca651e3a-f2ab-45d1-833c-cd323c70fe91 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:29.393409 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca651e3a-f2ab-45d1-833c-cd323c70fe91 None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:29.394859 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca651e3a-f2ab-45d1-833c-cd323c70fe91 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:29.395375 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca651e3a-f2ab-45d1-833c-cd323c70fe91 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:29.398015 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca651e3a-f2ab-45d1-833c-cd323c70fe91 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:29.425791 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 379/738] 10.222.0.26 () {56 vars in 1149 bytes} [Fri Jul 1 19:22:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:29.427447 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d50ada3-75b9-4c00-860c-2ecf8dca649a None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:29.428203 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d50ada3-75b9-4c00-860c-2ecf8dca649a None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:29.428682 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d50ada3-75b9-4c00-860c-2ecf8dca649a None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:29.431078 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 380/739] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:22:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:22:29.432028 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d50ada3-75b9-4c00-860c-2ecf8dca649a None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:29.458770 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:29.515738 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef121ec2-7bf8-49d6-9e6c-bdbada8a00fe None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:29.554248 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d50ada3-75b9-4c00-860c-2ecf8dca649a None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:29.556694 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53efc814-edc4-4409-b153-ef5739e96953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:29.557982 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53efc814-edc4-4409-b153-ef5739e96953 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:29.557982 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53efc814-edc4-4409-b153-ef5739e96953 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:29.558278 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53efc814-edc4-4409-b153-ef5739e96953 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:29.566164 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53efc814-edc4-4409-b153-ef5739e96953 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:29.567652 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53efc814-edc4-4409-b153-ef5739e96953 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:29.583940 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-53efc814-edc4-4409-b153-ef5739e96953 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 01 19:22:29.583940 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:29.583940 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:29.583940 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:29.583940 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:29.583940 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:29.583940 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:29.583940 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:29.583940 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:29.583940 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:29.583940 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:29.583940 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:29.583940 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 19:22:29.583940 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 19:22:29.583940 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 19:22:29.583940 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 19:22:29.584983 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:29.584983 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:29.584983 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 19:22:29.584983 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:22:29.584983 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 19:22:29.584983 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:22:29.584983 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:29.584983 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:29.584983 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:29.584983 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:29.584983 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:29.584983 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:29.584983 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:29.584983 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:29.584983 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:29.584983 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:29.584983 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:29.584983 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:29.586691 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:29.586691 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:29.586691 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 19:22:29.586691 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 19:22:29.586691 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 19:22:29.586691 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 19:22:29.586691 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 19:22:29.586691 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 19:22:29.586691 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 01 19:22:29.586691 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:29.586691 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 360/740] 10.222.0.26 () {56 vars in 1093 bytes} [Fri Jul 1 19:22:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:29.586691 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53efc814-edc4-4409-b153-ef5739e96953 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:29.605716 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28dfc7f-7516-4e45-87b7-6893ecb3a42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:29.607383 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28dfc7f-7516-4e45-87b7-6893ecb3a42c None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:29.607805 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28dfc7f-7516-4e45-87b7-6893ecb3a42c None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:29.608278 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28dfc7f-7516-4e45-87b7-6893ecb3a42c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:29.621817 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28dfc7f-7516-4e45-87b7-6893ecb3a42c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:22:29.635102 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-d28dfc7f-7516-4e45-87b7-6893ecb3a42c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:22:29.635102 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:29.635102 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:29.635102 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:29.635102 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:29.635102 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:29.635102 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:29.635102 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:29.635102 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:29.635102 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:29.635102 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:29.635102 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:29.635102 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:22:29.635102 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:22:29.635102 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:22:29.635102 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:22:29.636069 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:22:29.636069 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:22:29.636069 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:22:29.636069 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:22:29.636069 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:29.636069 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:29.636069 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:29.636069 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:29.636069 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:29.636069 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:29.636069 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:29.636069 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:29.636069 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:29.636069 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:29.636069 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:29.636069 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:29.637320 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:29.637320 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:29.637320 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:29.637320 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:29.637320 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:22:29.637320 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:22:29.637320 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:22:29.637320 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:22:29.637320 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:22:29.637320 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:22:29.637320 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:22:29.637320 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:29.643518 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 381/741] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Jul 1 19:22:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:29.644972 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadeb74a-1f50-4ba7-bba4-6dcae07be393 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:29.645416 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadeb74a-1f50-4ba7-bba4-6dcae07be393 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:29.645818 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadeb74a-1f50-4ba7-bba4-6dcae07be393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:29.648391 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:29.666953 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-aadeb74a-1f50-4ba7-bba4-6dcae07be393 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:22:29.668415 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-aadeb74a-1f50-4ba7-bba4-6dcae07be393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:22:29.725802 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53efc814-edc4-4409-b153-ef5739e96953 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:29.754127 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 382/742] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:22:29 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:22:29.755266 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadeb74a-1f50-4ba7-bba4-6dcae07be393 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:29.777891 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74c2f4a-bf6c-46b9-89dd-74047521a17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:29.779375 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c2f4a-bf6c-46b9-89dd-74047521a17d None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:29.779834 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c2f4a-bf6c-46b9-89dd-74047521a17d None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:29.780280 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c2f4a-bf6c-46b9-89dd-74047521a17d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:29.791292 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:29.867916 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74c2f4a-bf6c-46b9-89dd-74047521a17d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:29.869509 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74c2f4a-bf6c-46b9-89dd-74047521a17d None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:29.912276 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:29.921638 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadeb74a-1f50-4ba7-bba4-6dcae07be393 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:29.977258 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e80a1-0210-4d77-afdb-3f0fbfdc4d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:29.978579 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e80a1-0210-4d77-afdb-3f0fbfdc4d41 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:29.979137 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e80a1-0210-4d77-afdb-3f0fbfdc4d41 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:29.979685 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e80a1-0210-4d77-afdb-3f0fbfdc4d41 None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:29.981297 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 361/743] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Jul 1 19:22:29 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 19:22:29.981697 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746e80a1-0210-4d77-afdb-3f0fbfdc4d41 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:29.987437 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746e80a1-0210-4d77-afdb-3f0fbfdc4d41 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:29.987612 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74c2f4a-bf6c-46b9-89dd-74047521a17d None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:29.987703 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746e80a1-0210-4d77-afdb-3f0fbfdc4d41 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:30.021273 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 383/744] 10.222.0.26 () {56 vars in 1133 bytes} [Fri Jul 1 19:22:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:30.021273 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e80a1-0210-4d77-afdb-3f0fbfdc4d41 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:30.101414 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74c2f4a-bf6c-46b9-89dd-74047521a17d None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:30.126070 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:30.140618 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0984ff63-5742-46ea-a39e-0cecdfbbf828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:30.141312 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0984ff63-5742-46ea-a39e-0cecdfbbf828 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:30.141597 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0984ff63-5742-46ea-a39e-0cecdfbbf828 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:30.141870 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0984ff63-5742-46ea-a39e-0cecdfbbf828 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:30.142614 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0984ff63-5742-46ea-a39e-0cecdfbbf828 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:30.143050 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0984ff63-5742-46ea-a39e-0cecdfbbf828 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:30.144442 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0984ff63-5742-46ea-a39e-0cecdfbbf828 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:30.150637 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:30.155110 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 362/745] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Jul 1 19:22:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:30.156066 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0984ff63-5742-46ea-a39e-0cecdfbbf828 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:30.192307 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e80a1-0210-4d77-afdb-3f0fbfdc4d41 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:30.239271 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c222f-3885-439b-a2bd-068ff4cacbab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:30.239941 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c222f-3885-439b-a2bd-068ff4cacbab None admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:30.240227 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c222f-3885-439b-a2bd-068ff4cacbab None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:30.240508 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c222f-3885-439b-a2bd-068ff4cacbab None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:30.241271 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91c222f-3885-439b-a2bd-068ff4cacbab None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:30.242661 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91c222f-3885-439b-a2bd-068ff4cacbab None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:30.260049 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 384/746] 10.222.0.26 () {60 vars in 1141 bytes} [Fri Jul 1 19:22:30 2022] POST /identity/v3/services => generated 251 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:22:30.260715 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c222f-3885-439b-a2bd-068ff4cacbab None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:30.287080 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0984ff63-5742-46ea-a39e-0cecdfbbf828 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:30.353360 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9742062-d1b7-4a86-b129-c5a6de5fde24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:30.354557 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9742062-d1b7-4a86-b129-c5a6de5fde24 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:30.355053 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9742062-d1b7-4a86-b129-c5a6de5fde24 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:30.355581 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9742062-d1b7-4a86-b129-c5a6de5fde24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:30.373079 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9742062-d1b7-4a86-b129-c5a6de5fde24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:30.376545 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9742062-d1b7-4a86-b129-c5a6de5fde24 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:30.390345 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c222f-3885-439b-a2bd-068ff4cacbab None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:30.403890 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-e9742062-d1b7-4a86-b129-c5a6de5fde24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:30.403890 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:30.403890 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:30.403890 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:30.403890 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:30.403890 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:30.403890 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:30.403890 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:30.403890 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:30.403890 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:30.403890 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:30.403890 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:30.403890 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:22:30.403890 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:22:30.403890 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:22:30.404901 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:22:30.404901 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:30.404901 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:30.404901 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:30.404901 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:30.404901 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:30.404901 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:30.404901 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:30.404901 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:30.404901 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:30.404901 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:30.404901 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:30.404901 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:30.404901 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:30.404901 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:30.404901 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:30.404901 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:30.406368 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:22:30.406368 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:22:30.406368 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:30.406368 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:30.407406 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 363/747] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:22:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:30.408314 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9742062-d1b7-4a86-b129-c5a6de5fde24 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:30.433186 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:30.444046 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d50ac8-a54f-4f27-b8bb-0110f95c02db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:30.445438 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d50ac8-a54f-4f27-b8bb-0110f95c02db None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:30.446013 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d50ac8-a54f-4f27-b8bb-0110f95c02db None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:30.446257 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d50ac8-a54f-4f27-b8bb-0110f95c02db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:30.460863 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d50ac8-a54f-4f27-b8bb-0110f95c02db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:30.463487 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d50ac8-a54f-4f27-b8bb-0110f95c02db None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:30.475311 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:30.483994 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-01d50ac8-a54f-4f27-b8bb-0110f95c02db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:30.483994 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:30.483994 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:30.483994 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:30.483994 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:30.483994 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:30.483994 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:30.483994 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:30.483994 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:30.483994 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:30.483994 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:30.483994 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:30.483994 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:22:30.483994 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:22:30.483994 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:22:30.486095 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:22:30.486095 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:30.486095 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:30.486095 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:30.486095 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:30.486095 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:30.486095 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:30.486095 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:30.486095 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:30.486095 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:30.486095 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:30.486095 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:30.486095 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:30.486095 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:30.486095 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:30.486095 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:30.486095 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:30.487808 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:22:30.487808 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:22:30.487808 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:30.487808 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:30.487808 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 385/748] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:22:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:30.487808 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d50ac8-a54f-4f27-b8bb-0110f95c02db None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:30.547661 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9742062-d1b7-4a86-b129-c5a6de5fde24 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:30.587113 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd3212f-92e1-43e0-b772-05587cc82818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:30.588168 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd3212f-92e1-43e0-b772-05587cc82818 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:30.588645 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd3212f-92e1-43e0-b772-05587cc82818 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:30.589087 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd3212f-92e1-43e0-b772-05587cc82818 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:30.602541 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd3212f-92e1-43e0-b772-05587cc82818 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:30.604353 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd3212f-92e1-43e0-b772-05587cc82818 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:30.609554 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d50ac8-a54f-4f27-b8bb-0110f95c02db None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:30.625365 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-9cd3212f-92e1-43e0-b772-05587cc82818 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:30.625365 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:30.625365 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:30.625365 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:30.625365 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:30.625365 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:30.625365 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:30.625365 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:30.625365 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:30.625365 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:30.625365 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:30.625365 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:30.625365 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:22:30.625365 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:22:30.625365 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:22:30.626502 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:22:30.626502 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:30.626502 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:30.626502 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:30.626502 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:30.626502 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:30.626502 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:30.626502 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:30.626502 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:30.626502 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:30.626502 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:30.626502 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:30.626502 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:30.626502 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:30.626502 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:30.626502 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:30.626502 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:30.627396 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:22:30.627396 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:22:30.627396 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:30.627396 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:30.629600 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 364/749] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:22:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:30.630676 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd3212f-92e1-43e0-b772-05587cc82818 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:30.665673 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db57b98b-e72e-4848-927c-3388851657da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:30.667076 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db57b98b-e72e-4848-927c-3388851657da None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:30.667865 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db57b98b-e72e-4848-927c-3388851657da None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:30.668786 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db57b98b-e72e-4848-927c-3388851657da None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:30.670642 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db57b98b-e72e-4848-927c-3388851657da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:30.671225 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db57b98b-e72e-4848-927c-3388851657da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:30.673843 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db57b98b-e72e-4848-927c-3388851657da None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:30.696496 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 386/750] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Jul 1 19:22:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:30.698506 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db57b98b-e72e-4848-927c-3388851657da None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:30.754178 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:30.757741 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd3212f-92e1-43e0-b772-05587cc82818 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:30.759490 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:30.804258 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90608839-e19d-4d7d-8f18-9180233c7f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:30.805345 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90608839-e19d-4d7d-8f18-9180233c7f23 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:30.805859 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90608839-e19d-4d7d-8f18-9180233c7f23 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:30.806315 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90608839-e19d-4d7d-8f18-9180233c7f23 None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:30.807943 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90608839-e19d-4d7d-8f18-9180233c7f23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:30.808440 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90608839-e19d-4d7d-8f18-9180233c7f23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:30.810894 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90608839-e19d-4d7d-8f18-9180233c7f23 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:30.827900 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 365/751] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Jul 1 19:22:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:30.829467 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90608839-e19d-4d7d-8f18-9180233c7f23 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:30.849460 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db57b98b-e72e-4848-927c-3388851657da None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:30.890128 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182c81c9-317b-4122-aa52-48589adffea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:30.890828 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c81c9-317b-4122-aa52-48589adffea9 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:30.891558 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c81c9-317b-4122-aa52-48589adffea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:30.891839 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c81c9-317b-4122-aa52-48589adffea9 None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:30.892841 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182c81c9-317b-4122-aa52-48589adffea9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:30.893152 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182c81c9-317b-4122-aa52-48589adffea9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:30.895409 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182c81c9-317b-4122-aa52-48589adffea9 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:30.912175 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 387/752] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Jul 1 19:22:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:30.913414 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182c81c9-317b-4122-aa52-48589adffea9 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:30.961673 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90608839-e19d-4d7d-8f18-9180233c7f23 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:31.006291 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef95dfa1-12de-4864-b0f0-52e2a6999210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:31.007698 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef95dfa1-12de-4864-b0f0-52e2a6999210 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:31.007981 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef95dfa1-12de-4864-b0f0-52e2a6999210 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:31.008559 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef95dfa1-12de-4864-b0f0-52e2a6999210 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:31.018295 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef95dfa1-12de-4864-b0f0-52e2a6999210 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:31.020238 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef95dfa1-12de-4864-b0f0-52e2a6999210 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:31.040039 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-ef95dfa1-12de-4864-b0f0-52e2a6999210 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:22:31.040039 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:31.040039 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:31.040039 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:31.040039 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:31.040039 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:31.040039 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:31.040039 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:31.040039 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:31.040039 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:31.040039 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:31.040039 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:31.040039 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 19:22:31.040039 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 19:22:31.040039 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 19:22:31.041184 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 19:22:31.041184 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:31.041184 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:31.041184 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:31.041184 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:31.041184 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:31.041184 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:31.041184 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:31.041184 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:31.041184 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:31.041184 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:31.041184 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:31.041184 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:31.041184 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:31.041184 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:31.041184 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:31.041184 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:31.042716 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 19:22:31.042716 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 19:22:31.042716 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 19:22:31.042716 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 19:22:31.042716 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 19:22:31.042716 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 19:22:31.042716 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:22:31.042716 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:31.045563 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 366/753] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Jul 1 19:22:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:31.049253 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef95dfa1-12de-4864-b0f0-52e2a6999210 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:31.049503 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:31.054245 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182c81c9-317b-4122-aa52-48589adffea9 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:31.074065 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:31.103636 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92346551-c974-4137-a63d-1c07c086f2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:31.104939 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92346551-c974-4137-a63d-1c07c086f2cb None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:31.105399 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92346551-c974-4137-a63d-1c07c086f2cb None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:31.106276 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92346551-c974-4137-a63d-1c07c086f2cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:31.116106 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92346551-c974-4137-a63d-1c07c086f2cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:31.118627 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92346551-c974-4137-a63d-1c07c086f2cb None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:31.139251 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-92346551-c974-4137-a63d-1c07c086f2cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:22:31.139251 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:31.139251 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:31.139251 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:31.139251 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:31.139251 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:31.139251 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:31.139251 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:31.139251 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:31.139251 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:31.139251 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:31.139251 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:31.139251 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 19:22:31.139251 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 19:22:31.139251 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 19:22:31.140395 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 19:22:31.140395 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:31.140395 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:31.140395 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:31.140395 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:31.140395 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:31.140395 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:31.140395 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:31.140395 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:31.140395 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:31.140395 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:31.140395 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:31.140395 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:31.140395 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:31.140395 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:31.140395 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:31.140395 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:31.141497 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 19:22:31.141497 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 19:22:31.141497 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 19:22:31.141497 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 19:22:31.141497 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 19:22:31.141497 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 19:22:31.141497 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:22:31.141497 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:31.146917 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 388/754] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Jul 1 19:22:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:31.147852 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92346551-c974-4137-a63d-1c07c086f2cb None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:31.180368 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef95dfa1-12de-4864-b0f0-52e2a6999210 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:31.226693 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a102d4-92e5-497e-ab84-58390d374e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:31.227671 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a102d4-92e5-497e-ab84-58390d374e43 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:31.227973 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a102d4-92e5-497e-ab84-58390d374e43 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:31.229114 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a102d4-92e5-497e-ab84-58390d374e43 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:31.239497 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a102d4-92e5-497e-ab84-58390d374e43 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:31.241328 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a102d4-92e5-497e-ab84-58390d374e43 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:31.264149 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92346551-c974-4137-a63d-1c07c086f2cb None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:31.264358 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-15a102d4-92e5-497e-ab84-58390d374e43 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 01 19:22:31.264358 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:31.264358 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:31.264358 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:31.264358 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:31.264358 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:31.264358 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:31.264358 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:31.264358 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:31.264358 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:31.264358 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:31.264358 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:31.264358 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 19:22:31.264358 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 19:22:31.264358 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 19:22:31.264358 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 19:22:31.265584 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:31.265584 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:31.265584 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 19:22:31.265584 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:22:31.265584 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 19:22:31.265584 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:22:31.265584 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:31.265584 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:31.265584 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:31.265584 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:31.265584 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:31.265584 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:31.265584 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:31.265584 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:31.265584 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:31.265584 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:31.265584 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:31.265584 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:31.266540 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:31.266540 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:31.266540 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 19:22:31.266540 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 19:22:31.266540 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 19:22:31.266540 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 19:22:31.266540 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 19:22:31.266540 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 19:22:31.266540 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 01 19:22:31.266540 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:31.266540 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 367/755] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Jul 1 19:22:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:31.267136 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a102d4-92e5-497e-ab84-58390d374e43 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:31.308048 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aa2b22-9500-4b69-b6a6-5b18d3a949a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:31.308714 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa2b22-9500-4b69-b6a6-5b18d3a949a1 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:31.309000 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa2b22-9500-4b69-b6a6-5b18d3a949a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:31.309305 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa2b22-9500-4b69-b6a6-5b18d3a949a1 None admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:31.310731 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aa2b22-9500-4b69-b6a6-5b18d3a949a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:31.311048 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aa2b22-9500-4b69-b6a6-5b18d3a949a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:31.312954 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aa2b22-9500-4b69-b6a6-5b18d3a949a1 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:31.326357 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 389/756] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Jul 1 19:22:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:31.328068 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393b3cc-163f-4c19-867a-780e7beaae04 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:31.328366 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393b3cc-163f-4c19-867a-780e7beaae04 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:31.328813 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393b3cc-163f-4c19-867a-780e7beaae04 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:31.334678 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 390/757] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:22:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:22:31.334678 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8393b3cc-163f-4c19-867a-780e7beaae04 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:31.355144 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:31.364595 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:31.386931 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a102d4-92e5-497e-ab84-58390d374e43 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:31.422932 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d398b9c-b452-440b-930b-f9700fb391ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:31.423504 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d398b9c-b452-440b-930b-f9700fb391ae None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:31.423809 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d398b9c-b452-440b-930b-f9700fb391ae None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:31.424106 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d398b9c-b452-440b-930b-f9700fb391ae None admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:31.424920 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d398b9c-b452-440b-930b-f9700fb391ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:31.425254 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d398b9c-b452-440b-930b-f9700fb391ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:31.427146 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d398b9c-b452-440b-930b-f9700fb391ae None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:31.440920 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 368/758] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Jul 1 19:22:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:31.441872 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d398b9c-b452-440b-930b-f9700fb391ae None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:31.453034 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8393b3cc-163f-4c19-867a-780e7beaae04 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:31.491235 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2391c5f-1f7f-4b19-a749-a7b4f5891970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:31.492031 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2391c5f-1f7f-4b19-a749-a7b4f5891970 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:31.492364 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2391c5f-1f7f-4b19-a749-a7b4f5891970 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:31.492645 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2391c5f-1f7f-4b19-a749-a7b4f5891970 None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:31.493562 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2391c5f-1f7f-4b19-a749-a7b4f5891970 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:31.493877 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2391c5f-1f7f-4b19-a749-a7b4f5891970 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:31.495373 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2391c5f-1f7f-4b19-a749-a7b4f5891970 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:31.521277 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 391/759] 10.222.0.26 () {56 vars in 1135 bytes} [Fri Jul 1 19:22:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:31.521277 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db927ddd-a47d-494a-a0cc-dda5bc0bc51f None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:31.521277 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db927ddd-a47d-494a-a0cc-dda5bc0bc51f None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:31.521277 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db927ddd-a47d-494a-a0cc-dda5bc0bc51f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:31.538663 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-db927ddd-a47d-494a-a0cc-dda5bc0bc51f None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:22:31.539860 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-db927ddd-a47d-494a-a0cc-dda5bc0bc51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:22:31.569843 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d398b9c-b452-440b-930b-f9700fb391ae None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:31.612998 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3b11bb-5e3e-4020-96cc-d37c0b243d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:31.614252 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b11bb-5e3e-4020-96cc-d37c0b243d6d None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:31.614546 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b11bb-5e3e-4020-96cc-d37c0b243d6d None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:31.614827 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b11bb-5e3e-4020-96cc-d37c0b243d6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:31.616141 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3b11bb-5e3e-4020-96cc-d37c0b243d6d None admin] RBAC: Adding query filter params (role.id=35ca0f0b9a964300a63780ec435e730b, scope.project.id=69c523a41f4048cfb7df553b6feb6310, user.id=0834256bdfbc48ffbc5af6d6760ecdd9) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:31.616450 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3b11bb-5e3e-4020-96cc-d37c0b243d6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:31.617924 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3b11bb-5e3e-4020-96cc-d37c0b243d6d None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:31.626687 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 369/760] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Jul 1 19:22:31 2022] GET /identity/v3/role_assignments?user.id=0834256bdfbc48ffbc5af6d6760ecdd9&scope.project.id=69c523a41f4048cfb7df553b6feb6310&role.id=35ca0f0b9a964300a63780ec435e730b => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:31.630207 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3b11bb-5e3e-4020-96cc-d37c0b243d6d None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:31.635650 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:31.671601 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 392/761] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:22:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:22:31.673122 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db927ddd-a47d-494a-a0cc-dda5bc0bc51f None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:31.704212 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:31.783375 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3b11bb-5e3e-4020-96cc-d37c0b243d6d None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:31.824149 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d9e203-5a6f-407f-9274-b3ee0ae533e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:31.825993 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9e203-5a6f-407f-9274-b3ee0ae533e8 None admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:31.826109 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9e203-5a6f-407f-9274-b3ee0ae533e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:31.826388 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9e203-5a6f-407f-9274-b3ee0ae533e8 None admin] PATH_INFO: `/v3/projects/69c523a41f4048cfb7df553b6feb6310/users/13fd76fc7dd1410b9cde5adbaa6cb2e5/roles/6cb03785fb184ef587509b3174622f69` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:31.828482 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d9e203-5a6f-407f-9274-b3ee0ae533e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=69c523a41f4048cfb7df553b6feb6310, user_id=13fd76fc7dd1410b9cde5adbaa6cb2e5, role_id=6cb03785fb184ef587509b3174622f69)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:31.829999 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d9e203-5a6f-407f-9274-b3ee0ae533e8 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:31.834220 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db927ddd-a47d-494a-a0cc-dda5bc0bc51f None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:31.853563 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 370/762] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Jul 1 19:22:31 2022] PUT /identity/v3/projects/69c523a41f4048cfb7df553b6feb6310/users/13fd76fc7dd1410b9cde5adbaa6cb2e5/roles/6cb03785fb184ef587509b3174622f69 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:22:31.854724 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d9e203-5a6f-407f-9274-b3ee0ae533e8 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:31.899043 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9100be0-1a61-44c6-b4be-4fa62d145a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:31.903237 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9100be0-1a61-44c6-b4be-4fa62d145a1f None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:31.903534 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9100be0-1a61-44c6-b4be-4fa62d145a1f None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:31.903822 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9100be0-1a61-44c6-b4be-4fa62d145a1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:31.966869 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:31.989329 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9100be0-1a61-44c6-b4be-4fa62d145a1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:31.991299 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9100be0-1a61-44c6-b4be-4fa62d145a1f None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:32.003958 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:32.009726 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d9e203-5a6f-407f-9274-b3ee0ae533e8 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:32.063129 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29fc211-ce91-4f05-aa28-ec4303417cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:32.063879 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29fc211-ce91-4f05-aa28-ec4303417cb2 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:32.064168 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29fc211-ce91-4f05-aa28-ec4303417cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:32.064450 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29fc211-ce91-4f05-aa28-ec4303417cb2 None admin] PATH_INFO: `/v3/services/network` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:32.065141 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29fc211-ce91-4f05-aa28-ec4303417cb2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:32.066581 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29fc211-ce91-4f05-aa28-ec4303417cb2 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:32.089036 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-a29fc211-ce91-4f05-aa28-ec4303417cb2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 01 19:22:32.089036 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:32.089036 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 19:22:32.089036 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 19:22:32.089036 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 19:22:32.089036 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 19:22:32.089036 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 19:22:32.089036 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:22:32.089036 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 01 19:22:32.089036 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:32.089036 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 19:22:32.089036 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:32.089036 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:32.089036 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:32.089036 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:32.089036 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:32.089036 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:32.090170 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:32.090170 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:32.090170 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:32.090170 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:32.090170 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:32.090170 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:32.090170 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 19:22:32.090170 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 19:22:32.090170 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 19:22:32.090170 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 19:22:32.090170 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:32.090170 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:32.090170 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:32.090170 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:32.090170 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:32.090170 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:32.091047 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:32.091047 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:32.091047 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:32.091047 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:32.091047 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:32.091047 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:32.091047 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:32.091047 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:32.091047 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:32.091047 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:32.091047 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 19:22:32.091047 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:22:32.091047 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 01 19:22:32.091047 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:32.095039 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 371/763] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Jul 1 19:22:31 2022] GET /identity/v3/services/network => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:32.100530 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29fc211-ce91-4f05-aa28-ec4303417cb2 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:32.133935 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 393/764] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Jul 1 19:22:31 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 01 19:22:32.140672 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9100be0-1a61-44c6-b4be-4fa62d145a1f None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:32.234125 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29fc211-ce91-4f05-aa28-ec4303417cb2 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:32.279643 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9100be0-1a61-44c6-b4be-4fa62d145a1f None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:32.290929 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:32.300036 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:32.305567 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ece5f-39bb-4e5d-94a3-676258bbb7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:32.306240 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ece5f-39bb-4e5d-94a3-676258bbb7d7 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:32.306525 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ece5f-39bb-4e5d-94a3-676258bbb7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:32.306803 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ece5f-39bb-4e5d-94a3-676258bbb7d7 None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:32.307515 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236ece5f-39bb-4e5d-94a3-676258bbb7d7 None admin] RBAC: Adding query filter params (name=network) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:32.307822 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236ece5f-39bb-4e5d-94a3-676258bbb7d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:32.309208 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236ece5f-39bb-4e5d-94a3-676258bbb7d7 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:32.317853 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 372/765] 10.222.0.26 () {56 vars in 1112 bytes} [Fri Jul 1 19:22:32 2022] GET /identity/v3/services?name=network => generated 124 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:22:32.329775 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ece5f-39bb-4e5d-94a3-676258bbb7d7 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:32.365044 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d64de-0548-4026-8176-d151a889ac78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:32.367393 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d64de-0548-4026-8176-d151a889ac78 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:32.367675 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d64de-0548-4026-8176-d151a889ac78 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:32.367950 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d64de-0548-4026-8176-d151a889ac78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:32.392237 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0d64de-0548-4026-8176-d151a889ac78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:32.393730 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0d64de-0548-4026-8176-d151a889ac78 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:32.432112 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-db0d64de-0548-4026-8176-d151a889ac78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:32.432112 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:32.432112 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:32.432112 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:32.432112 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:32.432112 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:32.432112 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:32.432112 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:32.432112 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:32.432112 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:32.432112 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:32.432112 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:32.432112 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:22:32.432112 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:22:32.432112 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:22:32.433309 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:22:32.433309 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:32.433309 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:32.433309 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:32.433309 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:32.433309 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:32.433309 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:32.433309 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:32.433309 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:32.433309 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:32.433309 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:32.433309 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:32.433309 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:32.433309 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:32.433309 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:32.433309 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:32.433309 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:32.434255 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:22:32.434255 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:22:32.434255 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:32.434255 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:32.441412 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 394/766] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:22:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:22:32.442370 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d64de-0548-4026-8176-d151a889ac78 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:32.492734 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ece5f-39bb-4e5d-94a3-676258bbb7d7 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:32.532887 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d84e17c-ba1e-4363-b5fd-1df0798ad13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:32.534991 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d84e17c-ba1e-4363-b5fd-1df0798ad13c None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:32.535272 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d84e17c-ba1e-4363-b5fd-1df0798ad13c None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:32.535546 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d84e17c-ba1e-4363-b5fd-1df0798ad13c None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:32.537079 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d84e17c-ba1e-4363-b5fd-1df0798ad13c None admin] RBAC: Adding query filter params (type=network) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:32.537412 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d84e17c-ba1e-4363-b5fd-1df0798ad13c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:32.538811 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d84e17c-ba1e-4363-b5fd-1df0798ad13c None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:32.549837 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 373/767] 10.222.0.26 () {56 vars in 1112 bytes} [Fri Jul 1 19:22:32 2022] GET /identity/v3/services?type=network => generated 350 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:32.556679 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d84e17c-ba1e-4363-b5fd-1df0798ad13c None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:32.615821 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d64de-0548-4026-8176-d151a889ac78 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:32.649427 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:32.652886 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ba750b-d53f-4bee-8edf-84e30ca46051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:32.654116 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba750b-d53f-4bee-8edf-84e30ca46051 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:32.654406 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba750b-d53f-4bee-8edf-84e30ca46051 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:32.654690 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba750b-d53f-4bee-8edf-84e30ca46051 None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:32.655430 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ba750b-d53f-4bee-8edf-84e30ca46051 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:32.655744 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ba750b-d53f-4bee-8edf-84e30ca46051 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:32.657182 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ba750b-d53f-4bee-8edf-84e30ca46051 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:32.670176 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 395/768] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Jul 1 19:22:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:32.671498 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bcfbc6-915d-4dbf-912f-5a9ab69460d7 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:32.671824 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bcfbc6-915d-4dbf-912f-5a9ab69460d7 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:32.672108 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bcfbc6-915d-4dbf-912f-5a9ab69460d7 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:32.673644 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 396/769] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:22:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:22:32.676395 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bcfbc6-915d-4dbf-912f-5a9ab69460d7 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:32.685906 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d84e17c-ba1e-4363-b5fd-1df0798ad13c None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:32.706453 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:32.725359 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181df5d1-0fdc-4bef-a139-a5a8ec4e3a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:32.726336 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181df5d1-0fdc-4bef-a139-a5a8ec4e3a88 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:32.726757 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181df5d1-0fdc-4bef-a139-a5a8ec4e3a88 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:32.727179 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181df5d1-0fdc-4bef-a139-a5a8ec4e3a88 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:32.728112 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181df5d1-0fdc-4bef-a139-a5a8ec4e3a88 None admin] RBAC: Adding query filter params (interface=public, service_id=c80315853abb4b50a616e19ca6b15b27, region_id=RegionOne) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:32.728596 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181df5d1-0fdc-4bef-a139-a5a8ec4e3a88 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:32.730137 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181df5d1-0fdc-4bef-a139-a5a8ec4e3a88 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:32.738860 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 374/770] 10.222.0.26 () {56 vars in 1251 bytes} [Fri Jul 1 19:22:32 2022] GET /identity/v3/endpoints?service_id=c80315853abb4b50a616e19ca6b15b27&interface=public®ion_id=RegionOne => generated 194 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:22:32.740328 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a49c2c-f85c-4e42-a6e6-aeb8337dc568 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:32.740756 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a49c2c-f85c-4e42-a6e6-aeb8337dc568 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:32.741172 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a49c2c-f85c-4e42-a6e6-aeb8337dc568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:32.758939 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-62a49c2c-f85c-4e42-a6e6-aeb8337dc568 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:22:32.760442 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-62a49c2c-f85c-4e42-a6e6-aeb8337dc568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:22:32.818233 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bcfbc6-915d-4dbf-912f-5a9ab69460d7 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:32.849259 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 375/771] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:22:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:22:32.849259 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a49c2c-f85c-4e42-a6e6-aeb8337dc568 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:32.873663 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7ca494-0d0c-4dd8-bdb6-7fcc4b760918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:32.874817 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ca494-0d0c-4dd8-bdb6-7fcc4b760918 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:32.875306 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ca494-0d0c-4dd8-bdb6-7fcc4b760918 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:32.875834 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ca494-0d0c-4dd8-bdb6-7fcc4b760918 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:32.892807 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7ca494-0d0c-4dd8-bdb6-7fcc4b760918 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:32.894917 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7ca494-0d0c-4dd8-bdb6-7fcc4b760918 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:32.905611 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:32.915017 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-fc7ca494-0d0c-4dd8-bdb6-7fcc4b760918 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:22:32.915017 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:32.915017 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:32.915017 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:32.915017 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:32.915017 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:32.915017 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:32.915017 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:32.915017 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:32.915017 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:32.915017 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:32.915017 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:32.915017 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 19:22:32.915017 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 19:22:32.915017 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 19:22:32.915974 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 19:22:32.915974 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:32.915974 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:32.915974 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:32.915974 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:32.915974 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:32.915974 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:32.915974 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:32.915974 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:32.915974 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:32.915974 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:32.915974 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:32.915974 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:32.915974 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:32.915974 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:32.915974 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:32.915974 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:32.916860 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 19:22:32.916860 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 19:22:32.916860 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 19:22:32.916860 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 19:22:32.916860 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 19:22:32.916860 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 19:22:32.916860 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:22:32.916860 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:32.919795 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 397/772] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Jul 1 19:22:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:32.920867 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7ca494-0d0c-4dd8-bdb6-7fcc4b760918 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:32.974588 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a49c2c-f85c-4e42-a6e6-aeb8337dc568 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:33.022585 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:33.025281 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193ac8fe-d852-4c50-8bbe-8077c1d4699f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:33.026039 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ac8fe-d852-4c50-8bbe-8077c1d4699f None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:33.026288 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ac8fe-d852-4c50-8bbe-8077c1d4699f None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:33.026573 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ac8fe-d852-4c50-8bbe-8077c1d4699f None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:33.027950 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193ac8fe-d852-4c50-8bbe-8077c1d4699f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:33.030433 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193ac8fe-d852-4c50-8bbe-8077c1d4699f None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:33.036806 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 376/773] 10.222.0.26 () {56 vars in 1087 bytes} [Fri Jul 1 19:22:32 2022] GET /identity/v3/services => generated 772 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:33.041999 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193ac8fe-d852-4c50-8bbe-8077c1d4699f None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:33.083577 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7ca494-0d0c-4dd8-bdb6-7fcc4b760918 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:33.198328 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3908d7-0008-4c9d-8e5f-a876f3c93080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:33.200212 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3908d7-0008-4c9d-8e5f-a876f3c93080 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:33.201570 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3908d7-0008-4c9d-8e5f-a876f3c93080 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:33.202562 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3908d7-0008-4c9d-8e5f-a876f3c93080 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:33.204310 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3908d7-0008-4c9d-8e5f-a876f3c93080 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:33.207291 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3908d7-0008-4c9d-8e5f-a876f3c93080 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:33.236940 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-6b3908d7-0008-4c9d-8e5f-a876f3c93080 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 01 19:22:33.236940 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:33.236940 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 19:22:33.236940 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 19:22:33.236940 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 19:22:33.236940 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 19:22:33.236940 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 19:22:33.236940 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:22:33.236940 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 01 19:22:33.236940 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:33.236940 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 19:22:33.236940 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:33.236940 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:33.236940 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:33.236940 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:33.236940 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:33.238847 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:33.238847 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:33.238847 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:33.238847 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:33.238847 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:33.238847 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:33.238847 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:33.238847 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 19:22:33.238847 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 19:22:33.238847 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 19:22:33.238847 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 19:22:33.238847 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:33.238847 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:33.238847 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:33.238847 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:33.238847 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:33.240559 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:33.240559 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:33.240559 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:33.240559 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:33.240559 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:33.240559 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:33.240559 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:33.240559 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:33.240559 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:33.240559 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:33.240559 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:33.240559 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 19:22:33.240559 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:22:33.240559 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 01 19:22:33.240559 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:33.245738 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 398/774] 10.222.0.26 () {56 vars in 1129 bytes} [Fri Jul 1 19:22:32 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:33.255819 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3908d7-0008-4c9d-8e5f-a876f3c93080 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:33.273091 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193ac8fe-d852-4c50-8bbe-8077c1d4699f None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:33.307777 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:33.356700 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa1461-6e39-4342-a0ad-30ccacffb3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:33.357758 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa1461-6e39-4342-a0ad-30ccacffb3cf None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:33.358294 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa1461-6e39-4342-a0ad-30ccacffb3cf None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:33.358856 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa1461-6e39-4342-a0ad-30ccacffb3cf None admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:33.361051 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fa1461-6e39-4342-a0ad-30ccacffb3cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:33.362224 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fa1461-6e39-4342-a0ad-30ccacffb3cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:33.364872 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fa1461-6e39-4342-a0ad-30ccacffb3cf None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:33.395293 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 377/775] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Jul 1 19:22:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:33.397902 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa1461-6e39-4342-a0ad-30ccacffb3cf None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:33.477938 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3908d7-0008-4c9d-8e5f-a876f3c93080 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:33.526419 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1002471a-0651-421f-bf7d-6ca8270acc43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:33.527575 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002471a-0651-421f-bf7d-6ca8270acc43 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:33.528097 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002471a-0651-421f-bf7d-6ca8270acc43 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:33.528604 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002471a-0651-421f-bf7d-6ca8270acc43 None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:33.529553 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1002471a-0651-421f-bf7d-6ca8270acc43 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:33.530073 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1002471a-0651-421f-bf7d-6ca8270acc43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:33.531877 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1002471a-0651-421f-bf7d-6ca8270acc43 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:33.537834 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 399/776] 10.222.0.26 () {56 vars in 1124 bytes} [Fri Jul 1 19:22:33 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:33.543619 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1002471a-0651-421f-bf7d-6ca8270acc43 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:33.565376 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:33.569964 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa1461-6e39-4342-a0ad-30ccacffb3cf None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:33.656279 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525890a2-4263-4a94-9005-4f4f16b29578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:33.656942 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525890a2-4263-4a94-9005-4f4f16b29578 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:33.657228 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525890a2-4263-4a94-9005-4f4f16b29578 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:33.657534 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525890a2-4263-4a94-9005-4f4f16b29578 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:33.658371 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525890a2-4263-4a94-9005-4f4f16b29578 None admin] RBAC: Adding query filter params (role.id=6cb03785fb184ef587509b3174622f69, scope.project.id=69c523a41f4048cfb7df553b6feb6310, user.id=e958c5b03a9346d59c32675c5271bf3b) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:33.658686 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525890a2-4263-4a94-9005-4f4f16b29578 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:33.660127 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525890a2-4263-4a94-9005-4f4f16b29578 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:33.666564 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 378/777] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Jul 1 19:22:33 2022] GET /identity/v3/role_assignments?user.id=e958c5b03a9346d59c32675c5271bf3b&scope.project.id=69c523a41f4048cfb7df553b6feb6310&role.id=6cb03785fb184ef587509b3174622f69 => generated 259 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:33.768828 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1002471a-0651-421f-bf7d-6ca8270acc43 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:33.818587 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a577647e-c605-49a3-87fa-a62cfc9cb7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:33.819291 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a577647e-c605-49a3-87fa-a62cfc9cb7d2 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:33.819577 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a577647e-c605-49a3-87fa-a62cfc9cb7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:33.819851 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a577647e-c605-49a3-87fa-a62cfc9cb7d2 None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:33.820598 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a577647e-c605-49a3-87fa-a62cfc9cb7d2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:33.820915 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a577647e-c605-49a3-87fa-a62cfc9cb7d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:33.822359 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a577647e-c605-49a3-87fa-a62cfc9cb7d2 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:33.835448 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 400/778] 10.222.0.26 () {56 vars in 1124 bytes} [Fri Jul 1 19:22:33 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:22:33.841773 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525890a2-4263-4a94-9005-4f4f16b29578 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:33.908610 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:34.008533 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525890a2-4263-4a94-9005-4f4f16b29578 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:34.056384 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f522d54a-10b4-4639-822e-0df456242ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:34.056980 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522d54a-10b4-4639-822e-0df456242ff8 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:34.057280 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522d54a-10b4-4639-822e-0df456242ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:34.057562 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522d54a-10b4-4639-822e-0df456242ff8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:34.058355 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f522d54a-10b4-4639-822e-0df456242ff8 None admin] RBAC: Adding query filter params (interface=public, service_id=93ef10e94c644591a320100f3abc4755, region_id=RegionOne) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:34.058670 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f522d54a-10b4-4639-822e-0df456242ff8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:34.060119 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f522d54a-10b4-4639-822e-0df456242ff8 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:34.065999 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 379/779] 10.222.0.26 () {56 vars in 1251 bytes} [Fri Jul 1 19:22:33 2022] GET /identity/v3/endpoints?service_id=93ef10e94c644591a320100f3abc4755&interface=public®ion_id=RegionOne => generated 194 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:34.078357 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a577647e-c605-49a3-87fa-a62cfc9cb7d2 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:34.178176 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:34.197693 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6720dfb-184d-48d2-88ce-2fc7fcf1de60 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:34.198032 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6720dfb-184d-48d2-88ce-2fc7fcf1de60 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:34.198254 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6720dfb-184d-48d2-88ce-2fc7fcf1de60 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:34.199629 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 380/780] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:22:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:22:34.209076 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d16a69-e3ce-483f-89aa-a226142722bd None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:34.209404 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d16a69-e3ce-483f-89aa-a226142722bd None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:34.209682 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d16a69-e3ce-483f-89aa-a226142722bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:34.233251 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-66d16a69-e3ce-483f-89aa-a226142722bd None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:22:34.234446 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-66d16a69-e3ce-483f-89aa-a226142722bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:22:34.249161 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a577647e-c605-49a3-87fa-a62cfc9cb7d2 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:34.320051 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f355cf9-1def-42db-b209-a43a3bca5eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:34.321094 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f355cf9-1def-42db-b209-a43a3bca5eb0 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:34.321613 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f355cf9-1def-42db-b209-a43a3bca5eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:34.322090 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f355cf9-1def-42db-b209-a43a3bca5eb0 None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:34.322999 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f355cf9-1def-42db-b209-a43a3bca5eb0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:34.324579 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f355cf9-1def-42db-b209-a43a3bca5eb0 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:34.336088 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 401/781] 10.222.0.26 () {56 vars in 1087 bytes} [Fri Jul 1 19:22:34 2022] GET /identity/v3/services => generated 772 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:34.361422 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 381/782] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:22:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 01 19:22:34.388842 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f355cf9-1def-42db-b209-a43a3bca5eb0 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:34.413465 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d653b8-60f5-4b48-9369-cbe78b6402ba None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:34.413900 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d653b8-60f5-4b48-9369-cbe78b6402ba None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:34.414165 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d653b8-60f5-4b48-9369-cbe78b6402ba None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:34.415925 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 382/783] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:22:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:22:34.421809 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4698584-37ec-48ab-9c0d-116bf740df42 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:34.422170 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4698584-37ec-48ab-9c0d-116bf740df42 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:34.422448 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4698584-37ec-48ab-9c0d-116bf740df42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:34.443403 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-e4698584-37ec-48ab-9c0d-116bf740df42 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:22:34.445078 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-e4698584-37ec-48ab-9c0d-116bf740df42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:22:34.485602 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:34.568005 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 383/784] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:22:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 01 19:22:34.592435 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4698584-37ec-48ab-9c0d-116bf740df42 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:34.593875 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f355cf9-1def-42db-b209-a43a3bca5eb0 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:34.641258 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95939b6-dc9e-4b91-a318-af4b6752dee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:34.641258 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95939b6-dc9e-4b91-a318-af4b6752dee2 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:34.641258 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95939b6-dc9e-4b91-a318-af4b6752dee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:34.641258 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95939b6-dc9e-4b91-a318-af4b6752dee2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:34.644490 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:34.654917 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95939b6-dc9e-4b91-a318-af4b6752dee2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:22:34.663632 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-c95939b6-dc9e-4b91-a318-af4b6752dee2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:22:34.663632 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:34.663632 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:34.663632 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:34.663632 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:34.663632 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:34.663632 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:34.663632 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:34.663632 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:34.663632 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:34.663632 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:34.663632 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:34.663632 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:22:34.663632 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:22:34.663632 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:22:34.663632 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:22:34.664567 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:22:34.664567 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:22:34.664567 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:22:34.664567 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:22:34.664567 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:34.664567 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:34.664567 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:34.664567 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:34.664567 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:34.664567 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:34.664567 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:34.664567 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:34.664567 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:34.664567 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:34.664567 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:34.664567 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:34.665448 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:34.665448 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:34.665448 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:34.665448 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:34.665448 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:22:34.665448 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:22:34.665448 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:22:34.665448 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:22:34.665448 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:22:34.665448 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:22:34.665448 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:22:34.665448 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:34.665448 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 402/785] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Jul 1 19:22:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:34.671778 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95939b6-dc9e-4b91-a318-af4b6752dee2 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:34.733661 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4698584-37ec-48ab-9c0d-116bf740df42 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:34.804834 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9549d992-4dfc-4b21-b8ee-9fd6c4b46b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:34.805820 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9549d992-4dfc-4b21-b8ee-9fd6c4b46b82 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:34.806107 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9549d992-4dfc-4b21-b8ee-9fd6c4b46b82 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:34.806384 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9549d992-4dfc-4b21-b8ee-9fd6c4b46b82 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:34.829895 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9549d992-4dfc-4b21-b8ee-9fd6c4b46b82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:22:34.841725 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-9549d992-4dfc-4b21-b8ee-9fd6c4b46b82 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:22:34.841725 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:34.841725 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:34.841725 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:34.841725 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:34.841725 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:34.841725 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:34.841725 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:34.841725 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:34.841725 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:34.841725 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:34.841725 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:34.841725 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:22:34.841725 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:22:34.841725 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:22:34.841725 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:22:34.842740 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:22:34.842740 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:22:34.842740 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:22:34.842740 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:22:34.842740 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:34.842740 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:34.842740 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:34.842740 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:34.842740 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:34.842740 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:34.842740 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:34.842740 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:34.842740 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:34.842740 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:34.842740 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:34.842740 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:34.843620 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:34.843620 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:34.843620 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:34.843620 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:34.843620 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:22:34.843620 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:22:34.843620 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:22:34.843620 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:22:34.843620 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:22:34.843620 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:22:34.843620 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:22:34.843620 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:34.847606 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 384/786] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Jul 1 19:22:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:34.848765 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9549d992-4dfc-4b21-b8ee-9fd6c4b46b82 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:34.857141 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95939b6-dc9e-4b91-a318-af4b6752dee2 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:34.899142 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:34.925716 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe6e834-eaf1-4ee8-9ae5-3dc2022888fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:34.926460 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe6e834-eaf1-4ee8-9ae5-3dc2022888fd None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:34.926750 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe6e834-eaf1-4ee8-9ae5-3dc2022888fd None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:34.927082 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe6e834-eaf1-4ee8-9ae5-3dc2022888fd None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:34.928089 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe6e834-eaf1-4ee8-9ae5-3dc2022888fd None admin] RBAC: Adding query filter params (name=service) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:34.928412 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe6e834-eaf1-4ee8-9ae5-3dc2022888fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:34.933583 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe6e834-eaf1-4ee8-9ae5-3dc2022888fd None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:34.953276 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 403/787] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Jul 1 19:22:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:34.958724 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe6e834-eaf1-4ee8-9ae5-3dc2022888fd None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:35.052074 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9549d992-4dfc-4b21-b8ee-9fd6c4b46b82 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:35.085644 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:35.124059 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426543f7-f0c8-4a1a-ba92-b94cde47fbf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:35.124743 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426543f7-f0c8-4a1a-ba92-b94cde47fbf2 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:35.125028 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426543f7-f0c8-4a1a-ba92-b94cde47fbf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:35.125333 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426543f7-f0c8-4a1a-ba92-b94cde47fbf2 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:35.126090 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426543f7-f0c8-4a1a-ba92-b94cde47fbf2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:35.126402 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426543f7-f0c8-4a1a-ba92-b94cde47fbf2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:35.127795 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426543f7-f0c8-4a1a-ba92-b94cde47fbf2 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:35.147046 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 385/788] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Jul 1 19:22:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:35.154598 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426543f7-f0c8-4a1a-ba92-b94cde47fbf2 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:35.175405 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe6e834-eaf1-4ee8-9ae5-3dc2022888fd None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:35.235393 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ed5826-1400-46ef-aba0-05639d6bc7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:35.236208 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed5826-1400-46ef-aba0-05639d6bc7a7 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:35.236562 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed5826-1400-46ef-aba0-05639d6bc7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:35.236893 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed5826-1400-46ef-aba0-05639d6bc7a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:35.261726 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ed5826-1400-46ef-aba0-05639d6bc7a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:35.263235 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ed5826-1400-46ef-aba0-05639d6bc7a7 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:35.280997 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:35.295759 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-84ed5826-1400-46ef-aba0-05639d6bc7a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:35.295759 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:35.295759 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:35.295759 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:35.295759 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:35.295759 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:35.295759 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:35.295759 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:35.295759 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:35.295759 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:35.295759 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:35.295759 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:35.295759 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:22:35.295759 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:22:35.295759 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:22:35.298009 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:22:35.298009 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:35.298009 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:35.298009 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:35.298009 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:35.298009 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:35.298009 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:35.298009 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:35.298009 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:35.298009 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:35.298009 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:35.298009 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:35.298009 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:35.298009 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:35.298009 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:35.298009 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:35.298009 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:35.300249 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:22:35.300249 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:22:35.300249 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:35.300249 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:35.300249 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 404/789] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:22:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:35.306282 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ed5826-1400-46ef-aba0-05639d6bc7a7 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:35.326750 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426543f7-f0c8-4a1a-ba92-b94cde47fbf2 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:35.429213 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf5300b-b5c5-4a6e-b1de-d0ab475ad359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:35.430850 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf5300b-b5c5-4a6e-b1de-d0ab475ad359 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:35.430850 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf5300b-b5c5-4a6e-b1de-d0ab475ad359 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:35.430850 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf5300b-b5c5-4a6e-b1de-d0ab475ad359 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:35.456009 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf5300b-b5c5-4a6e-b1de-d0ab475ad359 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:35.457093 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ed5826-1400-46ef-aba0-05639d6bc7a7 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:35.457578 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf5300b-b5c5-4a6e-b1de-d0ab475ad359 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:35.469559 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:35.478129 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-7cf5300b-b5c5-4a6e-b1de-d0ab475ad359 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:35.478129 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:35.478129 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:35.478129 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:35.478129 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:35.478129 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:35.478129 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:35.478129 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:35.478129 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:35.478129 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:35.478129 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:35.478129 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:35.478129 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:22:35.478129 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:22:35.478129 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:22:35.479208 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:22:35.479208 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:35.479208 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:35.479208 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:35.479208 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:35.479208 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:35.479208 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:35.479208 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:35.479208 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:35.479208 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:35.479208 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:35.479208 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:35.479208 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:35.479208 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:35.479208 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:35.479208 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:35.479208 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:35.480094 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:22:35.480094 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:22:35.480094 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:35.480094 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:35.480840 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 386/790] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:22:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:35.482767 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36550ca4-5b26-4e3b-b6d8-bad5ae1d92df None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:35.483059 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36550ca4-5b26-4e3b-b6d8-bad5ae1d92df None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:35.483337 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36550ca4-5b26-4e3b-b6d8-bad5ae1d92df None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:35.488724 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 387/791] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:22:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:22:35.489625 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36550ca4-5b26-4e3b-b6d8-bad5ae1d92df None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:35.503001 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8870019b-d0ba-45d9-bdef-d6e9f406800c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:35.504185 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870019b-d0ba-45d9-bdef-d6e9f406800c None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:35.504931 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870019b-d0ba-45d9-bdef-d6e9f406800c None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:35.505551 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870019b-d0ba-45d9-bdef-d6e9f406800c None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:35.506514 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8870019b-d0ba-45d9-bdef-d6e9f406800c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:35.507025 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8870019b-d0ba-45d9-bdef-d6e9f406800c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:35.508595 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8870019b-d0ba-45d9-bdef-d6e9f406800c None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:35.525986 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 405/792] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Jul 1 19:22:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:35.526879 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c705b0d4-f3d6-40cf-9cdd-219e5d309760 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:35.527009 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c705b0d4-f3d6-40cf-9cdd-219e5d309760 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:35.527270 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c705b0d4-f3d6-40cf-9cdd-219e5d309760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:35.548358 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-c705b0d4-f3d6-40cf-9cdd-219e5d309760 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:22:35.549827 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-c705b0d4-f3d6-40cf-9cdd-219e5d309760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:22:35.621040 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36550ca4-5b26-4e3b-b6d8-bad5ae1d92df None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:35.650707 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 406/793] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:22:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:22:35.651651 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c705b0d4-f3d6-40cf-9cdd-219e5d309760 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:35.693728 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48160d16-e379-426c-8631-e817be8c7650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:35.694333 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48160d16-e379-426c-8631-e817be8c7650 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:35.694621 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48160d16-e379-426c-8631-e817be8c7650 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:35.694895 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48160d16-e379-426c-8631-e817be8c7650 None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:35.696456 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48160d16-e379-426c-8631-e817be8c7650 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:35.696456 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48160d16-e379-426c-8631-e817be8c7650 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:35.697667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48160d16-e379-426c-8631-e817be8c7650 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:35.701809 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:35.724373 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 388/794] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Jul 1 19:22:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:35.725906 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48160d16-e379-426c-8631-e817be8c7650 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:35.811225 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:35.816484 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c705b0d4-f3d6-40cf-9cdd-219e5d309760 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:35.845158 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48160d16-e379-426c-8631-e817be8c7650 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:35.864962 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcebae5-45d6-4ac9-99cf-18b8ede918fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:35.866177 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcebae5-45d6-4ac9-99cf-18b8ede918fd None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:35.866666 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcebae5-45d6-4ac9-99cf-18b8ede918fd None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:35.867154 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcebae5-45d6-4ac9-99cf-18b8ede918fd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:35.878182 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcebae5-45d6-4ac9-99cf-18b8ede918fd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:35.880234 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcebae5-45d6-4ac9-99cf-18b8ede918fd None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:35.884166 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf702c2-a33c-4da8-aeea-34b483972174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:35.885310 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf702c2-a33c-4da8-aeea-34b483972174 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:35.885743 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf702c2-a33c-4da8-aeea-34b483972174 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:35.886183 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf702c2-a33c-4da8-aeea-34b483972174 None admin] PATH_INFO: `/v3/services/network` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:35.886983 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf702c2-a33c-4da8-aeea-34b483972174 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:35.889043 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf702c2-a33c-4da8-aeea-34b483972174 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:35.901667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-5bf702c2-a33c-4da8-aeea-34b483972174 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 01 19:22:35.901667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:35.901667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 19:22:35.901667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 19:22:35.901667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 19:22:35.901667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 19:22:35.901667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 19:22:35.901667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:22:35.901667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 01 19:22:35.901667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:35.901667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 19:22:35.901667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:35.901667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:35.901667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:35.901667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:35.901667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:35.901667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:35.902894 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:35.902894 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:35.902894 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:35.902894 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:35.902894 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:35.902894 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:35.902894 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 19:22:35.902894 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 19:22:35.902894 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 19:22:35.902894 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 19:22:35.902894 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:35.902894 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:35.902894 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:35.902894 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:35.902894 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:35.902894 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:35.904501 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:35.904501 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:35.904501 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:35.904501 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:35.904501 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:35.904501 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:35.904501 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:35.904501 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:35.904501 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:35.904501 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:35.904501 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 19:22:35.904501 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:22:35.904501 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 01 19:22:35.904501 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:35.906815 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 389/795] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Jul 1 19:22:35 2022] GET /identity/v3/services/network => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:35.906936 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-9dcebae5-45d6-4ac9-99cf-18b8ede918fd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 01 19:22:35.906936 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:35.906936 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:35.906936 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:35.906936 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:35.906936 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:35.906936 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:35.906936 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:35.906936 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:35.906936 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:35.906936 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:35.906936 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:35.906936 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 19:22:35.906936 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 19:22:35.906936 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 19:22:35.906936 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 19:22:35.907802 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:35.907802 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:35.907802 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 19:22:35.907802 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:22:35.907802 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 19:22:35.907802 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:22:35.907802 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:35.907802 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:35.907802 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:35.907802 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:35.907802 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:35.907802 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:35.907802 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:35.907802 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:35.907802 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:35.907802 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:35.907802 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:35.907802 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:35.908727 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:35.908727 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:35.908727 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 19:22:35.908727 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 19:22:35.908727 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 19:22:35.908727 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 19:22:35.908727 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 19:22:35.908727 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 19:22:35.908727 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 01 19:22:35.908727 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:35.920379 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 407/796] 10.222.0.26 () {56 vars in 1117 bytes} [Fri Jul 1 19:22:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:35.920379 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcebae5-45d6-4ac9-99cf-18b8ede918fd None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:35.924724 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf702c2-a33c-4da8-aeea-34b483972174 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:36.000840 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:36.048915 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf702c2-a33c-4da8-aeea-34b483972174 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:36.049688 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcebae5-45d6-4ac9-99cf-18b8ede918fd None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:36.087505 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15420017-2cf7-41c9-b75e-072be051b772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:36.088713 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15420017-2cf7-41c9-b75e-072be051b772 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:36.089182 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15420017-2cf7-41c9-b75e-072be051b772 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:36.089767 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15420017-2cf7-41c9-b75e-072be051b772 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:36.099475 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15420017-2cf7-41c9-b75e-072be051b772 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:36.101184 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15420017-2cf7-41c9-b75e-072be051b772 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:36.101668 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f5d754-0d02-4c90-91f7-166cfacfb062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:36.102976 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f5d754-0d02-4c90-91f7-166cfacfb062 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:36.103373 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f5d754-0d02-4c90-91f7-166cfacfb062 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:36.103867 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f5d754-0d02-4c90-91f7-166cfacfb062 None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:36.105563 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f5d754-0d02-4c90-91f7-166cfacfb062 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:36.106002 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f5d754-0d02-4c90-91f7-166cfacfb062 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:36.108713 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f5d754-0d02-4c90-91f7-166cfacfb062 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:36.118745 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-15420017-2cf7-41c9-b75e-072be051b772 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 01 19:22:36.118745 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:36.118745 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:36.118745 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:36.118745 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:36.118745 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:36.118745 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:36.118745 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:36.118745 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:36.118745 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:36.118745 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:36.118745 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:36.118745 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 19:22:36.118745 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 19:22:36.118745 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 19:22:36.118745 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 19:22:36.119714 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:36.119714 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:36.119714 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 19:22:36.119714 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:22:36.119714 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 19:22:36.119714 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:22:36.119714 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:36.119714 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:36.119714 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:36.119714 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:36.119714 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:36.119714 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:36.119714 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:36.119714 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:36.119714 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:36.119714 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:36.119714 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:36.119714 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:36.120648 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:36.120648 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:36.120648 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 19:22:36.120648 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 19:22:36.120648 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 19:22:36.120648 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 19:22:36.120648 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 19:22:36.120648 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 19:22:36.120648 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 01 19:22:36.120648 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:36.123416 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 390/797] 10.222.0.26 () {56 vars in 1093 bytes} [Fri Jul 1 19:22:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:36.124419 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15420017-2cf7-41c9-b75e-072be051b772 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:36.141103 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 408/798] 10.222.0.26 () {56 vars in 1149 bytes} [Fri Jul 1 19:22:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:22:36.142522 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f5d754-0d02-4c90-91f7-166cfacfb062 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:36.170139 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:36.243032 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15420017-2cf7-41c9-b75e-072be051b772 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:36.267767 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:36.283554 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb54ade0-eec2-48bf-9eda-bca5e1e510fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:36.284217 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54ade0-eec2-48bf-9eda-bca5e1e510fe None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:36.284500 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54ade0-eec2-48bf-9eda-bca5e1e510fe None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:36.284859 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54ade0-eec2-48bf-9eda-bca5e1e510fe None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:36.285499 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb54ade0-eec2-48bf-9eda-bca5e1e510fe None admin] RBAC: Adding query filter params (name=network) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:36.285807 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb54ade0-eec2-48bf-9eda-bca5e1e510fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:36.287030 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f5d754-0d02-4c90-91f7-166cfacfb062 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:36.287328 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb54ade0-eec2-48bf-9eda-bca5e1e510fe None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:36.292566 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 391/799] 10.222.0.26 () {56 vars in 1112 bytes} [Fri Jul 1 19:22:36 2022] GET /identity/v3/services?name=network => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:36.294246 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb54ade0-eec2-48bf-9eda-bca5e1e510fe None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:36.331252 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124c60cf-4e71-4cd3-9357-314473d7974b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:36.331936 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c60cf-4e71-4cd3-9357-314473d7974b None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:36.332225 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c60cf-4e71-4cd3-9357-314473d7974b None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:36.332564 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c60cf-4e71-4cd3-9357-314473d7974b None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:36.333452 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124c60cf-4e71-4cd3-9357-314473d7974b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:36.333762 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124c60cf-4e71-4cd3-9357-314473d7974b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:36.335242 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124c60cf-4e71-4cd3-9357-314473d7974b None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:36.355599 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 409/800] 10.222.0.26 () {56 vars in 1133 bytes} [Fri Jul 1 19:22:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:36.357089 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d91303-2ee9-406d-96a3-9a5b55d4a4d2 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:36.357427 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d91303-2ee9-406d-96a3-9a5b55d4a4d2 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:36.357749 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d91303-2ee9-406d-96a3-9a5b55d4a4d2 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:36.363466 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 410/801] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:22:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:22:36.363466 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d91303-2ee9-406d-96a3-9a5b55d4a4d2 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:36.425602 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb54ade0-eec2-48bf-9eda-bca5e1e510fe None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:36.445177 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:36.465542 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb568d72-8fb1-4a96-a179-62c256271f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:36.466394 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb568d72-8fb1-4a96-a179-62c256271f9f None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:36.466682 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb568d72-8fb1-4a96-a179-62c256271f9f None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:36.467117 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb568d72-8fb1-4a96-a179-62c256271f9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:36.470619 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d91303-2ee9-406d-96a3-9a5b55d4a4d2 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:36.477921 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb568d72-8fb1-4a96-a179-62c256271f9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:36.479397 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb568d72-8fb1-4a96-a179-62c256271f9f None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:36.498246 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-fb568d72-8fb1-4a96-a179-62c256271f9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:36.498246 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:36.498246 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:36.498246 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:36.498246 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:36.498246 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:36.498246 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:36.498246 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:36.498246 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:36.498246 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:36.498246 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:36.498246 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:36.498246 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:22:36.498246 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:22:36.498246 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:22:36.499183 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:22:36.499183 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:36.499183 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:36.499183 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:36.499183 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:36.499183 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:36.499183 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:36.499183 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:36.499183 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:36.499183 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:36.499183 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:36.499183 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:36.499183 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:36.499183 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:36.499183 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:36.499183 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:36.499183 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:36.500067 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:22:36.500067 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:22:36.500067 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:36.500067 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:36.500067 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 392/802] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:22:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:36.500364 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb568d72-8fb1-4a96-a179-62c256271f9f None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:36.512862 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb92aa96-25ad-4cc1-a8cd-3862b03df206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:36.513573 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92aa96-25ad-4cc1-a8cd-3862b03df206 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:36.513863 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92aa96-25ad-4cc1-a8cd-3862b03df206 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:36.514137 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92aa96-25ad-4cc1-a8cd-3862b03df206 None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:36.514850 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb92aa96-25ad-4cc1-a8cd-3862b03df206 None admin] RBAC: Adding query filter params (type=network) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:36.515157 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb92aa96-25ad-4cc1-a8cd-3862b03df206 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:36.516516 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb92aa96-25ad-4cc1-a8cd-3862b03df206 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:36.526289 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 411/803] 10.222.0.26 () {56 vars in 1112 bytes} [Fri Jul 1 19:22:36 2022] GET /identity/v3/services?type=network => generated 350 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:36.526289 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec6f76-85e3-4b12-ad71-95f9d5b70855 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:36.526289 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec6f76-85e3-4b12-ad71-95f9d5b70855 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:36.526289 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec6f76-85e3-4b12-ad71-95f9d5b70855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:36.539596 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-14ec6f76-85e3-4b12-ad71-95f9d5b70855 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:22:36.540775 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-14ec6f76-85e3-4b12-ad71-95f9d5b70855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:22:36.548173 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:36.611122 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 412/804] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:22:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:22:36.612468 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ec6f76-85e3-4b12-ad71-95f9d5b70855 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:36.636557 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb568d72-8fb1-4a96-a179-62c256271f9f None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:36.675245 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc2cfda-ad84-4e7f-bded-7cee4092163c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:36.675896 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc2cfda-ad84-4e7f-bded-7cee4092163c None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:36.676174 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc2cfda-ad84-4e7f-bded-7cee4092163c None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:36.676453 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc2cfda-ad84-4e7f-bded-7cee4092163c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:36.703125 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:36.739447 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ec6f76-85e3-4b12-ad71-95f9d5b70855 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:36.745608 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc2cfda-ad84-4e7f-bded-7cee4092163c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:36.747110 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc2cfda-ad84-4e7f-bded-7cee4092163c None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:36.775306 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881417e9-027f-419b-a699-a254089d407b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:36.775979 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881417e9-027f-419b-a699-a254089d407b None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:36.776274 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881417e9-027f-419b-a699-a254089d407b None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:36.776598 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881417e9-027f-419b-a699-a254089d407b None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:36.777296 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881417e9-027f-419b-a699-a254089d407b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:36.777613 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881417e9-027f-419b-a699-a254089d407b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:36.779021 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881417e9-027f-419b-a699-a254089d407b None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:36.780867 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:36.791170 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 413/805] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Jul 1 19:22:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:36.791975 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881417e9-027f-419b-a699-a254089d407b None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:36.848144 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 393/806] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Jul 1 19:22:36 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 01 19:22:36.848983 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc2cfda-ad84-4e7f-bded-7cee4092163c None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:36.906449 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881417e9-027f-419b-a699-a254089d407b None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:36.935149 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:36.940987 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd3aa05-14a0-463c-8da0-e1d8e3032d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:36.941682 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3aa05-14a0-463c-8da0-e1d8e3032d53 None admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:36.941970 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3aa05-14a0-463c-8da0-e1d8e3032d53 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:36.942244 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3aa05-14a0-463c-8da0-e1d8e3032d53 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:36.942977 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd3aa05-14a0-463c-8da0-e1d8e3032d53 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:36.944331 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd3aa05-14a0-463c-8da0-e1d8e3032d53 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:36.948392 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc2cfda-ad84-4e7f-bded-7cee4092163c None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:36.964114 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 414/807] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Jul 1 19:22:36 2022] POST /identity/v3/endpoints => generated 327 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:22:36.974144 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059ca8f-f193-4b3d-8427-43aeea80f953 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:36.974144 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059ca8f-f193-4b3d-8427-43aeea80f953 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:36.974144 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059ca8f-f193-4b3d-8427-43aeea80f953 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:36.974144 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 415/808] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:22:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:22:36.974144 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7059ca8f-f193-4b3d-8427-43aeea80f953 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:37.000540 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:37.007523 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdbd511-1051-4272-9f65-8e50dad62263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:37.008932 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdbd511-1051-4272-9f65-8e50dad62263 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:37.009824 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdbd511-1051-4272-9f65-8e50dad62263 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:37.010546 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdbd511-1051-4272-9f65-8e50dad62263 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:37.024253 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdbd511-1051-4272-9f65-8e50dad62263 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:22:37.032954 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-5fdbd511-1051-4272-9f65-8e50dad62263 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:22:37.032954 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:37.032954 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:37.032954 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:37.032954 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:37.032954 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:37.032954 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:37.032954 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:37.032954 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:37.032954 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:37.032954 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:37.032954 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:37.032954 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:22:37.032954 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:22:37.032954 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:22:37.032954 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:22:37.033995 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:22:37.033995 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:22:37.033995 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:22:37.033995 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:22:37.033995 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:37.033995 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:37.033995 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:37.033995 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:37.033995 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:37.033995 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:37.033995 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:37.033995 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:37.033995 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:37.033995 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:37.033995 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:37.033995 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:37.034896 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:37.034896 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:37.034896 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:37.034896 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:37.034896 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:22:37.034896 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:22:37.034896 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:22:37.034896 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:22:37.034896 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:22:37.034896 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:22:37.034896 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:22:37.034896 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:37.039499 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 394/809] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Jul 1 19:22:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:37.040500 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdbd511-1051-4272-9f65-8e50dad62263 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:37.102800 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7059ca8f-f193-4b3d-8427-43aeea80f953 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:37.148087 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319b15dc-4291-4409-b77a-0945633a2d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:37.148888 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b15dc-4291-4409-b77a-0945633a2d5d None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:37.149171 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b15dc-4291-4409-b77a-0945633a2d5d None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:37.149506 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b15dc-4291-4409-b77a-0945633a2d5d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:37.158008 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319b15dc-4291-4409-b77a-0945633a2d5d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:37.159468 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319b15dc-4291-4409-b77a-0945633a2d5d None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:37.160807 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdbd511-1051-4272-9f65-8e50dad62263 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:37.174717 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-319b15dc-4291-4409-b77a-0945633a2d5d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:22:37.174717 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:37.174717 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:37.174717 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:37.174717 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:37.174717 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:37.174717 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:37.174717 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:37.174717 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:37.174717 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:37.174717 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:37.174717 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:37.174717 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 19:22:37.174717 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 19:22:37.174717 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 19:22:37.175833 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 19:22:37.175833 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:37.175833 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:37.175833 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:37.175833 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:37.175833 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:37.175833 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:37.175833 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:37.175833 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:37.175833 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:37.175833 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:37.175833 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:37.175833 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:37.175833 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:37.175833 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:37.175833 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:37.175833 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:37.176848 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 19:22:37.176848 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 19:22:37.176848 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 19:22:37.176848 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 19:22:37.176848 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 19:22:37.176848 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 19:22:37.176848 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:22:37.176848 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:37.176848 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 416/810] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Jul 1 19:22:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:37.177545 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f67a6-648f-46c8-8d15-87260c2cd0b0 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:37.177629 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f67a6-648f-46c8-8d15-87260c2cd0b0 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:37.178173 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f67a6-648f-46c8-8d15-87260c2cd0b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:37.196434 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-155f67a6-648f-46c8-8d15-87260c2cd0b0 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:22:37.197991 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-155f67a6-648f-46c8-8d15-87260c2cd0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:22:37.204153 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e999666-6e28-43d7-8156-78c3cb878e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:37.204944 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e999666-6e28-43d7-8156-78c3cb878e65 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:37.205228 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e999666-6e28-43d7-8156-78c3cb878e65 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:37.205578 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e999666-6e28-43d7-8156-78c3cb878e65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:37.217875 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e999666-6e28-43d7-8156-78c3cb878e65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:37.219552 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e999666-6e28-43d7-8156-78c3cb878e65 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:37.236990 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-5e999666-6e28-43d7-8156-78c3cb878e65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:37.236990 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:37.236990 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:37.236990 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:37.236990 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:37.236990 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:37.236990 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:37.236990 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:37.236990 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:37.236990 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:37.236990 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:37.236990 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:37.236990 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:22:37.236990 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:22:37.236990 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:22:37.238598 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:22:37.238598 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:37.238598 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:37.238598 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:37.238598 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:37.238598 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:37.238598 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:37.238598 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:37.238598 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:37.238598 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:37.238598 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:37.238598 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:37.238598 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:37.238598 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:37.238598 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:37.238598 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:37.238598 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:37.240067 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:22:37.240067 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:22:37.240067 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:37.240067 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:37.240067 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 395/811] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:22:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:37.240067 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e999666-6e28-43d7-8156-78c3cb878e65 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:37.244044 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:37.272250 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 417/812] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:22:37 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:22:37.273091 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f67a6-648f-46c8-8d15-87260c2cd0b0 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:37.289761 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:37.348699 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e999666-6e28-43d7-8156-78c3cb878e65 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:37.379823 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f67a6-648f-46c8-8d15-87260c2cd0b0 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:37.385355 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d84da4-0fa4-4141-8308-03e145297d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:37.386042 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d84da4-0fa4-4141-8308-03e145297d66 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:37.386326 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d84da4-0fa4-4141-8308-03e145297d66 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:37.386601 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d84da4-0fa4-4141-8308-03e145297d66 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:37.387357 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d84da4-0fa4-4141-8308-03e145297d66 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:37.387673 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d84da4-0fa4-4141-8308-03e145297d66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:37.389072 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d84da4-0fa4-4141-8308-03e145297d66 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:37.401265 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 396/813] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Jul 1 19:22:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:37.401265 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d84da4-0fa4-4141-8308-03e145297d66 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:37.422320 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5524af4a-86f5-425c-b095-b8bc5b3238e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:37.423148 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5524af4a-86f5-425c-b095-b8bc5b3238e2 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:37.423421 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5524af4a-86f5-425c-b095-b8bc5b3238e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:37.426779 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5524af4a-86f5-425c-b095-b8bc5b3238e2 None admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:37.426779 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5524af4a-86f5-425c-b095-b8bc5b3238e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:37.426779 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5524af4a-86f5-425c-b095-b8bc5b3238e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:37.426779 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5524af4a-86f5-425c-b095-b8bc5b3238e2 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:37.440002 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 418/814] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Jul 1 19:22:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:37.440874 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5524af4a-86f5-425c-b095-b8bc5b3238e2 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:37.476357 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:37.523993 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d84da4-0fa4-4141-8308-03e145297d66 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:37.531528 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:37.547999 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5524af4a-86f5-425c-b095-b8bc5b3238e2 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:37.571625 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f86f8e0-460b-411d-b0b4-e7ce918e4a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:37.572301 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f86f8e0-460b-411d-b0b4-e7ce918e4a74 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:37.572582 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f86f8e0-460b-411d-b0b4-e7ce918e4a74 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:37.572856 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f86f8e0-460b-411d-b0b4-e7ce918e4a74 None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:37.573612 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f86f8e0-460b-411d-b0b4-e7ce918e4a74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:37.573924 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f86f8e0-460b-411d-b0b4-e7ce918e4a74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:37.575325 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f86f8e0-460b-411d-b0b4-e7ce918e4a74 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:37.584047 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe950b3-6cb6-4499-9ece-455faafafd86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:37.584860 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe950b3-6cb6-4499-9ece-455faafafd86 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:37.585141 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe950b3-6cb6-4499-9ece-455faafafd86 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:37.585445 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe950b3-6cb6-4499-9ece-455faafafd86 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:37.586108 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe950b3-6cb6-4499-9ece-455faafafd86 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:37.587492 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe950b3-6cb6-4499-9ece-455faafafd86 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:37.587628 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 397/815] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Jul 1 19:22:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:37.589001 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f86f8e0-460b-411d-b0b4-e7ce918e4a74 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:37.607063 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-0fe950b3-6cb6-4499-9ece-455faafafd86 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 01 19:22:37.607063 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:37.607063 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 19:22:37.607063 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 19:22:37.607063 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 19:22:37.607063 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 19:22:37.607063 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 19:22:37.607063 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:22:37.607063 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 01 19:22:37.607063 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:37.607063 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 19:22:37.607063 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:37.607063 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:37.607063 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:37.607063 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:37.607063 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:37.608199 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:37.608199 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:37.608199 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:37.608199 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:37.608199 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:37.608199 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:37.608199 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:37.608199 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 19:22:37.608199 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 19:22:37.608199 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 19:22:37.608199 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 19:22:37.608199 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:37.608199 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:37.608199 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:37.608199 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:37.608199 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:37.614089 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:37.614089 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:37.614089 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:37.614089 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:37.614089 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:37.614089 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:37.614089 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:37.614089 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:37.614089 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:37.614089 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:37.614089 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:37.614089 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 19:22:37.614089 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:22:37.614089 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 01 19:22:37.614089 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:37.614089 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 419/816] 10.222.0.26 () {56 vars in 1129 bytes} [Fri Jul 1 19:22:37 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:37.614957 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe950b3-6cb6-4499-9ece-455faafafd86 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:37.714753 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f86f8e0-460b-411d-b0b4-e7ce918e4a74 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:37.721655 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:37.724550 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe950b3-6cb6-4499-9ece-455faafafd86 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:37.749665 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60729f9b-8ad0-432a-986f-fdc4e27a027a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:37.750451 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60729f9b-8ad0-432a-986f-fdc4e27a027a None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:37.750736 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60729f9b-8ad0-432a-986f-fdc4e27a027a None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:37.751020 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60729f9b-8ad0-432a-986f-fdc4e27a027a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:37.758387 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8335df2-1283-4876-baa9-e9d9bd694c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:37.759259 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8335df2-1283-4876-baa9-e9d9bd694c8f None admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:37.759539 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8335df2-1283-4876-baa9-e9d9bd694c8f None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:37.759815 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8335df2-1283-4876-baa9-e9d9bd694c8f None admin] PATH_INFO: `/v3/projects/69c523a41f4048cfb7df553b6feb6310/users/0834256bdfbc48ffbc5af6d6760ecdd9/roles/35ca0f0b9a964300a63780ec435e730b` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:37.761372 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60729f9b-8ad0-432a-986f-fdc4e27a027a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:37.762898 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60729f9b-8ad0-432a-986f-fdc4e27a027a None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:37.773918 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8335df2-1283-4876-baa9-e9d9bd694c8f None admin] RBAC: Authorizing `identity:create_grant(project_id=69c523a41f4048cfb7df553b6feb6310, user_id=0834256bdfbc48ffbc5af6d6760ecdd9, role_id=35ca0f0b9a964300a63780ec435e730b)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:37.775348 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8335df2-1283-4876-baa9-e9d9bd694c8f None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:37.780710 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-60729f9b-8ad0-432a-986f-fdc4e27a027a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:37.780710 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:37.780710 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:37.780710 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:37.780710 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:37.780710 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:37.780710 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:37.780710 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:37.780710 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:37.780710 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:37.780710 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:37.780710 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:37.780710 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:22:37.780710 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:22:37.780710 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:22:37.781922 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:22:37.781922 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:37.781922 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:37.781922 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:37.781922 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:37.781922 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:37.781922 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:37.781922 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:37.781922 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:37.781922 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:37.781922 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:37.781922 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:37.781922 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:37.781922 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:37.781922 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:37.781922 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:37.781922 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:37.783064 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:22:37.783064 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:22:37.783064 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:37.783064 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:37.783064 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 398/817] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:22:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:37.783417 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60729f9b-8ad0-432a-986f-fdc4e27a027a None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:37.792942 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 420/818] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Jul 1 19:22:37 2022] PUT /identity/v3/projects/69c523a41f4048cfb7df553b6feb6310/users/0834256bdfbc48ffbc5af6d6760ecdd9/roles/35ca0f0b9a964300a63780ec435e730b => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:22:37.794629 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8335df2-1283-4876-baa9-e9d9bd694c8f None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:37.815197 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:37.906391 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60729f9b-8ad0-432a-986f-fdc4e27a027a None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:37.919721 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8335df2-1283-4876-baa9-e9d9bd694c8f None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:37.967780 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c030fcd-7a94-4b37-8399-0ab6313ab636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:37.968682 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c030fcd-7a94-4b37-8399-0ab6313ab636 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:37.969074 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c030fcd-7a94-4b37-8399-0ab6313ab636 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:37.969419 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c030fcd-7a94-4b37-8399-0ab6313ab636 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:37.971158 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3100aa2c-e10d-410a-8df1-0a2e9a7859a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:37.971822 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100aa2c-e10d-410a-8df1-0a2e9a7859a3 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:37.972106 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100aa2c-e10d-410a-8df1-0a2e9a7859a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:37.972564 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100aa2c-e10d-410a-8df1-0a2e9a7859a3 None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:37.973089 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3100aa2c-e10d-410a-8df1-0a2e9a7859a3 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:37.973482 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3100aa2c-e10d-410a-8df1-0a2e9a7859a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:37.974859 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3100aa2c-e10d-410a-8df1-0a2e9a7859a3 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:37.977363 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c030fcd-7a94-4b37-8399-0ab6313ab636 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:37.979655 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c030fcd-7a94-4b37-8399-0ab6313ab636 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:37.980207 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 421/819] 10.222.0.26 () {56 vars in 1124 bytes} [Fri Jul 1 19:22:37 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:37.980883 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3100aa2c-e10d-410a-8df1-0a2e9a7859a3 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:37.997040 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:37.999197 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-0c030fcd-7a94-4b37-8399-0ab6313ab636 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:22:37.999197 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:37.999197 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:37.999197 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:37.999197 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:37.999197 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:37.999197 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:37.999197 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:37.999197 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:37.999197 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:37.999197 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:37.999197 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:37.999197 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 19:22:37.999197 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 19:22:37.999197 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 19:22:38.000483 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 19:22:38.000483 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:38.000483 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:38.000483 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:38.000483 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:38.000483 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:38.000483 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:38.000483 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:38.000483 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:38.000483 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:38.000483 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:38.000483 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:38.000483 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:38.000483 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:38.000483 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:38.000483 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:38.000483 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:38.001419 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 19:22:38.001419 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 19:22:38.001419 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 19:22:38.001419 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 19:22:38.001419 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 19:22:38.001419 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 19:22:38.001419 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:22:38.001419 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:38.001419 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 399/820] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Jul 1 19:22:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:38.001419 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c030fcd-7a94-4b37-8399-0ab6313ab636 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:38.088246 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:38.098567 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3100aa2c-e10d-410a-8df1-0a2e9a7859a3 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:38.111809 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c030fcd-7a94-4b37-8399-0ab6313ab636 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:38.141205 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c27f0c-3002-46dd-89b0-c6125b11f789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:38.141899 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c27f0c-3002-46dd-89b0-c6125b11f789 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:38.142185 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c27f0c-3002-46dd-89b0-c6125b11f789 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:38.142462 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c27f0c-3002-46dd-89b0-c6125b11f789 None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:38.143189 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c27f0c-3002-46dd-89b0-c6125b11f789 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:38.143498 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c27f0c-3002-46dd-89b0-c6125b11f789 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:38.144864 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c27f0c-3002-46dd-89b0-c6125b11f789 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:38.156087 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b483b9b-ae3b-42c8-965a-fcdd19d54125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:38.156762 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b483b9b-ae3b-42c8-965a-fcdd19d54125 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:38.157048 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b483b9b-ae3b-42c8-965a-fcdd19d54125 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:38.162716 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 422/821] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Jul 1 19:22:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:38.162866 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b483b9b-ae3b-42c8-965a-fcdd19d54125 None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:38.162866 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b483b9b-ae3b-42c8-965a-fcdd19d54125 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:38.163118 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c27f0c-3002-46dd-89b0-c6125b11f789 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:38.163229 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b483b9b-ae3b-42c8-965a-fcdd19d54125 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:38.163229 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b483b9b-ae3b-42c8-965a-fcdd19d54125 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:38.172907 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 400/822] 10.222.0.26 () {56 vars in 1124 bytes} [Fri Jul 1 19:22:38 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:38.172907 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b483b9b-ae3b-42c8-965a-fcdd19d54125 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:38.240988 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:38.274810 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c27f0c-3002-46dd-89b0-c6125b11f789 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:38.297712 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b483b9b-ae3b-42c8-965a-fcdd19d54125 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:38.317151 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1fb367-7252-4cfe-b0b1-9b8365fa6605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:38.317877 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1fb367-7252-4cfe-b0b1-9b8365fa6605 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:38.318161 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1fb367-7252-4cfe-b0b1-9b8365fa6605 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:38.318441 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1fb367-7252-4cfe-b0b1-9b8365fa6605 None admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:38.319234 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1fb367-7252-4cfe-b0b1-9b8365fa6605 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:38.319549 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1fb367-7252-4cfe-b0b1-9b8365fa6605 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:38.321058 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1fb367-7252-4cfe-b0b1-9b8365fa6605 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:38.338713 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 423/823] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Jul 1 19:22:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:38.338713 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1fb367-7252-4cfe-b0b1-9b8365fa6605 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:38.344758 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6946140f-3b29-455d-af3b-c23cbc8648b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:38.345625 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6946140f-3b29-455d-af3b-c23cbc8648b8 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:38.345918 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6946140f-3b29-455d-af3b-c23cbc8648b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:38.346199 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6946140f-3b29-455d-af3b-c23cbc8648b8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:38.355861 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6946140f-3b29-455d-af3b-c23cbc8648b8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:38.357535 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6946140f-3b29-455d-af3b-c23cbc8648b8 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:38.372752 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-6946140f-3b29-455d-af3b-c23cbc8648b8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 01 19:22:38.372752 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:38.372752 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:38.372752 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:38.372752 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:38.372752 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:38.372752 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:38.372752 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:38.372752 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:38.372752 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:38.372752 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:38.372752 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:38.372752 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 19:22:38.372752 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 19:22:38.372752 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 19:22:38.372752 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 19:22:38.373849 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:38.373849 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:38.373849 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 19:22:38.373849 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:22:38.373849 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 19:22:38.373849 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:22:38.373849 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:38.373849 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:38.373849 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:38.373849 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:38.373849 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:38.373849 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:38.373849 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:38.373849 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:38.373849 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:38.373849 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:38.373849 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:38.373849 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:38.374828 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:38.374828 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:38.374828 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 19:22:38.374828 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 19:22:38.374828 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 19:22:38.374828 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 19:22:38.374828 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 19:22:38.374828 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 19:22:38.374828 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 01 19:22:38.374828 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:38.374828 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 401/824] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Jul 1 19:22:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:38.374828 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6946140f-3b29-455d-af3b-c23cbc8648b8 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:38.379989 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:38.459347 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1fb367-7252-4cfe-b0b1-9b8365fa6605 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:38.492329 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6946140f-3b29-455d-af3b-c23cbc8648b8 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:38.498263 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea42cc-6463-42fd-b5ff-d26edfabf103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:38.498935 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea42cc-6463-42fd-b5ff-d26edfabf103 None admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:38.499224 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea42cc-6463-42fd-b5ff-d26edfabf103 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:38.499505 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea42cc-6463-42fd-b5ff-d26edfabf103 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:38.500261 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cea42cc-6463-42fd-b5ff-d26edfabf103 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:38.501689 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cea42cc-6463-42fd-b5ff-d26edfabf103 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:38.505625 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:38.525331 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 424/825] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Jul 1 19:22:38 2022] POST /identity/v3/endpoints => generated 346 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:22:38.526644 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea42cc-6463-42fd-b5ff-d26edfabf103 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:38.547072 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676cb098-d771-423d-9489-2bf889fa2e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:38.547817 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676cb098-d771-423d-9489-2bf889fa2e8a None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:38.548100 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676cb098-d771-423d-9489-2bf889fa2e8a None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:38.548374 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676cb098-d771-423d-9489-2bf889fa2e8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:38.549316 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676cb098-d771-423d-9489-2bf889fa2e8a None admin] RBAC: Adding query filter params (role.id=6cb03785fb184ef587509b3174622f69, scope.project.id=69c523a41f4048cfb7df553b6feb6310, user.id=13fd76fc7dd1410b9cde5adbaa6cb2e5) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:38.549638 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676cb098-d771-423d-9489-2bf889fa2e8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:38.551206 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676cb098-d771-423d-9489-2bf889fa2e8a None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:38.564761 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 402/826] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Jul 1 19:22:38 2022] GET /identity/v3/role_assignments?user.id=13fd76fc7dd1410b9cde5adbaa6cb2e5&scope.project.id=69c523a41f4048cfb7df553b6feb6310&role.id=6cb03785fb184ef587509b3174622f69 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:38.673259 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea42cc-6463-42fd-b5ff-d26edfabf103 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:38.717097 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f0db52-7849-4852-a284-a08e64e54649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:38.717879 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0db52-7849-4852-a284-a08e64e54649 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:38.718224 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0db52-7849-4852-a284-a08e64e54649 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:38.718505 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0db52-7849-4852-a284-a08e64e54649 None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:38.719438 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f0db52-7849-4852-a284-a08e64e54649 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:38.719758 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f0db52-7849-4852-a284-a08e64e54649 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:38.721268 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f0db52-7849-4852-a284-a08e64e54649 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:38.742449 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 425/827] 10.222.0.26 () {56 vars in 1135 bytes} [Fri Jul 1 19:22:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:38.748588 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676cb098-d771-423d-9489-2bf889fa2e8a None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:38.815805 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:38.859665 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676cb098-d771-423d-9489-2bf889fa2e8a None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:38.899235 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648b55b8-f57a-4c22-8da5-c6db8d55a20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:38.900386 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b55b8-f57a-4c22-8da5-c6db8d55a20d None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:38.900880 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b55b8-f57a-4c22-8da5-c6db8d55a20d None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:38.901388 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b55b8-f57a-4c22-8da5-c6db8d55a20d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:38.913529 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648b55b8-f57a-4c22-8da5-c6db8d55a20d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:38.915406 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648b55b8-f57a-4c22-8da5-c6db8d55a20d None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:38.937039 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-648b55b8-f57a-4c22-8da5-c6db8d55a20d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:38.937039 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:38.937039 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:38.937039 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:38.937039 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:38.937039 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:38.937039 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:38.937039 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:38.937039 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:38.937039 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:38.937039 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:38.937039 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:38.937039 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:22:38.937039 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:22:38.937039 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:22:38.938017 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:22:38.938017 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:38.938017 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:38.938017 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:38.938017 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:38.938017 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:38.938017 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:38.938017 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:38.938017 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:38.938017 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:38.938017 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:38.938017 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:38.938017 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:38.938017 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:38.938017 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:38.938017 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:38.938017 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:38.938923 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:22:38.938923 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:22:38.938923 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:38.938923 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:38.941208 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 403/828] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:22:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:38.947284 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f0db52-7849-4852-a284-a08e64e54649 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:39.012345 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:39.058040 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f0db52-7849-4852-a284-a08e64e54649 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:39.094367 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9736020-1bdc-485f-a44c-2f1e3b46ae60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:39.095474 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9736020-1bdc-485f-a44c-2f1e3b46ae60 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:39.095995 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9736020-1bdc-485f-a44c-2f1e3b46ae60 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:39.096479 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9736020-1bdc-485f-a44c-2f1e3b46ae60 None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:39.097453 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9736020-1bdc-485f-a44c-2f1e3b46ae60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:39.097971 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9736020-1bdc-485f-a44c-2f1e3b46ae60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:39.099553 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9736020-1bdc-485f-a44c-2f1e3b46ae60 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:39.113209 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 426/829] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Jul 1 19:22:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:39.119174 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648b55b8-f57a-4c22-8da5-c6db8d55a20d None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:39.231183 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648b55b8-f57a-4c22-8da5-c6db8d55a20d None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:39.246410 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:39.270058 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ccc64f-134a-48f7-9ce0-94074694e7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:39.270854 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ccc64f-134a-48f7-9ce0-94074694e7a7 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:39.271133 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ccc64f-134a-48f7-9ce0-94074694e7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:39.271405 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ccc64f-134a-48f7-9ce0-94074694e7a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:39.279144 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ccc64f-134a-48f7-9ce0-94074694e7a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:39.280596 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ccc64f-134a-48f7-9ce0-94074694e7a7 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:39.295968 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-33ccc64f-134a-48f7-9ce0-94074694e7a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:22:39.295968 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:39.295968 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:39.295968 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:39.295968 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:39.295968 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:39.295968 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:39.295968 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:39.295968 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:39.295968 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:39.295968 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:39.295968 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:39.295968 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 19:22:39.295968 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 19:22:39.295968 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 19:22:39.297596 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 19:22:39.297596 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:39.297596 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:39.297596 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:39.297596 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:39.297596 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:39.297596 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:39.297596 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:39.297596 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:39.297596 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:39.297596 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:39.297596 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:39.297596 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:39.297596 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:39.297596 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:39.297596 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:39.297596 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:39.299077 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 19:22:39.299077 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 19:22:39.299077 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 19:22:39.299077 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 19:22:39.299077 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 19:22:39.299077 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 19:22:39.299077 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:22:39.299077 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:39.299077 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 404/830] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Jul 1 19:22:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:39.309078 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9736020-1bdc-485f-a44c-2f1e3b46ae60 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:39.433823 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9736020-1bdc-485f-a44c-2f1e3b46ae60 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:39.449604 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:39.473892 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48453bd5-042c-4afe-bad5-e7a90d52c970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:39.474965 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48453bd5-042c-4afe-bad5-e7a90d52c970 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:39.475496 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48453bd5-042c-4afe-bad5-e7a90d52c970 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:39.476049 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48453bd5-042c-4afe-bad5-e7a90d52c970 None admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:39.477900 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48453bd5-042c-4afe-bad5-e7a90d52c970 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:39.478457 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48453bd5-042c-4afe-bad5-e7a90d52c970 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:39.480124 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48453bd5-042c-4afe-bad5-e7a90d52c970 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:39.495853 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 427/831] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Jul 1 19:22:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:39.502437 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ccc64f-134a-48f7-9ce0-94074694e7a7 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:39.639420 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ccc64f-134a-48f7-9ce0-94074694e7a7 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:39.696881 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db3de6-8711-4255-9da7-499be1b8ca6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:39.697849 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db3de6-8711-4255-9da7-499be1b8ca6c None admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:39.698135 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db3de6-8711-4255-9da7-499be1b8ca6c None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:39.698411 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db3de6-8711-4255-9da7-499be1b8ca6c None admin] PATH_INFO: `/v3/projects/69c523a41f4048cfb7df553b6feb6310/users/e958c5b03a9346d59c32675c5271bf3b/roles/6cb03785fb184ef587509b3174622f69` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:39.700509 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08db3de6-8711-4255-9da7-499be1b8ca6c None admin] RBAC: Authorizing `identity:create_grant(project_id=69c523a41f4048cfb7df553b6feb6310, user_id=e958c5b03a9346d59c32675c5271bf3b, role_id=6cb03785fb184ef587509b3174622f69)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:39.701998 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08db3de6-8711-4255-9da7-499be1b8ca6c None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:39.720666 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 405/832] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Jul 1 19:22:39 2022] PUT /identity/v3/projects/69c523a41f4048cfb7df553b6feb6310/users/e958c5b03a9346d59c32675c5271bf3b/roles/6cb03785fb184ef587509b3174622f69 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:22:39.910133 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de6711-eb05-4dc8-a0a2-bb82255f2f19 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:39.910688 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de6711-eb05-4dc8-a0a2-bb82255f2f19 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:39.910992 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de6711-eb05-4dc8-a0a2-bb82255f2f19 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:39.912352 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 428/833] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:22:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:22:39.917961 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d433df-9c70-42bf-8a20-465bd82837ee None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:39.918643 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d433df-9c70-42bf-8a20-465bd82837ee None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:39.918643 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d433df-9c70-42bf-8a20-465bd82837ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:39.936748 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-02d433df-9c70-42bf-8a20-465bd82837ee None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:22:39.938048 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-02d433df-9c70-42bf-8a20-465bd82837ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:22:39.972962 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:40.023236 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 406/834] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:22:39 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:22:40.048250 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de6711-eb05-4dc8-a0a2-bb82255f2f19 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:40.167735 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de6711-eb05-4dc8-a0a2-bb82255f2f19 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:40.204703 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e07d88-a2ff-476f-8eb2-1c59d024080d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:40.205608 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e07d88-a2ff-476f-8eb2-1c59d024080d None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:40.205897 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e07d88-a2ff-476f-8eb2-1c59d024080d None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:40.206173 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e07d88-a2ff-476f-8eb2-1c59d024080d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:40.218347 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e07d88-a2ff-476f-8eb2-1c59d024080d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:22:40.226662 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-a8e07d88-a2ff-476f-8eb2-1c59d024080d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:22:40.226662 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:40.226662 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:40.226662 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:40.226662 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:40.226662 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:40.226662 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:40.226662 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:40.226662 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:40.226662 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:40.226662 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:40.226662 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:40.226662 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:22:40.226662 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:22:40.226662 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:22:40.226662 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:22:40.227641 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:22:40.227641 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:22:40.227641 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:22:40.227641 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:22:40.227641 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:40.227641 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:40.227641 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:40.227641 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:40.227641 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:40.227641 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:40.227641 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:40.227641 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:40.227641 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:40.227641 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:40.227641 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:40.227641 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:40.228736 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:40.228736 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:40.228736 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:40.228736 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:40.228736 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:22:40.228736 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:22:40.228736 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:22:40.228736 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:22:40.228736 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:22:40.228736 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:22:40.228736 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:22:40.228736 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:40.228736 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 429/835] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Jul 1 19:22:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:40.234709 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d433df-9c70-42bf-8a20-465bd82837ee None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:40.343695 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d433df-9c70-42bf-8a20-465bd82837ee None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:40.379572 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce032286-da86-4a01-b30a-8a99383e1293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:40.380251 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce032286-da86-4a01-b30a-8a99383e1293 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:40.380536 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce032286-da86-4a01-b30a-8a99383e1293 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:40.380814 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce032286-da86-4a01-b30a-8a99383e1293 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:40.381597 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce032286-da86-4a01-b30a-8a99383e1293 None admin] RBAC: Adding query filter params (name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:40.381909 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce032286-da86-4a01-b30a-8a99383e1293 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:40.383297 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce032286-da86-4a01-b30a-8a99383e1293 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:40.392708 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 407/836] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Jul 1 19:22:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:40.398170 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e07d88-a2ff-476f-8eb2-1c59d024080d None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:40.429097 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:40.514658 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e07d88-a2ff-476f-8eb2-1c59d024080d None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:40.552365 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caf4c88-66ed-418d-9748-2ca6c6cdf300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:40.553521 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf4c88-66ed-418d-9748-2ca6c6cdf300 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:40.553816 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf4c88-66ed-418d-9748-2ca6c6cdf300 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:40.557255 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf4c88-66ed-418d-9748-2ca6c6cdf300 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:40.684016 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caf4c88-66ed-418d-9748-2ca6c6cdf300 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:40.686018 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caf4c88-66ed-418d-9748-2ca6c6cdf300 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:40.706022 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-5caf4c88-66ed-418d-9748-2ca6c6cdf300 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:40.706022 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:40.706022 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:40.706022 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:40.706022 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:40.706022 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:40.706022 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:40.706022 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:40.706022 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:40.706022 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:40.706022 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:40.706022 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:40.706022 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:22:40.706022 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:22:40.706022 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:22:40.707159 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:22:40.707159 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:40.707159 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:40.707159 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:40.707159 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:40.707159 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:40.707159 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:40.707159 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:40.707159 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:40.707159 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:40.707159 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:40.707159 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:40.707159 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:40.707159 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:40.707159 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:40.707159 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:40.707159 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:40.708050 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:22:40.708050 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:22:40.708050 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:40.708050 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:40.708050 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 430/837] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:22:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:40.718352 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce032286-da86-4a01-b30a-8a99383e1293 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:40.748000 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:40.785295 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ea056-7620-4205-9b8e-103f677dff5e None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:40.785653 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ea056-7620-4205-9b8e-103f677dff5e None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:40.785877 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ea056-7620-4205-9b8e-103f677dff5e None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:40.787531 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 431/838] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:22:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:22:40.795155 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf1b81a-cf8b-428b-a68d-dffc6218775e None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:40.795585 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf1b81a-cf8b-428b-a68d-dffc6218775e None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:40.796019 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf1b81a-cf8b-428b-a68d-dffc6218775e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:40.822975 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-1bf1b81a-cf8b-428b-a68d-dffc6218775e None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:22:40.824739 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-1bf1b81a-cf8b-428b-a68d-dffc6218775e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:22:40.844565 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce032286-da86-4a01-b30a-8a99383e1293 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:40.889596 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9397fb9-9a18-454d-bfa9-d27c80e9cb07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:40.890279 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9397fb9-9a18-454d-bfa9-d27c80e9cb07 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:40.890895 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9397fb9-9a18-454d-bfa9-d27c80e9cb07 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:40.891182 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9397fb9-9a18-454d-bfa9-d27c80e9cb07 None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:40.892222 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9397fb9-9a18-454d-bfa9-d27c80e9cb07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:40.892536 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9397fb9-9a18-454d-bfa9-d27c80e9cb07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:40.894584 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9397fb9-9a18-454d-bfa9-d27c80e9cb07 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:40.911965 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 408/839] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Jul 1 19:22:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:40.918804 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9397fb9-9a18-454d-bfa9-d27c80e9cb07 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:40.924973 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 432/840] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:22:40 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (3 switches on core 0) Jul 01 19:22:40.945283 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf1b81a-cf8b-428b-a68d-dffc6218775e None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:40.958276 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:41.027634 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:41.043641 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9397fb9-9a18-454d-bfa9-d27c80e9cb07 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:41.067020 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf1b81a-cf8b-428b-a68d-dffc6218775e None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:41.078867 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c2a39c-4875-490b-9e10-eef45bd1d27c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:41.079675 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2a39c-4875-490b-9e10-eef45bd1d27c None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:41.079955 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2a39c-4875-490b-9e10-eef45bd1d27c None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:41.080229 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2a39c-4875-490b-9e10-eef45bd1d27c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:41.087759 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c2a39c-4875-490b-9e10-eef45bd1d27c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:41.089211 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c2a39c-4875-490b-9e10-eef45bd1d27c None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:41.105938 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-52c2a39c-4875-490b-9e10-eef45bd1d27c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 01 19:22:41.105938 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:41.105938 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:41.105938 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:41.105938 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:41.105938 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:41.105938 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:41.105938 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:41.105938 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:41.105938 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:41.105938 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:41.105938 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:41.105938 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 19:22:41.105938 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 19:22:41.105938 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 19:22:41.105938 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 19:22:41.107674 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:41.107674 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:41.107674 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 19:22:41.107674 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:22:41.107674 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 19:22:41.107674 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:22:41.107674 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:41.107674 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:41.107674 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:41.107674 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:41.107674 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:41.107674 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:41.107674 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:41.107674 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:41.107674 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:41.107674 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:41.107674 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:41.107674 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:41.108793 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:41.108793 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:41.108793 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 19:22:41.108793 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 19:22:41.108793 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 19:22:41.108793 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 19:22:41.108793 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 19:22:41.108793 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 19:22:41.108793 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 01 19:22:41.108793 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:41.108793 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 409/841] 10.222.0.26 () {56 vars in 1117 bytes} [Fri Jul 1 19:22:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:41.110010 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d4e44-2ca5-4762-87e1-10ecb33823c5 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:41.110395 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d4e44-2ca5-4762-87e1-10ecb33823c5 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:41.110713 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d4e44-2ca5-4762-87e1-10ecb33823c5 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:41.112181 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 410/842] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:22:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:22:41.114165 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7d4e44-2ca5-4762-87e1-10ecb33823c5 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:41.114373 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40317f04-7fc5-4afe-92ef-236782837317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:41.115285 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40317f04-7fc5-4afe-92ef-236782837317 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:41.115670 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40317f04-7fc5-4afe-92ef-236782837317 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:41.116306 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40317f04-7fc5-4afe-92ef-236782837317 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:41.116975 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40317f04-7fc5-4afe-92ef-236782837317 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:41.118400 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40317f04-7fc5-4afe-92ef-236782837317 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:41.131398 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-40317f04-7fc5-4afe-92ef-236782837317 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 01 19:22:41.131398 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:41.131398 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 19:22:41.131398 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 19:22:41.131398 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 19:22:41.131398 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 19:22:41.131398 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 19:22:41.131398 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:22:41.131398 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 01 19:22:41.131398 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:41.131398 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 19:22:41.131398 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:41.131398 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:41.131398 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:41.131398 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:41.131398 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:41.132466 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:41.132466 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:41.132466 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:41.132466 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:41.132466 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:41.132466 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:41.132466 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:41.132466 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 19:22:41.132466 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 19:22:41.132466 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 19:22:41.132466 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 19:22:41.132466 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:41.132466 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:41.132466 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:41.132466 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:41.132466 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:41.133363 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:41.133363 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:41.133363 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:41.133363 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:41.133363 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:41.133363 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:41.133363 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:41.133363 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:41.133363 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:41.133363 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:41.133363 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:41.133363 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 19:22:41.133363 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:22:41.133363 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 01 19:22:41.133363 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:41.137394 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 433/843] 10.222.0.26 () {56 vars in 1132 bytes} [Fri Jul 1 19:22:40 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:22:41.138883 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9cd6c-21a1-4b33-865b-048fb7e0153f None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:41.139164 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9cd6c-21a1-4b33-865b-048fb7e0153f None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:41.139438 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9cd6c-21a1-4b33-865b-048fb7e0153f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:41.160990 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-e8f9cd6c-21a1-4b33-865b-048fb7e0153f None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:22:41.162457 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-e8f9cd6c-21a1-4b33-865b-048fb7e0153f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:22:41.243085 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 434/844] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:22:41 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:22:41.243727 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f9cd6c-21a1-4b33-865b-048fb7e0153f None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:41.254174 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:41.259547 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7d4e44-2ca5-4762-87e1-10ecb33823c5 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:41.300828 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c1aeb2-8bf4-4d5c-9a6c-319600b4fa37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:41.301795 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c1aeb2-8bf4-4d5c-9a6c-319600b4fa37 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:41.302082 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c1aeb2-8bf4-4d5c-9a6c-319600b4fa37 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:41.302358 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c1aeb2-8bf4-4d5c-9a6c-319600b4fa37 None admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:41.303626 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c1aeb2-8bf4-4d5c-9a6c-319600b4fa37 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:41.304297 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c1aeb2-8bf4-4d5c-9a6c-319600b4fa37 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:41.306026 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c1aeb2-8bf4-4d5c-9a6c-319600b4fa37 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:41.328595 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 411/845] 10.222.0.26 () {56 vars in 1149 bytes} [Fri Jul 1 19:22:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:41.329519 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c1aeb2-8bf4-4d5c-9a6c-319600b4fa37 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:41.333886 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:41.368177 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f9cd6c-21a1-4b33-865b-048fb7e0153f None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:41.406498 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bbf707-4fea-4953-8f09-8c426dd1cd89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:41.407176 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bbf707-4fea-4953-8f09-8c426dd1cd89 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:41.407465 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bbf707-4fea-4953-8f09-8c426dd1cd89 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:41.407746 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bbf707-4fea-4953-8f09-8c426dd1cd89 None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:41.408455 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bbf707-4fea-4953-8f09-8c426dd1cd89 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:41.408764 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bbf707-4fea-4953-8f09-8c426dd1cd89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:41.410762 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bbf707-4fea-4953-8f09-8c426dd1cd89 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:41.420936 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 435/846] 10.222.0.26 () {56 vars in 1126 bytes} [Fri Jul 1 19:22:41 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:41.420936 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bbf707-4fea-4953-8f09-8c426dd1cd89 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:41.443387 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c1aeb2-8bf4-4d5c-9a6c-319600b4fa37 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:41.481505 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2182598-5ee7-4242-b071-5a6755d13cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:41.482312 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2182598-5ee7-4242-b071-5a6755d13cde None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:41.482597 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2182598-5ee7-4242-b071-5a6755d13cde None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:41.482870 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2182598-5ee7-4242-b071-5a6755d13cde None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:41.483529 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2182598-5ee7-4242-b071-5a6755d13cde None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:41.484924 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2182598-5ee7-4242-b071-5a6755d13cde None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:41.493078 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:41.498058 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-b2182598-5ee7-4242-b071-5a6755d13cde None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 01 19:22:41.498058 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:41.498058 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 19:22:41.498058 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 19:22:41.498058 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 19:22:41.498058 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 19:22:41.498058 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 19:22:41.498058 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:22:41.498058 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 01 19:22:41.498058 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:41.498058 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 19:22:41.498058 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:41.498058 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:41.498058 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:41.498058 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:41.498058 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:41.498058 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:41.499081 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:41.499081 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:41.499081 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:41.499081 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:41.499081 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:41.499081 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:41.499081 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 19:22:41.499081 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 19:22:41.499081 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 19:22:41.499081 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 19:22:41.499081 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:41.499081 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:41.499081 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:41.499081 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:41.499081 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:41.499081 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:41.499921 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:41.499921 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:41.499921 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:41.499921 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:41.499921 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:41.499921 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:41.499921 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:41.499921 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:41.499921 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:41.499921 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:41.499921 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 19:22:41.499921 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:22:41.499921 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 01 19:22:41.499921 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:41.499921 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 412/847] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Jul 1 19:22:41 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:41.501384 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2182598-5ee7-4242-b071-5a6755d13cde None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:41.534227 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bbf707-4fea-4953-8f09-8c426dd1cd89 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:41.574789 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea13728a-4669-4188-867d-c454b7894113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:41.576001 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13728a-4669-4188-867d-c454b7894113 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:41.576286 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13728a-4669-4188-867d-c454b7894113 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:41.576565 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13728a-4669-4188-867d-c454b7894113 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:41.605011 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:41.653121 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2182598-5ee7-4242-b071-5a6755d13cde None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:41.666416 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea13728a-4669-4188-867d-c454b7894113 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:41.667863 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea13728a-4669-4188-867d-c454b7894113 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:41.699789 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ff56a3-1c2e-4aff-8a38-aea902bae840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:41.701433 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff56a3-1c2e-4aff-8a38-aea902bae840 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:41.701950 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff56a3-1c2e-4aff-8a38-aea902bae840 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:41.702444 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff56a3-1c2e-4aff-8a38-aea902bae840 None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:41.703725 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ff56a3-1c2e-4aff-8a38-aea902bae840 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:41.704295 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ff56a3-1c2e-4aff-8a38-aea902bae840 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:41.706783 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ff56a3-1c2e-4aff-8a38-aea902bae840 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:41.721288 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 413/848] 10.222.0.26 () {56 vars in 1126 bytes} [Fri Jul 1 19:22:41 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:41.721288 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ff56a3-1c2e-4aff-8a38-aea902bae840 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:41.754565 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:41.805720 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 436/849] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Jul 1 19:22:41 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 01 19:22:41.812257 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea13728a-4669-4188-867d-c454b7894113 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:41.889702 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ff56a3-1c2e-4aff-8a38-aea902bae840 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:41.926820 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:41.936667 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea13728a-4669-4188-867d-c454b7894113 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:41.941557 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30378373-4349-42db-80c8-378950c4d421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:41.942384 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30378373-4349-42db-80c8-378950c4d421 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:41.942801 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30378373-4349-42db-80c8-378950c4d421 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:41.943202 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30378373-4349-42db-80c8-378950c4d421 None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:41.944040 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30378373-4349-42db-80c8-378950c4d421 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:41.944464 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30378373-4349-42db-80c8-378950c4d421 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:41.946586 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30378373-4349-42db-80c8-378950c4d421 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:41.954872 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 414/850] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Jul 1 19:22:41 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:41.963661 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30378373-4349-42db-80c8-378950c4d421 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:42.003836 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5da55fd-2d10-4bc0-a3a8-4b2a5cf63e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:42.004979 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da55fd-2d10-4bc0-a3a8-4b2a5cf63e5d None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:42.006275 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da55fd-2d10-4bc0-a3a8-4b2a5cf63e5d None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:42.006447 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da55fd-2d10-4bc0-a3a8-4b2a5cf63e5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:42.017791 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5da55fd-2d10-4bc0-a3a8-4b2a5cf63e5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:42.019238 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5da55fd-2d10-4bc0-a3a8-4b2a5cf63e5d None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:42.038093 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-f5da55fd-2d10-4bc0-a3a8-4b2a5cf63e5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:42.038093 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:42.038093 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:42.038093 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:42.038093 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:42.038093 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:42.038093 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:42.038093 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:42.038093 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:42.038093 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:42.038093 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:42.038093 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:42.038093 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:22:42.038093 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:22:42.038093 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:22:42.039068 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:22:42.039068 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:42.039068 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:42.039068 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:42.039068 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:42.039068 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:42.039068 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:42.039068 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:42.039068 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:42.039068 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:42.039068 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:42.039068 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:42.039068 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:42.039068 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:42.039068 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:42.039068 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:42.039068 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:42.039969 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:22:42.039969 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:22:42.039969 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:42.039969 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:42.039969 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 437/851] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:22:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:22:42.040991 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5370d-6210-4815-b25c-5963b6f4d064 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:42.041370 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5370d-6210-4815-b25c-5963b6f4d064 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:42.041711 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5370d-6210-4815-b25c-5963b6f4d064 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:42.045277 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 438/852] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:22:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:22:42.045869 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d5370d-6210-4815-b25c-5963b6f4d064 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:42.071149 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:42.095996 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30378373-4349-42db-80c8-378950c4d421 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:42.131294 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2c6fe7-1781-4613-b483-7e0aaf84f5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:42.131965 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c6fe7-1781-4613-b483-7e0aaf84f5ea None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:42.132249 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c6fe7-1781-4613-b483-7e0aaf84f5ea None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:42.132524 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c6fe7-1781-4613-b483-7e0aaf84f5ea None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:42.133364 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2c6fe7-1781-4613-b483-7e0aaf84f5ea None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:42.133680 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2c6fe7-1781-4613-b483-7e0aaf84f5ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:42.135056 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2c6fe7-1781-4613-b483-7e0aaf84f5ea None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:42.146696 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 415/853] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Jul 1 19:22:41 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:22:42.146696 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf05fad-56ba-4b22-bfb2-bc9fe43397ba None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:42.146696 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf05fad-56ba-4b22-bfb2-bc9fe43397ba None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:42.146696 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf05fad-56ba-4b22-bfb2-bc9fe43397ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:42.169513 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-5cf05fad-56ba-4b22-bfb2-bc9fe43397ba None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:22:42.170821 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d5370d-6210-4815-b25c-5963b6f4d064 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:42.170941 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-5cf05fad-56ba-4b22-bfb2-bc9fe43397ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:22:42.211206 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d72263-74ac-4766-819d-d8715855c66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:42.211933 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d72263-74ac-4766-819d-d8715855c66a None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:42.212220 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d72263-74ac-4766-819d-d8715855c66a None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:42.212498 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d72263-74ac-4766-819d-d8715855c66a None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:42.213407 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d72263-74ac-4766-819d-d8715855c66a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:42.213724 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d72263-74ac-4766-819d-d8715855c66a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:42.215307 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d72263-74ac-4766-819d-d8715855c66a None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:42.229703 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 439/854] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Jul 1 19:22:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:22:42.237373 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d72263-74ac-4766-819d-d8715855c66a None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:42.250828 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:42.271866 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 416/855] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:22:42 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:22:42.296250 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf05fad-56ba-4b22-bfb2-bc9fe43397ba None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:42.351643 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:42.374053 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d72263-74ac-4766-819d-d8715855c66a None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:42.412431 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf05fad-56ba-4b22-bfb2-bc9fe43397ba None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:42.413856 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae8719a-7657-4067-be5e-da0954ff611a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:42.414738 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae8719a-7657-4067-be5e-da0954ff611a None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:42.415191 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae8719a-7657-4067-be5e-da0954ff611a None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:42.415551 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae8719a-7657-4067-be5e-da0954ff611a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:42.428048 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae8719a-7657-4067-be5e-da0954ff611a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:42.429979 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae8719a-7657-4067-be5e-da0954ff611a None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:42.446295 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-0ae8719a-7657-4067-be5e-da0954ff611a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:22:42.446295 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:42.446295 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:42.446295 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:42.446295 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:42.446295 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:42.446295 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:42.446295 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:42.446295 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:42.446295 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:42.446295 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:42.446295 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:42.446295 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 19:22:42.446295 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 19:22:42.446295 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 19:22:42.447472 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 19:22:42.447472 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:42.447472 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:42.447472 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:42.447472 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:42.447472 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:42.447472 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:42.447472 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:42.447472 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:42.447472 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:42.447472 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:42.447472 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:42.447472 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:42.447472 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:42.447472 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:42.447472 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:42.447472 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:42.448599 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 19:22:42.448599 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 19:22:42.448599 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 19:22:42.448599 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 19:22:42.448599 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 19:22:42.448599 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 19:22:42.448599 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:22:42.448599 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:42.450669 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 440/856] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Jul 1 19:22:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:22:42.461687 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae8719a-7657-4067-be5e-da0954ff611a None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:42.462307 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03600aee-c692-4a2c-ad6b-c8d1e8687bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:42.463708 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03600aee-c692-4a2c-ad6b-c8d1e8687bdb None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:42.463708 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03600aee-c692-4a2c-ad6b-c8d1e8687bdb None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:42.463900 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03600aee-c692-4a2c-ad6b-c8d1e8687bdb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:42.475820 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03600aee-c692-4a2c-ad6b-c8d1e8687bdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:22:42.483675 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-03600aee-c692-4a2c-ad6b-c8d1e8687bdb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:22:42.483675 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:42.483675 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:42.483675 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:42.483675 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:42.483675 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:42.483675 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:42.483675 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:42.483675 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:42.483675 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:42.483675 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:42.483675 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:42.483675 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:22:42.483675 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:22:42.483675 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:22:42.483675 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:22:42.484835 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:22:42.484835 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:22:42.484835 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:22:42.484835 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:22:42.484835 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:42.484835 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:42.484835 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:42.484835 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:42.484835 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:42.484835 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:42.484835 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:42.484835 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:42.484835 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:42.484835 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:42.484835 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:42.484835 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:42.485944 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:42.485944 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:42.485944 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:42.485944 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:42.485944 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:22:42.485944 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:22:42.485944 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:22:42.485944 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:22:42.485944 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:22:42.485944 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:22:42.485944 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:22:42.485944 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:42.487134 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 417/857] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Jul 1 19:22:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:22:42.492836 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03600aee-c692-4a2c-ad6b-c8d1e8687bdb None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:42.555192 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:42.605216 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae8719a-7657-4067-be5e-da0954ff611a None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:42.610763 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03600aee-c692-4a2c-ad6b-c8d1e8687bdb None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:42.654167 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ec877-89d1-4222-90f1-3d5efc63d40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:42.654846 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ec877-89d1-4222-90f1-3d5efc63d40c None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:42.655132 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ec877-89d1-4222-90f1-3d5efc63d40c None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:42.655411 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ec877-89d1-4222-90f1-3d5efc63d40c None admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:42.656234 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94ec877-89d1-4222-90f1-3d5efc63d40c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:42.656541 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94ec877-89d1-4222-90f1-3d5efc63d40c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:42.658016 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94ec877-89d1-4222-90f1-3d5efc63d40c None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:42.663094 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb27c97-a88f-44a0-8cc4-2df2771cb508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:42.664035 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb27c97-a88f-44a0-8cc4-2df2771cb508 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:42.664523 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb27c97-a88f-44a0-8cc4-2df2771cb508 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:42.665002 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb27c97-a88f-44a0-8cc4-2df2771cb508 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:42.666603 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb27c97-a88f-44a0-8cc4-2df2771cb508 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:42.667144 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb27c97-a88f-44a0-8cc4-2df2771cb508 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:42.668393 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:42.670466 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb27c97-a88f-44a0-8cc4-2df2771cb508 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:42.677064 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 441/858] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Jul 1 19:22:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:42.678483 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ec877-89d1-4222-90f1-3d5efc63d40c None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:42.685322 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 418/859] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Jul 1 19:22:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:22:42.686695 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb27c97-a88f-44a0-8cc4-2df2771cb508 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:42.797877 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb27c97-a88f-44a0-8cc4-2df2771cb508 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:42.812811 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:42.828193 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ec877-89d1-4222-90f1-3d5efc63d40c None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:42.838585 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa6081d-966d-4c13-bf74-8ded2d4a39c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:42.840081 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa6081d-966d-4c13-bf74-8ded2d4a39c6 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:42.841486 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa6081d-966d-4c13-bf74-8ded2d4a39c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:42.841920 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa6081d-966d-4c13-bf74-8ded2d4a39c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:42.857259 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa6081d-966d-4c13-bf74-8ded2d4a39c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:42.859926 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa6081d-966d-4c13-bf74-8ded2d4a39c6 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:42.867174 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385cbba5-db1d-4a10-88dc-4fee996912e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:42.868253 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385cbba5-db1d-4a10-88dc-4fee996912e3 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:42.868740 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385cbba5-db1d-4a10-88dc-4fee996912e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:42.869252 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385cbba5-db1d-4a10-88dc-4fee996912e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:42.870394 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385cbba5-db1d-4a10-88dc-4fee996912e3 None admin] RBAC: Adding query filter params (role.id=35ca0f0b9a964300a63780ec435e730b, scope.project.id=69c523a41f4048cfb7df553b6feb6310, user.id=0834256bdfbc48ffbc5af6d6760ecdd9) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:42.870926 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385cbba5-db1d-4a10-88dc-4fee996912e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:42.873091 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385cbba5-db1d-4a10-88dc-4fee996912e3 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:42.881161 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-9aa6081d-966d-4c13-bf74-8ded2d4a39c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:42.881161 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:42.881161 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:42.881161 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:42.881161 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:42.881161 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:42.881161 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:42.881161 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:42.881161 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:42.881161 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:42.881161 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:42.881161 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:42.881161 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:22:42.881161 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:22:42.881161 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:22:42.882121 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:22:42.882121 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:42.882121 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:42.882121 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:42.882121 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:42.882121 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:42.882121 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:42.882121 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:42.882121 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:42.882121 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:42.882121 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:42.882121 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:42.882121 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:42.882121 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:42.882121 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:42.882121 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:42.882121 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:42.883027 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:22:42.883027 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:22:42.883027 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:42.883027 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:42.885428 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 442/861] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Jul 1 19:22:42 2022] GET /identity/v3/role_assignments?user.id=0834256bdfbc48ffbc5af6d6760ecdd9&scope.project.id=69c523a41f4048cfb7df553b6feb6310&role.id=35ca0f0b9a964300a63780ec435e730b => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:42.890152 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 419/861] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:22:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:42.891503 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385cbba5-db1d-4a10-88dc-4fee996912e3 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:42.971097 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:43.022977 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385cbba5-db1d-4a10-88dc-4fee996912e3 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:43.060730 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce3041f-d0b2-4eac-b31a-2bd968ff23f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:43.061481 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce3041f-d0b2-4eac-b31a-2bd968ff23f4 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:43.061766 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce3041f-d0b2-4eac-b31a-2bd968ff23f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:43.062096 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce3041f-d0b2-4eac-b31a-2bd968ff23f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:43.062885 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce3041f-d0b2-4eac-b31a-2bd968ff23f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:43.063141 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce3041f-d0b2-4eac-b31a-2bd968ff23f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:43.064507 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce3041f-d0b2-4eac-b31a-2bd968ff23f4 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:43.077919 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 443/862] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Jul 1 19:22:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:43.084452 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa6081d-966d-4c13-bf74-8ded2d4a39c6 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:43.192727 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa6081d-966d-4c13-bf74-8ded2d4a39c6 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:43.228325 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a17c3c-a3d4-44ee-9d67-9241d2d17f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:43.229535 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a17c3c-a3d4-44ee-9d67-9241d2d17f1a None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:43.230002 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a17c3c-a3d4-44ee-9d67-9241d2d17f1a None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:43.230456 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a17c3c-a3d4-44ee-9d67-9241d2d17f1a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:43.239067 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a17c3c-a3d4-44ee-9d67-9241d2d17f1a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:43.240716 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a17c3c-a3d4-44ee-9d67-9241d2d17f1a None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:43.255963 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-b3a17c3c-a3d4-44ee-9d67-9241d2d17f1a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 01 19:22:43.255963 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:43.255963 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:43.255963 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:43.255963 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:43.255963 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:43.255963 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:43.255963 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:43.255963 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:43.255963 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:43.255963 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:43.255963 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:43.255963 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 19:22:43.255963 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 19:22:43.255963 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 19:22:43.255963 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 19:22:43.256961 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:43.256961 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:43.256961 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 19:22:43.256961 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:22:43.256961 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 19:22:43.256961 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:22:43.256961 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:43.256961 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:43.256961 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:43.256961 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:43.256961 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:43.256961 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:43.256961 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:43.256961 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:43.256961 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:43.256961 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:43.256961 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:43.256961 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:43.257970 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:43.257970 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:43.257970 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 19:22:43.257970 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 19:22:43.257970 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 19:22:43.257970 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 19:22:43.257970 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 19:22:43.257970 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 19:22:43.257970 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 01 19:22:43.257970 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:43.260234 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 420/863] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Jul 1 19:22:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:43.265825 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce3041f-d0b2-4eac-b31a-2bd968ff23f4 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:43.380189 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce3041f-d0b2-4eac-b31a-2bd968ff23f4 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:43.405622 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:43.418505 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf7b072-3ac1-4106-99a1-b54ed04b9838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:43.419946 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7b072-3ac1-4106-99a1-b54ed04b9838 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:43.420377 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7b072-3ac1-4106-99a1-b54ed04b9838 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:43.420798 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7b072-3ac1-4106-99a1-b54ed04b9838 None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:43.421835 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf7b072-3ac1-4106-99a1-b54ed04b9838 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:43.422292 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf7b072-3ac1-4106-99a1-b54ed04b9838 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:43.423864 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf7b072-3ac1-4106-99a1-b54ed04b9838 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:43.445790 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 444/864] 10.222.0.26 () {56 vars in 1135 bytes} [Fri Jul 1 19:22:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:43.451697 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a17c3c-a3d4-44ee-9d67-9241d2d17f1a None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:43.479907 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:43.617354 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a17c3c-a3d4-44ee-9d67-9241d2d17f1a None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:43.683486 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939cfb0c-5d66-4bef-8209-5cfc7fb8cd3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:43.684635 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939cfb0c-5d66-4bef-8209-5cfc7fb8cd3d None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:43.685141 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939cfb0c-5d66-4bef-8209-5cfc7fb8cd3d None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:43.685682 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939cfb0c-5d66-4bef-8209-5cfc7fb8cd3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:43.821513 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939cfb0c-5d66-4bef-8209-5cfc7fb8cd3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:43.824238 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939cfb0c-5d66-4bef-8209-5cfc7fb8cd3d None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:43.871444 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:43.904727 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf22680c-e812-4780-aa3d-54c45b88a2fb None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:43.904922 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf22680c-e812-4780-aa3d-54c45b88a2fb None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:43.905197 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf22680c-e812-4780-aa3d-54c45b88a2fb None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:43.906735 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 445/865] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:22:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:22:43.911992 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8ab64-edf6-4649-926e-0019d8422624 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:43.912285 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8ab64-edf6-4649-926e-0019d8422624 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:43.912568 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8ab64-edf6-4649-926e-0019d8422624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:43.931341 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-9ca8ab64-edf6-4649-926e-0019d8422624 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:22:43.932886 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-9ca8ab64-edf6-4649-926e-0019d8422624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:22:43.985971 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 421/866] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Jul 1 19:22:43 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 01 19:22:43.992100 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939cfb0c-5d66-4bef-8209-5cfc7fb8cd3d None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:44.009433 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 446/867] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:22:43 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:22:44.032145 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca8ab64-edf6-4649-926e-0019d8422624 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:44.155331 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca8ab64-edf6-4649-926e-0019d8422624 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:44.170369 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:44.193532 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d31a64a-9b15-437c-a894-f581e7bbfda8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:44.194578 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31a64a-9b15-437c-a894-f581e7bbfda8 None admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:44.195090 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31a64a-9b15-437c-a894-f581e7bbfda8 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:44.195569 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31a64a-9b15-437c-a894-f581e7bbfda8 None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:44.196545 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d31a64a-9b15-437c-a894-f581e7bbfda8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:44.198258 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d31a64a-9b15-437c-a894-f581e7bbfda8 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:44.217586 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 447/868] 10.222.0.26 () {60 vars in 1141 bytes} [Fri Jul 1 19:22:44 2022] POST /identity/v3/services => generated 269 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:22:44.239025 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939cfb0c-5d66-4bef-8209-5cfc7fb8cd3d None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:44.274697 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:44.296039 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e63e57d-2aad-443d-9031-a75d4b814a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:44.297300 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63e57d-2aad-443d-9031-a75d4b814a41 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:44.297818 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63e57d-2aad-443d-9031-a75d4b814a41 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:44.298310 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63e57d-2aad-443d-9031-a75d4b814a41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:44.312731 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e63e57d-2aad-443d-9031-a75d4b814a41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:44.314913 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e63e57d-2aad-443d-9031-a75d4b814a41 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:44.335043 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-6e63e57d-2aad-443d-9031-a75d4b814a41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:44.335043 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:44.335043 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:44.335043 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:44.335043 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:44.335043 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:44.335043 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:44.335043 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:44.335043 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:44.335043 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:44.335043 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:44.335043 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:44.335043 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:22:44.335043 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:22:44.335043 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:22:44.336110 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:22:44.336110 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:44.336110 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:44.336110 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:44.336110 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:44.336110 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:44.336110 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:44.336110 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:44.336110 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:44.336110 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:44.336110 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:44.336110 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:44.336110 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:44.336110 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:44.336110 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:44.336110 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:44.336110 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:44.337065 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:22:44.337065 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:22:44.337065 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:44.337065 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:44.339762 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 422/869] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:22:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:22:44.348982 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d31a64a-9b15-437c-a894-f581e7bbfda8 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:44.470907 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d31a64a-9b15-437c-a894-f581e7bbfda8 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:44.512161 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb0542-b383-4250-884b-204ff31d6922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:44.513668 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb0542-b383-4250-884b-204ff31d6922 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:44.514117 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb0542-b383-4250-884b-204ff31d6922 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:44.514550 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb0542-b383-4250-884b-204ff31d6922 None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:44.515446 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eb0542-b383-4250-884b-204ff31d6922 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:44.515913 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eb0542-b383-4250-884b-204ff31d6922 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:44.517471 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eb0542-b383-4250-884b-204ff31d6922 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:44.531239 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 448/870] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Jul 1 19:22:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:44.533002 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9349373-3587-4f0f-a3f2-f2950fb45ccc None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:44.533495 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9349373-3587-4f0f-a3f2-f2950fb45ccc None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:44.534004 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9349373-3587-4f0f-a3f2-f2950fb45ccc None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:44.536219 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 423/871] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:22:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:22:44.537090 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb0542-b383-4250-884b-204ff31d6922 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:44.542979 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855de4d-6bc2-41da-931a-5ad42a728fd5 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:44.543545 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855de4d-6bc2-41da-931a-5ad42a728fd5 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:44.544066 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855de4d-6bc2-41da-931a-5ad42a728fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:44.562120 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-5855de4d-6bc2-41da-931a-5ad42a728fd5 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:22:44.563747 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-5855de4d-6bc2-41da-931a-5ad42a728fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:22:44.570734 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:44.649792 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 424/872] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:22:44 2022] POST /identity/v3/auth/tokens => generated 1261 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 01 19:22:44.664827 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb0542-b383-4250-884b-204ff31d6922 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:44.671882 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5855de4d-6bc2-41da-931a-5ad42a728fd5 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:44.703813 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9684b3-286a-4792-8c30-ad95fdb797ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:44.704966 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9684b3-286a-4792-8c30-ad95fdb797ec None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:44.705498 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9684b3-286a-4792-8c30-ad95fdb797ec None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:44.706036 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9684b3-286a-4792-8c30-ad95fdb797ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:44.713854 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9684b3-286a-4792-8c30-ad95fdb797ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:44.715760 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9684b3-286a-4792-8c30-ad95fdb797ec None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:44.732314 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-2e9684b3-286a-4792-8c30-ad95fdb797ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:22:44.732314 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:44.732314 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:44.732314 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:44.732314 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:44.732314 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:44.732314 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:44.732314 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:44.732314 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:44.732314 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:44.732314 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:44.732314 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:44.732314 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 19:22:44.732314 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 19:22:44.732314 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 19:22:44.733256 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 19:22:44.733256 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:44.733256 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:44.733256 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:44.733256 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:44.733256 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:44.733256 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:44.733256 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:44.733256 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:44.733256 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:44.733256 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:44.733256 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:44.733256 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:44.733256 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:44.733256 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:44.733256 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:44.733256 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:44.734315 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 19:22:44.734315 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 19:22:44.734315 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 19:22:44.734315 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 19:22:44.734315 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 19:22:44.734315 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 19:22:44.734315 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:22:44.734315 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:44.736287 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 449/873] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Jul 1 19:22:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:22:44.742983 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9684b3-286a-4792-8c30-ad95fdb797ec None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:44.790060 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5855de4d-6bc2-41da-931a-5ad42a728fd5 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:44.791957 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:44.832769 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fba2fc0-dd0e-4293-93e1-0cb49065c974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:44.833803 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba2fc0-dd0e-4293-93e1-0cb49065c974 None admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:44.834332 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba2fc0-dd0e-4293-93e1-0cb49065c974 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:44.834778 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba2fc0-dd0e-4293-93e1-0cb49065c974 None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:44.835689 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fba2fc0-dd0e-4293-93e1-0cb49065c974 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:44.837352 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fba2fc0-dd0e-4293-93e1-0cb49065c974 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:44.856673 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:44.862028 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 425/874] 10.222.0.26 () {60 vars in 1141 bytes} [Fri Jul 1 19:22:44 2022] POST /identity/v3/services => generated 251 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 19:22:44.875289 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9684b3-286a-4792-8c30-ad95fdb797ec None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:44.922384 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2022bb-21ae-462d-bc77-bc5886fc205c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:44.923062 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2022bb-21ae-462d-bc77-bc5886fc205c None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:44.923346 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2022bb-21ae-462d-bc77-bc5886fc205c None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:44.923728 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2022bb-21ae-462d-bc77-bc5886fc205c None admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:44.924532 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2022bb-21ae-462d-bc77-bc5886fc205c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:44.924841 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2022bb-21ae-462d-bc77-bc5886fc205c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:44.926454 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2022bb-21ae-462d-bc77-bc5886fc205c None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:44.942280 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 450/875] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Jul 1 19:22:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:22:44.950476 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fba2fc0-dd0e-4293-93e1-0cb49065c974 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:45.066837 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fba2fc0-dd0e-4293-93e1-0cb49065c974 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:45.103250 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97b6562-86a3-4f8f-9834-db4069dea7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:45.104335 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b6562-86a3-4f8f-9834-db4069dea7a2 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:45.104825 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b6562-86a3-4f8f-9834-db4069dea7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:45.105334 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b6562-86a3-4f8f-9834-db4069dea7a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:45.106930 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97b6562-86a3-4f8f-9834-db4069dea7a2 None admin] RBAC: Adding query filter params (role.id=6cb03785fb184ef587509b3174622f69, scope.project.id=69c523a41f4048cfb7df553b6feb6310, user.id=e958c5b03a9346d59c32675c5271bf3b) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:45.107449 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97b6562-86a3-4f8f-9834-db4069dea7a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:45.109095 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97b6562-86a3-4f8f-9834-db4069dea7a2 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:45.118722 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 426/876] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Jul 1 19:22:44 2022] GET /identity/v3/role_assignments?user.id=e958c5b03a9346d59c32675c5271bf3b&scope.project.id=69c523a41f4048cfb7df553b6feb6310&role.id=6cb03785fb184ef587509b3174622f69 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:45.218603 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ccf5ed-bc56-40f9-83ad-ae1a9fc8bd29 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:45.219133 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ccf5ed-bc56-40f9-83ad-ae1a9fc8bd29 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:45.219241 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ccf5ed-bc56-40f9-83ad-ae1a9fc8bd29 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:45.220831 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 451/877] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:22:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:22:45.226342 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92304e46-5d07-4c5d-9d2f-88a98d83c818 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:45.226701 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92304e46-5d07-4c5d-9d2f-88a98d83c818 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:45.226921 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92304e46-5d07-4c5d-9d2f-88a98d83c818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:45.245549 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-92304e46-5d07-4c5d-9d2f-88a98d83c818 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:22:45.246812 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-92304e46-5d07-4c5d-9d2f-88a98d83c818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:22:45.270622 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:45.324054 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 427/878] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:22:45 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:22:45.351298 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ccf5ed-bc56-40f9-83ad-ae1a9fc8bd29 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:45.462584 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ccf5ed-bc56-40f9-83ad-ae1a9fc8bd29 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:45.498922 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35450c20-5b43-45a6-a721-efeb8adf6646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:45.499732 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35450c20-5b43-45a6-a721-efeb8adf6646 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:45.500126 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35450c20-5b43-45a6-a721-efeb8adf6646 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:45.500408 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35450c20-5b43-45a6-a721-efeb8adf6646 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:45.513111 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35450c20-5b43-45a6-a721-efeb8adf6646 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:22:45.521398 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-35450c20-5b43-45a6-a721-efeb8adf6646 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 01 19:22:45.521398 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:45.521398 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:45.521398 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:45.521398 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:45.521398 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:45.521398 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:45.521398 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:45.521398 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:45.521398 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:45.521398 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:45.521398 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:45.521398 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:22:45.521398 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:22:45.521398 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:22:45.521398 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:22:45.522542 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:22:45.522542 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:22:45.522542 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:22:45.522542 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:22:45.522542 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:45.522542 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:45.522542 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:45.522542 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:45.522542 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:45.522542 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:45.522542 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:45.522542 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:45.522542 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:45.522542 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:45.522542 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:45.522542 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:45.523578 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:45.523578 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:45.523578 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:45.523578 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:45.523578 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:22:45.523578 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:22:45.523578 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:22:45.523578 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:22:45.523578 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:22:45.523578 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:22:45.523578 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 01 19:22:45.523578 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:45.523578 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 452/879] 10.222.0.26 () {56 vars in 1120 bytes} [Fri Jul 1 19:22:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:45.529214 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92304e46-5d07-4c5d-9d2f-88a98d83c818 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:45.636377 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92304e46-5d07-4c5d-9d2f-88a98d83c818 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:45.673851 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9688912b-4df8-4e73-b86a-344bd262b1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:45.674580 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9688912b-4df8-4e73-b86a-344bd262b1ba None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:45.674861 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9688912b-4df8-4e73-b86a-344bd262b1ba None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:45.675188 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9688912b-4df8-4e73-b86a-344bd262b1ba None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:45.676039 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9688912b-4df8-4e73-b86a-344bd262b1ba None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:45.676348 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9688912b-4df8-4e73-b86a-344bd262b1ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:45.678003 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9688912b-4df8-4e73-b86a-344bd262b1ba None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:45.686799 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 428/880] 10.222.0.26 () {56 vars in 1115 bytes} [Fri Jul 1 19:22:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:45.694640 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35450c20-5b43-45a6-a721-efeb8adf6646 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:45.707529 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:45.805265 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35450c20-5b43-45a6-a721-efeb8adf6646 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:45.843881 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9075f1-5cee-40be-8b34-4f27132656ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:45.844680 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9075f1-5cee-40be-8b34-4f27132656ef None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:45.844967 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9075f1-5cee-40be-8b34-4f27132656ef None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:45.845352 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9075f1-5cee-40be-8b34-4f27132656ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:45.857912 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9075f1-5cee-40be-8b34-4f27132656ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:45.859451 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9075f1-5cee-40be-8b34-4f27132656ef None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:45.877634 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-7d9075f1-5cee-40be-8b34-4f27132656ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:45.877634 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:45.877634 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:45.877634 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:45.877634 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:45.877634 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:45.877634 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:45.877634 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:45.877634 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:45.877634 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:45.877634 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:45.877634 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:45.877634 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:22:45.877634 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:22:45.877634 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:22:45.879784 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:22:45.879784 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:45.879784 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:45.879784 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:45.879784 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:45.879784 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:45.879784 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:45.879784 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:45.879784 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:45.879784 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:45.879784 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:45.879784 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:45.879784 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:45.879784 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:45.879784 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:45.879784 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:45.879784 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:45.881942 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:22:45.881942 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:22:45.881942 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:45.881942 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:45.881942 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 453/881] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:22:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:45.890391 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9688912b-4df8-4e73-b86a-344bd262b1ba None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:45.913562 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:45.996098 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9688912b-4df8-4e73-b86a-344bd262b1ba None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:46.043081 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0b6fba-6776-4d5b-ab69-b2be60e81316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:46.044271 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b6fba-6776-4d5b-ab69-b2be60e81316 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:46.044747 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b6fba-6776-4d5b-ab69-b2be60e81316 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:46.045211 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b6fba-6776-4d5b-ab69-b2be60e81316 None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:46.046148 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0b6fba-6776-4d5b-ab69-b2be60e81316 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:46.046642 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0b6fba-6776-4d5b-ab69-b2be60e81316 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:46.048203 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0b6fba-6776-4d5b-ab69-b2be60e81316 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:46.061850 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 429/882] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Jul 1 19:22:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:46.067658 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9075f1-5cee-40be-8b34-4f27132656ef None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:46.133548 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:46.177344 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9075f1-5cee-40be-8b34-4f27132656ef None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:46.213639 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03bd15e-afc8-4235-b618-abc5c6c96f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:46.214778 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03bd15e-afc8-4235-b618-abc5c6c96f88 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:46.215247 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03bd15e-afc8-4235-b618-abc5c6c96f88 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:46.215722 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03bd15e-afc8-4235-b618-abc5c6c96f88 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:46.223785 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03bd15e-afc8-4235-b618-abc5c6c96f88 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:46.226502 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03bd15e-afc8-4235-b618-abc5c6c96f88 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:46.242212 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-e03bd15e-afc8-4235-b618-abc5c6c96f88 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 01 19:22:46.242212 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:46.242212 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:46.242212 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:46.242212 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:46.242212 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:46.242212 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:46.242212 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:46.242212 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:46.242212 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:46.242212 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:46.242212 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:46.242212 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 19:22:46.242212 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 19:22:46.242212 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 19:22:46.242212 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 19:22:46.243197 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:46.243197 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:46.243197 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 19:22:46.243197 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:22:46.243197 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 19:22:46.243197 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:22:46.243197 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:46.243197 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:46.243197 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:46.243197 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:46.243197 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:46.243197 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:46.243197 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:46.243197 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:46.243197 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:46.243197 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:46.243197 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:46.243197 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:46.244161 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:46.244161 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:46.244161 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 19:22:46.244161 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 19:22:46.244161 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 19:22:46.244161 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 19:22:46.244161 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 19:22:46.244161 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 19:22:46.244161 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 01 19:22:46.244161 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:46.244161 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 454/883] 10.222.0.26 () {56 vars in 1117 bytes} [Fri Jul 1 19:22:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:46.251511 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0b6fba-6776-4d5b-ab69-b2be60e81316 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:46.334886 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:46.357854 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0b6fba-6776-4d5b-ab69-b2be60e81316 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:46.395776 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6cb621-9dcf-4315-ba1d-61217c79b605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:46.396864 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6cb621-9dcf-4315-ba1d-61217c79b605 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:46.397459 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6cb621-9dcf-4315-ba1d-61217c79b605 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:46.397957 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6cb621-9dcf-4315-ba1d-61217c79b605 None admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:46.399006 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6cb621-9dcf-4315-ba1d-61217c79b605 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:46.399519 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6cb621-9dcf-4315-ba1d-61217c79b605 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:46.401266 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6cb621-9dcf-4315-ba1d-61217c79b605 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:46.420394 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 430/884] 10.222.0.26 () {56 vars in 1149 bytes} [Fri Jul 1 19:22:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:46.426023 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc93d593-70e2-44b1-9e78-4290ed823c58 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:46.426318 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc93d593-70e2-44b1-9e78-4290ed823c58 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:46.426603 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc93d593-70e2-44b1-9e78-4290ed823c58 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:46.427015 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6cb621-9dcf-4315-ba1d-61217c79b605 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:46.428513 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 455/885] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:22:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:22:46.433423 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642afdaa-2ffc-4c0e-b980-98582ae11c37 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:46.433717 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642afdaa-2ffc-4c0e-b980-98582ae11c37 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:46.434000 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642afdaa-2ffc-4c0e-b980-98582ae11c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:46.453027 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-642afdaa-2ffc-4c0e-b980-98582ae11c37 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:22:46.454274 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-642afdaa-2ffc-4c0e-b980-98582ae11c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:22:46.541496 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6cb621-9dcf-4315-ba1d-61217c79b605 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:46.547446 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 456/886] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:22:46 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 01 19:22:46.574179 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642afdaa-2ffc-4c0e-b980-98582ae11c37 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:46.588223 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaca1136-db09-4d9e-95fa-ac67919576eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:46.588874 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca1136-db09-4d9e-95fa-ac67919576eb None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:46.589160 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca1136-db09-4d9e-95fa-ac67919576eb None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:46.589480 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca1136-db09-4d9e-95fa-ac67919576eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:46.594722 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:46.651088 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:46.684902 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaca1136-db09-4d9e-95fa-ac67919576eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:46.686915 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaca1136-db09-4d9e-95fa-ac67919576eb None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:46.707044 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642afdaa-2ffc-4c0e-b980-98582ae11c37 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:46.750633 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f5631-42ab-4147-87eb-00f065636d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:46.751610 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f5631-42ab-4147-87eb-00f065636d6c None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:46.751996 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f5631-42ab-4147-87eb-00f065636d6c None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:46.752379 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f5631-42ab-4147-87eb-00f065636d6c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:46.753193 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0f5631-42ab-4147-87eb-00f065636d6c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:46.757682 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0f5631-42ab-4147-87eb-00f065636d6c None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:46.775184 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-7e0f5631-42ab-4147-87eb-00f065636d6c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 01 19:22:46.775184 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:46.775184 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 19:22:46.775184 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 19:22:46.775184 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 19:22:46.775184 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 19:22:46.775184 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 19:22:46.775184 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:22:46.775184 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 01 19:22:46.775184 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:46.775184 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 19:22:46.775184 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:46.775184 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:46.775184 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:46.775184 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:46.775184 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:46.776198 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:46.776198 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:46.776198 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:46.776198 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:46.776198 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:46.776198 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:46.776198 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:46.776198 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 19:22:46.776198 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 19:22:46.776198 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 19:22:46.776198 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 19:22:46.776198 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:46.776198 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:46.776198 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:46.776198 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:46.776198 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:46.777043 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:46.777043 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:46.777043 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:46.777043 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:46.777043 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:46.777043 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:46.777043 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:46.777043 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:46.777043 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:46.777043 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:46.777043 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:46.777043 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 19:22:46.777043 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:22:46.777043 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 01 19:22:46.777043 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:46.781382 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 457/887] 10.222.0.26 () {56 vars in 1132 bytes} [Fri Jul 1 19:22:46 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:46.784222 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f5631-42ab-4147-87eb-00f065636d6c None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:46.819844 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 431/888] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Jul 1 19:22:46 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 01 19:22:46.821348 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaca1136-db09-4d9e-95fa-ac67919576eb None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:46.857671 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:46.907194 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f5631-42ab-4147-87eb-00f065636d6c None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:46.922301 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:46.930639 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaca1136-db09-4d9e-95fa-ac67919576eb None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:46.945862 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a235463c-821f-4bc5-a80b-7ec2eb38e0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:46.946752 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a235463c-821f-4bc5-a80b-7ec2eb38e0da None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:46.947192 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a235463c-821f-4bc5-a80b-7ec2eb38e0da None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:46.947647 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a235463c-821f-4bc5-a80b-7ec2eb38e0da None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:46.948561 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a235463c-821f-4bc5-a80b-7ec2eb38e0da None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:46.949068 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a235463c-821f-4bc5-a80b-7ec2eb38e0da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:46.951227 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a235463c-821f-4bc5-a80b-7ec2eb38e0da None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:46.961248 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 458/889] 10.222.0.26 () {56 vars in 1126 bytes} [Fri Jul 1 19:22:46 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:46.962380 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a235463c-821f-4bc5-a80b-7ec2eb38e0da None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:46.969532 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5dfae1-1cae-4c80-bdbf-4b99c74f73a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:46.970432 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5dfae1-1cae-4c80-bdbf-4b99c74f73a0 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:46.970790 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5dfae1-1cae-4c80-bdbf-4b99c74f73a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:46.971138 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5dfae1-1cae-4c80-bdbf-4b99c74f73a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:46.982627 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5dfae1-1cae-4c80-bdbf-4b99c74f73a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:46.984188 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5dfae1-1cae-4c80-bdbf-4b99c74f73a0 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:47.003815 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-8f5dfae1-1cae-4c80-bdbf-4b99c74f73a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:47.003815 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:47.003815 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:47.003815 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:47.003815 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:47.003815 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:47.003815 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:47.003815 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:47.003815 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:47.003815 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:47.003815 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:47.003815 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:47.003815 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:22:47.003815 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:22:47.003815 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:22:47.004857 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:22:47.004857 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:47.004857 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:47.004857 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:47.004857 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:47.004857 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:47.004857 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:47.004857 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:47.004857 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:47.004857 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:47.004857 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:47.004857 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:47.004857 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:47.004857 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:47.004857 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:47.004857 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:47.004857 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:47.005825 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:22:47.005825 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:22:47.005825 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:47.005825 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:47.009794 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 432/890] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:22:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:22:47.010679 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5dfae1-1cae-4c80-bdbf-4b99c74f73a0 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:47.075677 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a235463c-821f-4bc5-a80b-7ec2eb38e0da None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:47.101840 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:47.112947 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1ada7-6b69-48c7-b699-8522133a9f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:47.113654 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1ada7-6b69-48c7-b699-8522133a9f88 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:47.113944 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1ada7-6b69-48c7-b699-8522133a9f88 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:47.114226 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1ada7-6b69-48c7-b699-8522133a9f88 None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:47.114936 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c1ada7-6b69-48c7-b699-8522133a9f88 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:47.115248 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c1ada7-6b69-48c7-b699-8522133a9f88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:47.116620 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c1ada7-6b69-48c7-b699-8522133a9f88 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:47.117166 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5dfae1-1cae-4c80-bdbf-4b99c74f73a0 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:47.121670 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 459/891] 10.222.0.26 () {56 vars in 1126 bytes} [Fri Jul 1 19:22:46 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:47.123427 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494bf837-64ed-4b3a-a390-bf2dd46e761a None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:47.123717 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494bf837-64ed-4b3a-a390-bf2dd46e761a None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:47.123997 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494bf837-64ed-4b3a-a390-bf2dd46e761a None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:47.125701 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 460/892] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:22:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:22:47.130950 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176320eb-cd94-436b-bbc5-94ddb1eda149 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:47.131247 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176320eb-cd94-436b-bbc5-94ddb1eda149 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:47.131648 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176320eb-cd94-436b-bbc5-94ddb1eda149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:47.148795 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-176320eb-cd94-436b-bbc5-94ddb1eda149 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:22:47.150010 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-176320eb-cd94-436b-bbc5-94ddb1eda149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:22:47.159701 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fa438e-114f-4d70-b9af-ff016ddfb261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:47.160473 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa438e-114f-4d70-b9af-ff016ddfb261 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:47.160766 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa438e-114f-4d70-b9af-ff016ddfb261 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:47.161051 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa438e-114f-4d70-b9af-ff016ddfb261 None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:47.161813 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fa438e-114f-4d70-b9af-ff016ddfb261 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:47.162127 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fa438e-114f-4d70-b9af-ff016ddfb261 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:47.163509 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fa438e-114f-4d70-b9af-ff016ddfb261 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:47.175817 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 433/893] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Jul 1 19:22:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:47.176635 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fa438e-114f-4d70-b9af-ff016ddfb261 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:47.196033 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:47.230046 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 461/894] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:22:47 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 01 19:22:47.238189 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176320eb-cd94-436b-bbc5-94ddb1eda149 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:47.290912 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fa438e-114f-4d70-b9af-ff016ddfb261 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:47.328112 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001742a5-1323-49e5-82f4-9eb685c974ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:47.328773 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001742a5-1323-49e5-82f4-9eb685c974ad None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:47.329059 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001742a5-1323-49e5-82f4-9eb685c974ad None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:47.329376 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001742a5-1323-49e5-82f4-9eb685c974ad None admin] PATH_INFO: `/v3/endpoints` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:47.330242 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001742a5-1323-49e5-82f4-9eb685c974ad None admin] RBAC: Adding query filter params (interface=public, service_id=24a4bc7aa7cd48bdb83edfcaa3504d37, region_id=RegionOne) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:47.330562 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001742a5-1323-49e5-82f4-9eb685c974ad None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:47.331937 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001742a5-1323-49e5-82f4-9eb685c974ad None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:47.336964 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 434/895] 10.222.0.26 () {56 vars in 1251 bytes} [Fri Jul 1 19:22:47 2022] GET /identity/v3/endpoints?service_id=24a4bc7aa7cd48bdb83edfcaa3504d37&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:47.337777 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001742a5-1323-49e5-82f4-9eb685c974ad None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:47.345885 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176320eb-cd94-436b-bbc5-94ddb1eda149 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:47.355376 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:47.381003 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a8c7a-3ff2-4408-8466-0898e39ceea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:47.381820 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a8c7a-3ff2-4408-8466-0898e39ceea1 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:47.382107 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a8c7a-3ff2-4408-8466-0898e39ceea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:47.382388 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a8c7a-3ff2-4408-8466-0898e39ceea1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:47.389277 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206a8c7a-3ff2-4408-8466-0898e39ceea1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:47.390733 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206a8c7a-3ff2-4408-8466-0898e39ceea1 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:47.404962 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-206a8c7a-3ff2-4408-8466-0898e39ceea1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:22:47.404962 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:47.404962 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:47.404962 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:47.404962 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:47.404962 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:47.404962 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:47.404962 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:47.404962 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:47.404962 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:47.404962 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:47.404962 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:47.404962 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 19:22:47.404962 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 19:22:47.404962 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 19:22:47.405896 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 19:22:47.405896 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:47.405896 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:47.405896 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:47.405896 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:47.405896 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:47.405896 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:47.405896 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:47.405896 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:47.405896 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:47.405896 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:47.405896 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:47.405896 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:47.405896 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:47.405896 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:47.405896 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:47.405896 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:47.406781 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 19:22:47.406781 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 19:22:47.406781 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 19:22:47.406781 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 19:22:47.406781 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 19:22:47.406781 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 19:22:47.406781 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:22:47.406781 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:47.406781 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 462/896] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Jul 1 19:22:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:47.407677 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c2e9f-45fd-4aeb-b82e-c37db36ef0a2 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:47.407677 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c2e9f-45fd-4aeb-b82e-c37db36ef0a2 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:47.407905 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c2e9f-45fd-4aeb-b82e-c37db36ef0a2 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:47.409155 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 463/897] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:22:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:22:47.409980 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c2e9f-45fd-4aeb-b82e-c37db36ef0a2 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:47.441551 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:47.447116 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001742a5-1323-49e5-82f4-9eb685c974ad None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:47.482581 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3ea41c-32a9-4d8e-85d1-d0e1153b9479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:47.482763 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ea41c-32a9-4d8e-85d1-d0e1153b9479 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:47.483032 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ea41c-32a9-4d8e-85d1-d0e1153b9479 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:47.483311 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ea41c-32a9-4d8e-85d1-d0e1153b9479 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:47.483963 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3ea41c-32a9-4d8e-85d1-d0e1153b9479 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:47.485366 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3ea41c-32a9-4d8e-85d1-d0e1153b9479 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:47.497480 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-bc3ea41c-32a9-4d8e-85d1-d0e1153b9479 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 01 19:22:47.497480 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:47.497480 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 19:22:47.497480 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 19:22:47.497480 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 19:22:47.497480 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 19:22:47.497480 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 19:22:47.497480 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:22:47.497480 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 01 19:22:47.497480 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:47.497480 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 19:22:47.497480 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:47.497480 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:47.497480 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:47.497480 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:47.497480 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:47.497480 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:47.498543 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:47.498543 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:47.498543 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:47.498543 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:47.498543 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:47.498543 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:47.498543 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 19:22:47.498543 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 19:22:47.498543 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 19:22:47.498543 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 19:22:47.498543 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:47.498543 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:47.498543 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:47.498543 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:47.498543 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:47.498543 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:47.499396 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:47.499396 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:47.499396 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:47.499396 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:47.499396 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:47.499396 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:47.499396 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:47.499396 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:47.499396 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:47.499396 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:47.499396 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 19:22:47.499396 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:22:47.499396 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 01 19:22:47.499396 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:47.499396 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 435/898] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Jul 1 19:22:47 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:47.500185 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3ea41c-32a9-4d8e-85d1-d0e1153b9479 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:47.514881 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c2e9f-45fd-4aeb-b82e-c37db36ef0a2 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:47.550144 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954d3852-b9ed-410c-bdbc-addc74ff28aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:47.550883 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954d3852-b9ed-410c-bdbc-addc74ff28aa None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:47.551171 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954d3852-b9ed-410c-bdbc-addc74ff28aa None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:47.551454 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954d3852-b9ed-410c-bdbc-addc74ff28aa None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:47.552140 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954d3852-b9ed-410c-bdbc-addc74ff28aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:47.553802 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954d3852-b9ed-410c-bdbc-addc74ff28aa None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:47.559426 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 464/899] 10.222.0.26 () {56 vars in 1087 bytes} [Fri Jul 1 19:22:47 2022] GET /identity/v3/services => generated 1268 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:22:47.560587 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09248783-5e1c-4441-bad4-b86e520c7cc7 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:47.560881 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09248783-5e1c-4441-bad4-b86e520c7cc7 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:47.561163 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09248783-5e1c-4441-bad4-b86e520c7cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:47.578809 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-09248783-5e1c-4441-bad4-b86e520c7cc7 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:22:47.580049 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-09248783-5e1c-4441-bad4-b86e520c7cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:22:47.592817 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:47.620287 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3ea41c-32a9-4d8e-85d1-d0e1153b9479 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:47.661768 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd8a242-7b50-42ec-bb96-f6778f412048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:47.662631 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd8a242-7b50-42ec-bb96-f6778f412048 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:47.662915 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd8a242-7b50-42ec-bb96-f6778f412048 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:47.663190 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd8a242-7b50-42ec-bb96-f6778f412048 None admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:47.663981 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd8a242-7b50-42ec-bb96-f6778f412048 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:47.664474 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 465/900] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:22:47 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:22:47.665219 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09248783-5e1c-4441-bad4-b86e520c7cc7 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:47.673430 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd8a242-7b50-42ec-bb96-f6778f412048 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:47.676061 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd8a242-7b50-42ec-bb96-f6778f412048 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:47.693153 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 436/901] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Jul 1 19:22:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:47.694393 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd8a242-7b50-42ec-bb96-f6778f412048 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:47.699042 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:47.777872 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09248783-5e1c-4441-bad4-b86e520c7cc7 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:47.809915 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd8a242-7b50-42ec-bb96-f6778f412048 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:47.815182 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e8369c-098d-4ea2-b599-8c0cadf07ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:47.815850 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e8369c-098d-4ea2-b599-8c0cadf07ed1 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:47.816269 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e8369c-098d-4ea2-b599-8c0cadf07ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:47.816479 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e8369c-098d-4ea2-b599-8c0cadf07ed1 None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:47.817189 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e8369c-098d-4ea2-b599-8c0cadf07ed1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:47.817954 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e8369c-098d-4ea2-b599-8c0cadf07ed1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:47.819329 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e8369c-098d-4ea2-b599-8c0cadf07ed1 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:47.826020 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 466/902] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Jul 1 19:22:47 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:47.830123 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e8369c-098d-4ea2-b599-8c0cadf07ed1 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:47.846465 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f9f83-7c5c-4a32-b0bf-db33b0c5886c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:47.847316 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f9f83-7c5c-4a32-b0bf-db33b0c5886c None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:47.847633 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f9f83-7c5c-4a32-b0bf-db33b0c5886c None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:47.847913 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f9f83-7c5c-4a32-b0bf-db33b0c5886c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:47.848569 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0f9f83-7c5c-4a32-b0bf-db33b0c5886c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:47.849986 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0f9f83-7c5c-4a32-b0bf-db33b0c5886c None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:47.852592 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:47.864067 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-1c0f9f83-7c5c-4a32-b0bf-db33b0c5886c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 01 19:22:47.864067 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:47.864067 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 19:22:47.864067 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 19:22:47.864067 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 19:22:47.864067 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 19:22:47.864067 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 19:22:47.864067 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:22:47.864067 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 01 19:22:47.864067 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:47.864067 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 19:22:47.864067 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:47.864067 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:47.864067 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:47.864067 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:47.864067 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:47.864067 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:47.865082 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:47.865082 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:47.865082 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:47.865082 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:47.865082 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:47.865082 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:47.865082 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 19:22:47.865082 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 19:22:47.865082 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 19:22:47.865082 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 19:22:47.865082 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:47.865082 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:47.865082 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:47.865082 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:47.865082 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:47.865082 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:47.865989 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:47.865989 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:47.865989 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:47.865989 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:47.865989 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:47.865989 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:47.865989 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:47.865989 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:47.865989 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:47.865989 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:47.865989 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 19:22:47.865989 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:22:47.865989 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 01 19:22:47.865989 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:47.870492 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 437/903] 10.222.0.26 () {56 vars in 1126 bytes} [Fri Jul 1 19:22:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:47.871385 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f9f83-7c5c-4a32-b0bf-db33b0c5886c None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:47.935889 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:47.947501 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e8369c-098d-4ea2-b599-8c0cadf07ed1 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:47.981712 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f9f83-7c5c-4a32-b0bf-db33b0c5886c None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:47.986581 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a5a886-f889-43bd-97f7-cf271aba1388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:47.987238 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5a886-f889-43bd-97f7-cf271aba1388 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:47.987532 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5a886-f889-43bd-97f7-cf271aba1388 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:47.987819 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5a886-f889-43bd-97f7-cf271aba1388 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:47.988858 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a5a886-f889-43bd-97f7-cf271aba1388 None admin] RBAC: Adding query filter params (role.id=6ce8e2867947472c8b441d47e4a4e28f, scope.project.id=69c523a41f4048cfb7df553b6feb6310, user.id=0834256bdfbc48ffbc5af6d6760ecdd9) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:47.989185 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a5a886-f889-43bd-97f7-cf271aba1388 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:47.990642 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a5a886-f889-43bd-97f7-cf271aba1388 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:47.996256 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 467/904] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Jul 1 19:22:47 2022] GET /identity/v3/role_assignments?user.id=0834256bdfbc48ffbc5af6d6760ecdd9&scope.project.id=69c523a41f4048cfb7df553b6feb6310&role.id=6ce8e2867947472c8b441d47e4a4e28f => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:47.997069 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a5a886-f889-43bd-97f7-cf271aba1388 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:48.031691 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e18b86e-4e61-4601-a274-284aabe99fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:48.032704 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e18b86e-4e61-4601-a274-284aabe99fe8 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:48.033163 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e18b86e-4e61-4601-a274-284aabe99fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:48.033778 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e18b86e-4e61-4601-a274-284aabe99fe8 None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:48.034502 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e18b86e-4e61-4601-a274-284aabe99fe8 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:48.034818 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e18b86e-4e61-4601-a274-284aabe99fe8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:48.036235 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e18b86e-4e61-4601-a274-284aabe99fe8 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:48.047084 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 438/905] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Jul 1 19:22:47 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:48.048739 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e18b86e-4e61-4601-a274-284aabe99fe8 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:48.132904 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:48.156909 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a5a886-f889-43bd-97f7-cf271aba1388 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:48.195826 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e18b86e-4e61-4601-a274-284aabe99fe8 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:48.204790 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5156dfea-a2ee-4306-99f9-ef310eb04eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:48.205776 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5156dfea-a2ee-4306-99f9-ef310eb04eb9 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:48.206789 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5156dfea-a2ee-4306-99f9-ef310eb04eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:48.207367 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5156dfea-a2ee-4306-99f9-ef310eb04eb9 None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:48.208999 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5156dfea-a2ee-4306-99f9-ef310eb04eb9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:48.209553 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5156dfea-a2ee-4306-99f9-ef310eb04eb9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:48.211901 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5156dfea-a2ee-4306-99f9-ef310eb04eb9 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:48.219507 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 468/906] 10.222.0.26 () {56 vars in 1122 bytes} [Fri Jul 1 19:22:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:48.225498 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5156dfea-a2ee-4306-99f9-ef310eb04eb9 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:48.238050 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a9c1f1-fa59-4b89-bedc-606cc1278982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:48.238677 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a9c1f1-fa59-4b89-bedc-606cc1278982 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:48.238963 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a9c1f1-fa59-4b89-bedc-606cc1278982 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:48.239798 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a9c1f1-fa59-4b89-bedc-606cc1278982 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:48.240837 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a9c1f1-fa59-4b89-bedc-606cc1278982 None admin] RBAC: Adding query filter params (interface=public, service_id=e3d9662411504336a4158142aaec726c, region_id=RegionOne) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:48.241388 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a9c1f1-fa59-4b89-bedc-606cc1278982 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:48.243389 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a9c1f1-fa59-4b89-bedc-606cc1278982 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:48.253266 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 439/907] 10.222.0.26 () {56 vars in 1251 bytes} [Fri Jul 1 19:22:48 2022] GET /identity/v3/endpoints?service_id=e3d9662411504336a4158142aaec726c&interface=public®ion_id=RegionOne => generated 194 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:48.256956 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a9c1f1-fa59-4b89-bedc-606cc1278982 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:48.258436 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:48.348770 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5156dfea-a2ee-4306-99f9-ef310eb04eb9 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:48.383301 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a9c1f1-fa59-4b89-bedc-606cc1278982 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:48.385147 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2ac61b-da09-4e5a-9395-66919b1686e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:48.386075 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ac61b-da09-4e5a-9395-66919b1686e1 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:48.386553 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ac61b-da09-4e5a-9395-66919b1686e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:48.387035 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ac61b-da09-4e5a-9395-66919b1686e1 None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:48.388533 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2ac61b-da09-4e5a-9395-66919b1686e1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:48.389039 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2ac61b-da09-4e5a-9395-66919b1686e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:48.390614 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2ac61b-da09-4e5a-9395-66919b1686e1 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:48.401404 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 469/908] 10.222.0.26 () {56 vars in 1122 bytes} [Fri Jul 1 19:22:48 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:48.412826 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:48.422069 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e144a164-6da9-4742-98a7-06a44f75c1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:48.422755 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e144a164-6da9-4742-98a7-06a44f75c1aa None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:48.423033 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e144a164-6da9-4742-98a7-06a44f75c1aa None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:48.423316 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e144a164-6da9-4742-98a7-06a44f75c1aa None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:48.424014 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e144a164-6da9-4742-98a7-06a44f75c1aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:48.426050 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e144a164-6da9-4742-98a7-06a44f75c1aa None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:48.433375 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 440/909] 10.222.0.26 () {56 vars in 1087 bytes} [Fri Jul 1 19:22:48 2022] GET /identity/v3/services => generated 1268 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:22:49.683788 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc39b26-a50e-4e63-8777-580b908d3272 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:49.684360 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc39b26-a50e-4e63-8777-580b908d3272 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:49.684360 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc39b26-a50e-4e63-8777-580b908d3272 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:49.686069 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 470/910] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:22:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:22:49.691423 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0643095-d339-4100-a4a3-54bdccd6d8e9 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:49.691832 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0643095-d339-4100-a4a3-54bdccd6d8e9 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:49.692001 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0643095-d339-4100-a4a3-54bdccd6d8e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:49.708626 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-c0643095-d339-4100-a4a3-54bdccd6d8e9 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:22:49.709851 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-c0643095-d339-4100-a4a3-54bdccd6d8e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:22:49.782286 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 441/911] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:22:49 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:22:49.806325 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc39b26-a50e-4e63-8777-580b908d3272 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:49.892638 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:49.914052 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc39b26-a50e-4e63-8777-580b908d3272 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:49.950415 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06410a53-5f15-488d-878b-ae164e376933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:49.951232 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06410a53-5f15-488d-878b-ae164e376933 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:49.951519 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06410a53-5f15-488d-878b-ae164e376933 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:49.951798 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06410a53-5f15-488d-878b-ae164e376933 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:49.952461 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06410a53-5f15-488d-878b-ae164e376933 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:49.953861 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06410a53-5f15-488d-878b-ae164e376933 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:49.966359 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-06410a53-5f15-488d-878b-ae164e376933 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 01 19:22:49.966359 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:49.966359 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 19:22:49.966359 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 19:22:49.966359 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 19:22:49.966359 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 19:22:49.966359 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 19:22:49.966359 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:22:49.966359 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 01 19:22:49.966359 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:49.966359 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 19:22:49.966359 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:49.966359 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:49.966359 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:49.966359 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:49.966359 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:49.967286 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:49.967286 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:49.967286 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:49.967286 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:49.967286 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:49.967286 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:49.967286 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:49.967286 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 19:22:49.967286 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 19:22:49.967286 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 19:22:49.967286 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 19:22:49.967286 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:49.967286 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:49.967286 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:49.967286 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:49.967286 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:49.968508 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:49.968508 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:49.968508 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:49.968508 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:49.968508 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:49.968508 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:49.968508 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:49.968508 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:49.968508 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:49.968508 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:49.968508 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:49.968508 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 19:22:49.968508 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:22:49.968508 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 01 19:22:49.968508 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:49.968508 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 471/912] 10.222.0.26 () {56 vars in 1132 bytes} [Fri Jul 1 19:22:49 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:49.973907 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0643095-d339-4100-a4a3-54bdccd6d8e9 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:50.081794 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0643095-d339-4100-a4a3-54bdccd6d8e9 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:50.109033 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:50.122970 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0144eea-f48e-4b9c-ac9e-080b37eb1192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:50.124006 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0144eea-f48e-4b9c-ac9e-080b37eb1192 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:50.124488 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0144eea-f48e-4b9c-ac9e-080b37eb1192 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:50.125005 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0144eea-f48e-4b9c-ac9e-080b37eb1192 None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:50.125946 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0144eea-f48e-4b9c-ac9e-080b37eb1192 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:50.126467 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0144eea-f48e-4b9c-ac9e-080b37eb1192 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:50.128054 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0144eea-f48e-4b9c-ac9e-080b37eb1192 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:50.133952 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 442/913] 10.222.0.26 () {56 vars in 1126 bytes} [Fri Jul 1 19:22:49 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:50.143333 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06410a53-5f15-488d-878b-ae164e376933 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:50.153699 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3ff8a-74c3-48b6-b8e1-8377edd8aca9 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:50.154003 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3ff8a-74c3-48b6-b8e1-8377edd8aca9 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:50.154271 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3ff8a-74c3-48b6-b8e1-8377edd8aca9 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:50.155939 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 443/914] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:22:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 19:22:50.162310 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07c056-8644-4e19-8515-360f1762245b None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:50.162599 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07c056-8644-4e19-8515-360f1762245b None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:50.162879 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07c056-8644-4e19-8515-360f1762245b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:50.185929 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-ce07c056-8644-4e19-8515-360f1762245b None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:22:50.189510 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-ce07c056-8644-4e19-8515-360f1762245b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:22:50.263315 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 444/915] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:22:50 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 01 19:22:50.276522 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06410a53-5f15-488d-878b-ae164e376933 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:50.285811 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce07c056-8644-4e19-8515-360f1762245b None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:50.315021 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddad5cf0-d518-4d99-b1ab-1ec096ce696c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:50.315974 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad5cf0-d518-4d99-b1ab-1ec096ce696c None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:50.316544 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad5cf0-d518-4d99-b1ab-1ec096ce696c None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:50.317023 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad5cf0-d518-4d99-b1ab-1ec096ce696c None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:50.318015 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddad5cf0-d518-4d99-b1ab-1ec096ce696c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:50.318553 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddad5cf0-d518-4d99-b1ab-1ec096ce696c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:50.320116 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddad5cf0-d518-4d99-b1ab-1ec096ce696c None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:50.327651 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 472/916] 10.222.0.26 () {56 vars in 1126 bytes} [Fri Jul 1 19:22:50 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:50.333704 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddad5cf0-d518-4d99-b1ab-1ec096ce696c None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:50.348714 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:50.388989 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce07c056-8644-4e19-8515-360f1762245b None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:50.406427 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:50.425419 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91486be5-3963-4fae-88af-f882f764d814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:50.426279 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91486be5-3963-4fae-88af-f882f764d814 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:50.426630 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91486be5-3963-4fae-88af-f882f764d814 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:50.426986 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91486be5-3963-4fae-88af-f882f764d814 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:50.438338 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91486be5-3963-4fae-88af-f882f764d814 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:22:50.446703 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-91486be5-3963-4fae-88af-f882f764d814 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 01 19:22:50.446703 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:50.446703 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:50.446703 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:50.446703 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:50.446703 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:50.446703 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:50.446703 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:50.446703 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:50.446703 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:50.446703 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:50.446703 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:50.446703 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:22:50.446703 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:22:50.446703 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:22:50.446703 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:22:50.447667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:22:50.447667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:22:50.447667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:22:50.447667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:22:50.447667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:50.447667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:50.447667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:50.447667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:50.447667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:50.447667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:50.447667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:50.447667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:50.447667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:50.447667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:50.447667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:50.447667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:50.448510 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:50.448510 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:50.448510 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:50.448510 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:50.448510 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:22:50.448510 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:22:50.448510 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:22:50.448510 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:22:50.448510 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:22:50.448510 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:22:50.448510 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 01 19:22:50.448510 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:50.452919 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 445/917] 10.222.0.26 () {56 vars in 1120 bytes} [Fri Jul 1 19:22:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:22:50.454309 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91486be5-3963-4fae-88af-f882f764d814 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:50.459418 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddad5cf0-d518-4d99-b1ab-1ec096ce696c None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:50.500540 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57994fe-497d-4a55-bcbb-03952953bc06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:50.501734 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57994fe-497d-4a55-bcbb-03952953bc06 None admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:50.502255 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57994fe-497d-4a55-bcbb-03952953bc06 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:50.502845 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57994fe-497d-4a55-bcbb-03952953bc06 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:50.504027 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57994fe-497d-4a55-bcbb-03952953bc06 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:50.506141 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57994fe-497d-4a55-bcbb-03952953bc06 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:50.533301 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 473/918] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Jul 1 19:22:50 2022] POST /identity/v3/endpoints => generated 347 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 19:22:50.533301 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066fbcc8-fca2-4456-9cb3-9eb3d28873a4 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:50.533301 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066fbcc8-fca2-4456-9cb3-9eb3d28873a4 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:50.533301 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066fbcc8-fca2-4456-9cb3-9eb3d28873a4 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:50.533725 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 474/919] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:22:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:22:50.540062 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29385025-4589-4528-9a52-764b426597a6 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:50.540368 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29385025-4589-4528-9a52-764b426597a6 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:50.540616 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29385025-4589-4528-9a52-764b426597a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:50.560551 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-29385025-4589-4528-9a52-764b426597a6 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:22:50.561843 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-29385025-4589-4528-9a52-764b426597a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:22:50.569883 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91486be5-3963-4fae-88af-f882f764d814 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:50.615612 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb09c5a-bc3f-4fa6-937f-df8103eddeb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:50.616984 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb09c5a-bc3f-4fa6-937f-df8103eddeb2 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:50.616984 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb09c5a-bc3f-4fa6-937f-df8103eddeb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:50.616984 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb09c5a-bc3f-4fa6-937f-df8103eddeb2 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:50.617579 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb09c5a-bc3f-4fa6-937f-df8103eddeb2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:50.617921 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb09c5a-bc3f-4fa6-937f-df8103eddeb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:50.619687 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb09c5a-bc3f-4fa6-937f-df8103eddeb2 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:50.630230 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 446/920] 10.222.0.26 () {56 vars in 1115 bytes} [Fri Jul 1 19:22:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:22:50.631591 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a412f-25eb-4ef9-a543-365acb88e07b None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:50.631875 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a412f-25eb-4ef9-a543-365acb88e07b None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:50.632147 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a412f-25eb-4ef9-a543-365acb88e07b None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:50.636907 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 447/921] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:22:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:22:50.639693 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383c163-3488-43f5-bb72-94184d94424a None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:50.639974 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383c163-3488-43f5-bb72-94184d94424a None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:50.640252 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383c163-3488-43f5-bb72-94184d94424a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:50.654314 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:50.658339 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-a383c163-3488-43f5-bb72-94184d94424a None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:22:50.659496 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-a383c163-3488-43f5-bb72-94184d94424a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:22:50.663418 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 475/922] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:22:50 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:22:50.663793 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29385025-4589-4528-9a52-764b426597a6 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:50.698161 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:50.748748 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 448/923] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:22:50 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 01 19:22:50.750526 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a383c163-3488-43f5-bb72-94184d94424a None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:50.788325 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29385025-4589-4528-9a52-764b426597a6 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:50.828731 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a7690a-388e-4c4f-80ca-40f67f0951ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:50.829616 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a7690a-388e-4c4f-80ca-40f67f0951ad None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:50.829894 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a7690a-388e-4c4f-80ca-40f67f0951ad None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:50.830165 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a7690a-388e-4c4f-80ca-40f67f0951ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:50.842374 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a7690a-388e-4c4f-80ca-40f67f0951ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:50.843989 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a7690a-388e-4c4f-80ca-40f67f0951ad None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:50.864214 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a383c163-3488-43f5-bb72-94184d94424a None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:50.865974 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-24a7690a-388e-4c4f-80ca-40f67f0951ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:50.865974 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:50.865974 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:50.865974 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:50.865974 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:50.865974 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:50.865974 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:50.865974 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:50.865974 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:50.865974 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:50.865974 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:50.865974 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:50.865974 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:22:50.865974 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:22:50.865974 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:22:50.866856 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:22:50.866856 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:50.866856 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:50.866856 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:50.866856 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:50.866856 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:50.866856 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:50.866856 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:50.866856 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:50.866856 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:50.866856 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:50.866856 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:50.866856 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:50.866856 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:50.866856 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:50.866856 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:50.866856 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:50.867764 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:22:50.867764 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:22:50.867764 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:50.867764 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:50.873223 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 476/924] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:22:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:50.874007 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a7690a-388e-4c4f-80ca-40f67f0951ad None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:50.900637 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c47b1c-b4db-47c1-9cf8-e0a92bffa3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:50.901456 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c47b1c-b4db-47c1-9cf8-e0a92bffa3c1 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:50.901738 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c47b1c-b4db-47c1-9cf8-e0a92bffa3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:50.902011 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c47b1c-b4db-47c1-9cf8-e0a92bffa3c1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:50.902801 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c47b1c-b4db-47c1-9cf8-e0a92bffa3c1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:50.904289 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c47b1c-b4db-47c1-9cf8-e0a92bffa3c1 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:50.916819 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-f2c47b1c-b4db-47c1-9cf8-e0a92bffa3c1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 01 19:22:50.916819 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:50.916819 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 19:22:50.916819 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 19:22:50.916819 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 19:22:50.916819 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 19:22:50.916819 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 19:22:50.916819 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:22:50.916819 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 01 19:22:50.916819 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:50.916819 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 19:22:50.916819 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:50.916819 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:50.916819 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:50.916819 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:50.916819 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:50.916819 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:50.917884 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:50.917884 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:50.917884 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:50.917884 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:50.917884 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:50.917884 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:50.917884 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 19:22:50.917884 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 19:22:50.917884 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 19:22:50.917884 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 19:22:50.917884 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:50.917884 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:50.917884 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:50.917884 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:50.917884 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:50.917884 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:50.919261 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:50.919261 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:50.919261 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:50.919261 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:50.919261 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:50.919261 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:50.919261 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:50.919261 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:50.919261 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:50.919261 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:50.919261 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 19:22:50.919261 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:22:50.919261 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 01 19:22:50.919261 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:50.919261 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 449/925] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Jul 1 19:22:50 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:50.920751 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c47b1c-b4db-47c1-9cf8-e0a92bffa3c1 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:50.931518 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:50.952123 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:50.987971 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a7690a-388e-4c4f-80ca-40f67f0951ad None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:51.026796 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d7976-30ae-4a1a-b093-5ec5b2059562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:51.027454 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d7976-30ae-4a1a-b093-5ec5b2059562 None admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:51.027758 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d7976-30ae-4a1a-b093-5ec5b2059562 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:51.028007 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c47b1c-b4db-47c1-9cf8-e0a92bffa3c1 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:51.028112 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d7976-30ae-4a1a-b093-5ec5b2059562 None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:51.028754 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671d7976-30ae-4a1a-b093-5ec5b2059562 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:51.031256 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671d7976-30ae-4a1a-b093-5ec5b2059562 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:51.057262 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 477/926] 10.222.0.26 () {60 vars in 1141 bytes} [Fri Jul 1 19:22:50 2022] POST /identity/v3/services => generated 241 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:22:51.057262 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d7976-30ae-4a1a-b093-5ec5b2059562 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:51.072459 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4500a708-9d04-4ccb-92fb-c717852822c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:51.073195 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4500a708-9d04-4ccb-92fb-c717852822c1 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:51.073513 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4500a708-9d04-4ccb-92fb-c717852822c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:51.073842 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4500a708-9d04-4ccb-92fb-c717852822c1 None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:51.074572 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4500a708-9d04-4ccb-92fb-c717852822c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:51.074957 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4500a708-9d04-4ccb-92fb-c717852822c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:51.076449 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4500a708-9d04-4ccb-92fb-c717852822c1 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:51.092933 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 450/927] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Jul 1 19:22:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:51.099957 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4500a708-9d04-4ccb-92fb-c717852822c1 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:51.212953 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:51.213914 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d7976-30ae-4a1a-b093-5ec5b2059562 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:51.227591 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:51.240125 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4500a708-9d04-4ccb-92fb-c717852822c1 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:51.271584 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd8fb17-39fd-4fce-a2c6-b65f922faa46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:51.272785 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd8fb17-39fd-4fce-a2c6-b65f922faa46 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:51.273331 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd8fb17-39fd-4fce-a2c6-b65f922faa46 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:51.273976 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd8fb17-39fd-4fce-a2c6-b65f922faa46 None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:51.275304 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd8fb17-39fd-4fce-a2c6-b65f922faa46 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:51.275895 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd8fb17-39fd-4fce-a2c6-b65f922faa46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:51.278213 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd8fb17-39fd-4fce-a2c6-b65f922faa46 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:51.284285 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 478/928] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Jul 1 19:22:51 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:51.284497 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48918c5-56e3-4db1-a8f8-0b2fcd30a01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:51.285475 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48918c5-56e3-4db1-a8f8-0b2fcd30a01f None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:51.285776 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48918c5-56e3-4db1-a8f8-0b2fcd30a01f None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:51.286057 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48918c5-56e3-4db1-a8f8-0b2fcd30a01f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:51.290464 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd8fb17-39fd-4fce-a2c6-b65f922faa46 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:51.297929 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48918c5-56e3-4db1-a8f8-0b2fcd30a01f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:51.299407 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48918c5-56e3-4db1-a8f8-0b2fcd30a01f None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:51.316969 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-b48918c5-56e3-4db1-a8f8-0b2fcd30a01f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 01 19:22:51.316969 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:51.316969 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:51.316969 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:51.316969 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:51.316969 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:51.316969 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:51.316969 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:51.316969 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:51.316969 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:51.316969 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:51.316969 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:51.316969 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 19:22:51.316969 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 19:22:51.316969 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 19:22:51.316969 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 19:22:51.318372 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:51.318372 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:51.318372 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 19:22:51.318372 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:22:51.318372 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 19:22:51.318372 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:22:51.318372 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:51.318372 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:51.318372 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:51.318372 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:51.318372 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:51.318372 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:51.318372 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:51.318372 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:51.318372 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:51.318372 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:51.318372 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:51.318372 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:51.319700 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:51.319700 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:51.319700 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 19:22:51.319700 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 19:22:51.319700 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 19:22:51.319700 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 19:22:51.319700 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 19:22:51.319700 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 19:22:51.319700 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 01 19:22:51.319700 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:51.319700 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 451/929] 10.222.0.26 () {56 vars in 1117 bytes} [Fri Jul 1 19:22:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:51.324079 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48918c5-56e3-4db1-a8f8-0b2fcd30a01f None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:51.435272 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd8fb17-39fd-4fce-a2c6-b65f922faa46 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:51.450150 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48918c5-56e3-4db1-a8f8-0b2fcd30a01f None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:51.477063 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61561e15-62b1-4207-befc-0c42218c3896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:51.477700 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61561e15-62b1-4207-befc-0c42218c3896 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:51.477991 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61561e15-62b1-4207-befc-0c42218c3896 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:51.478273 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61561e15-62b1-4207-befc-0c42218c3896 None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:51.478987 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61561e15-62b1-4207-befc-0c42218c3896 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:51.479302 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61561e15-62b1-4207-befc-0c42218c3896 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:51.480676 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61561e15-62b1-4207-befc-0c42218c3896 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:51.490592 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 479/930] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Jul 1 19:22:51 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:22:51.491665 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61561e15-62b1-4207-befc-0c42218c3896 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:51.500627 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a716b1d6-e4b9-40a5-922e-011e7f547b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:51.502013 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a716b1d6-e4b9-40a5-922e-011e7f547b29 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:51.502474 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a716b1d6-e4b9-40a5-922e-011e7f547b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:51.502900 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a716b1d6-e4b9-40a5-922e-011e7f547b29 None admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:51.504366 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a716b1d6-e4b9-40a5-922e-011e7f547b29 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:51.505214 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a716b1d6-e4b9-40a5-922e-011e7f547b29 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:51.507132 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a716b1d6-e4b9-40a5-922e-011e7f547b29 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:51.532396 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:51.533698 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 452/931] 10.222.0.26 () {56 vars in 1149 bytes} [Fri Jul 1 19:22:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:22:51.539143 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a716b1d6-e4b9-40a5-922e-011e7f547b29 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:51.542126 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:51.618667 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61561e15-62b1-4207-befc-0c42218c3896 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:51.662610 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a716b1d6-e4b9-40a5-922e-011e7f547b29 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:51.666151 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb47cee-083c-46e9-b078-002ddf0ac689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:51.667020 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb47cee-083c-46e9-b078-002ddf0ac689 None admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:51.667466 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb47cee-083c-46e9-b078-002ddf0ac689 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:51.667891 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb47cee-083c-46e9-b078-002ddf0ac689 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:51.668846 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb47cee-083c-46e9-b078-002ddf0ac689 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:51.670417 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb47cee-083c-46e9-b078-002ddf0ac689 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:51.705262 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 480/932] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Jul 1 19:22:51 2022] POST /identity/v3/endpoints => generated 346 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:22:51.727568 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e752751-a88f-4b74-afde-8286b303da56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:51.728403 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e752751-a88f-4b74-afde-8286b303da56 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:51.728871 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e752751-a88f-4b74-afde-8286b303da56 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:51.729218 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e752751-a88f-4b74-afde-8286b303da56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:51.742401 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e752751-a88f-4b74-afde-8286b303da56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:51.744134 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e752751-a88f-4b74-afde-8286b303da56 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:51.764762 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-6e752751-a88f-4b74-afde-8286b303da56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:51.764762 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:51.764762 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:51.764762 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:51.764762 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:51.764762 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:51.764762 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:51.764762 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:51.764762 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:51.764762 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:51.764762 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:51.764762 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:51.764762 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:22:51.764762 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:22:51.764762 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:22:51.765877 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:22:51.765877 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:51.765877 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:51.765877 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:51.765877 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:51.765877 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:51.765877 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:51.765877 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:51.765877 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:51.765877 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:51.765877 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:51.765877 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:51.765877 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:51.765877 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:51.765877 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:51.765877 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:51.765877 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:51.766790 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:22:51.766790 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:22:51.766790 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:51.766790 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:51.766790 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 453/933] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:22:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:51.772432 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb47cee-083c-46e9-b078-002ddf0ac689 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:51.880485 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:51.890899 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb47cee-083c-46e9-b078-002ddf0ac689 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:51.931883 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dc06cb-1544-4b53-8017-ffd23c8c9974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:51.932552 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc06cb-1544-4b53-8017-ffd23c8c9974 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:51.932838 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc06cb-1544-4b53-8017-ffd23c8c9974 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:51.933116 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc06cb-1544-4b53-8017-ffd23c8c9974 None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:51.933875 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dc06cb-1544-4b53-8017-ffd23c8c9974 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:51.934217 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dc06cb-1544-4b53-8017-ffd23c8c9974 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:51.935585 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dc06cb-1544-4b53-8017-ffd23c8c9974 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:51.948055 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 481/934] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Jul 1 19:22:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:51.955845 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e752751-a88f-4b74-afde-8286b303da56 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:52.009686 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:52.063989 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e752751-a88f-4b74-afde-8286b303da56 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:52.104328 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5883b6ac-eb3a-4a30-9f52-4e8e1f9a70bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:52.105130 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5883b6ac-eb3a-4a30-9f52-4e8e1f9a70bc None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:52.105447 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5883b6ac-eb3a-4a30-9f52-4e8e1f9a70bc None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:52.105728 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5883b6ac-eb3a-4a30-9f52-4e8e1f9a70bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:52.125176 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5883b6ac-eb3a-4a30-9f52-4e8e1f9a70bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:52.126851 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5883b6ac-eb3a-4a30-9f52-4e8e1f9a70bc None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:52.141449 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-5883b6ac-eb3a-4a30-9f52-4e8e1f9a70bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:22:52.141449 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:52.141449 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:52.141449 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:52.141449 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:52.141449 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:52.141449 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:52.141449 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:52.141449 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:52.141449 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:52.141449 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:52.141449 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:52.141449 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 19:22:52.141449 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 19:22:52.141449 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 19:22:52.142370 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 19:22:52.142370 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:52.142370 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:52.142370 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:52.142370 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:52.142370 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:52.142370 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:52.142370 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:52.142370 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:52.142370 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:52.142370 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:52.142370 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:52.142370 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:52.142370 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:52.142370 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:52.142370 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:52.142370 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:52.143300 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 19:22:52.143300 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 19:22:52.143300 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 19:22:52.143300 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 19:22:52.143300 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 19:22:52.143300 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 19:22:52.143300 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:22:52.143300 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:52.143300 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 454/935] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Jul 1 19:22:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:52.148675 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dc06cb-1544-4b53-8017-ffd23c8c9974 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:52.259678 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dc06cb-1544-4b53-8017-ffd23c8c9974 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:52.305028 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014b7e86-75c3-4d11-a0be-38c42729f5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:52.306013 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b7e86-75c3-4d11-a0be-38c42729f5dc None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:52.306504 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b7e86-75c3-4d11-a0be-38c42729f5dc None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:52.306962 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b7e86-75c3-4d11-a0be-38c42729f5dc None admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:52.307936 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014b7e86-75c3-4d11-a0be-38c42729f5dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:52.308427 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014b7e86-75c3-4d11-a0be-38c42729f5dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:52.310232 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014b7e86-75c3-4d11-a0be-38c42729f5dc None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:52.326499 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 482/936] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Jul 1 19:22:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:52.332432 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5883b6ac-eb3a-4a30-9f52-4e8e1f9a70bc None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:52.444729 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5883b6ac-eb3a-4a30-9f52-4e8e1f9a70bc None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:52.456911 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:52.484365 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f16ee78-59ad-410b-b4b0-465af0f9b4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:52.485333 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f16ee78-59ad-410b-b4b0-465af0f9b4c5 None admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:52.485620 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f16ee78-59ad-410b-b4b0-465af0f9b4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:52.485902 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f16ee78-59ad-410b-b4b0-465af0f9b4c5 None admin] PATH_INFO: `/v3/projects/69c523a41f4048cfb7df553b6feb6310/users/0834256bdfbc48ffbc5af6d6760ecdd9/roles/6ce8e2867947472c8b441d47e4a4e28f` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:52.488148 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f16ee78-59ad-410b-b4b0-465af0f9b4c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=69c523a41f4048cfb7df553b6feb6310, user_id=0834256bdfbc48ffbc5af6d6760ecdd9, role_id=6ce8e2867947472c8b441d47e4a4e28f)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:52.489798 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f16ee78-59ad-410b-b4b0-465af0f9b4c5 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:52.510064 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 455/937] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Jul 1 19:22:52 2022] PUT /identity/v3/projects/69c523a41f4048cfb7df553b6feb6310/users/0834256bdfbc48ffbc5af6d6760ecdd9/roles/6ce8e2867947472c8b441d47e4a4e28f => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:22:52.719943 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ee42d-9af4-460e-9701-7f897b18f7df None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:52.720388 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ee42d-9af4-460e-9701-7f897b18f7df None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:52.720790 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ee42d-9af4-460e-9701-7f897b18f7df None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:52.722734 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 483/938] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:22:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:22:52.728141 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028bcb1f-095f-4123-a0c6-a32fb78514b6 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:52.728854 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028bcb1f-095f-4123-a0c6-a32fb78514b6 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:52.728854 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028bcb1f-095f-4123-a0c6-a32fb78514b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:52.747530 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-028bcb1f-095f-4123-a0c6-a32fb78514b6 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:22:52.748711 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-028bcb1f-095f-4123-a0c6-a32fb78514b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:22:52.826045 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 456/939] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:22:52 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:22:52.852229 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ee42d-9af4-460e-9701-7f897b18f7df None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:52.869569 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:53.030862 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ee42d-9af4-460e-9701-7f897b18f7df None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:53.092345 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106d6ba8-4c21-412d-bd79-1e21538089c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:53.093730 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d6ba8-4c21-412d-bd79-1e21538089c3 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:53.094175 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d6ba8-4c21-412d-bd79-1e21538089c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:53.094625 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d6ba8-4c21-412d-bd79-1e21538089c3 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:53.095744 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106d6ba8-4c21-412d-bd79-1e21538089c3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:53.098208 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106d6ba8-4c21-412d-bd79-1e21538089c3 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:53.122286 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-106d6ba8-4c21-412d-bd79-1e21538089c3 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 01 19:22:53.122286 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:53.122286 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 19:22:53.122286 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 19:22:53.122286 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 19:22:53.122286 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 19:22:53.122286 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 19:22:53.122286 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:22:53.122286 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 01 19:22:53.122286 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:53.122286 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 19:22:53.122286 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:53.122286 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:53.122286 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:53.122286 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:53.122286 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:53.122286 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:53.123382 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:53.123382 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:53.123382 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:53.123382 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:53.123382 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:53.123382 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:53.123382 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 19:22:53.123382 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 19:22:53.123382 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 19:22:53.123382 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 19:22:53.123382 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:53.123382 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:53.123382 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:53.123382 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:53.123382 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:53.123382 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:53.124226 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:53.124226 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:53.124226 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:53.124226 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:53.124226 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:53.124226 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:53.124226 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:53.124226 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:53.124226 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:53.124226 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:53.124226 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 19:22:53.124226 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:22:53.124226 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 01 19:22:53.124226 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:53.125004 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 484/940] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Jul 1 19:22:52 2022] GET /identity/v3/services/compute => generated 88 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:53.130542 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028bcb1f-095f-4123-a0c6-a32fb78514b6 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:53.240288 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028bcb1f-095f-4123-a0c6-a32fb78514b6 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:53.242127 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:53.272082 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d4aaf-811a-4423-96c3-9d63cdf938a8 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:53.272382 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d4aaf-811a-4423-96c3-9d63cdf938a8 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:53.272827 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d4aaf-811a-4423-96c3-9d63cdf938a8 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:53.278382 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 485/941] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:22:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 19:22:53.280115 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91856d88-f351-4424-b41f-f5cd1ce15c30 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:53.280486 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91856d88-f351-4424-b41f-f5cd1ce15c30 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:53.280847 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91856d88-f351-4424-b41f-f5cd1ce15c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:53.289282 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a7ca2-fe86-43f0-af58-8ddcc45e3f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:53.290280 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a7ca2-fe86-43f0-af58-8ddcc45e3f2e None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:53.290741 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a7ca2-fe86-43f0-af58-8ddcc45e3f2e None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:53.291293 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a7ca2-fe86-43f0-af58-8ddcc45e3f2e None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:53.292178 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6a7ca2-fe86-43f0-af58-8ddcc45e3f2e None admin] RBAC: Adding query filter params (name=compute) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:53.292660 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6a7ca2-fe86-43f0-af58-8ddcc45e3f2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:53.295289 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6a7ca2-fe86-43f0-af58-8ddcc45e3f2e None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:53.304953 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-91856d88-f351-4424-b41f-f5cd1ce15c30 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:22:53.304953 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-91856d88-f351-4424-b41f-f5cd1ce15c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:22:53.305764 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 457/942] 10.222.0.26 () {56 vars in 1112 bytes} [Fri Jul 1 19:22:53 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:53.308807 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a7ca2-fe86-43f0-af58-8ddcc45e3f2e None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:53.405380 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 486/943] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:22:53 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:22:53.431688 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91856d88-f351-4424-b41f-f5cd1ce15c30 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:53.433942 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a7ca2-fe86-43f0-af58-8ddcc45e3f2e None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:53.441097 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:53.484346 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed12fce-910a-4c80-b79a-48678253a900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:53.485427 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed12fce-910a-4c80-b79a-48678253a900 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:53.486088 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed12fce-910a-4c80-b79a-48678253a900 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:53.486581 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed12fce-910a-4c80-b79a-48678253a900 None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:53.487534 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed12fce-910a-4c80-b79a-48678253a900 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:53.488256 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed12fce-910a-4c80-b79a-48678253a900 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:53.489893 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed12fce-910a-4c80-b79a-48678253a900 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:53.497002 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 458/944] 10.222.0.26 () {56 vars in 1112 bytes} [Fri Jul 1 19:22:53 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:22:53.559490 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91856d88-f351-4424-b41f-f5cd1ce15c30 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:53.599158 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc3f8bd-cab1-48f2-9541-b5eb290adc60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:53.600384 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3f8bd-cab1-48f2-9541-b5eb290adc60 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:53.600888 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3f8bd-cab1-48f2-9541-b5eb290adc60 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:53.601406 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3f8bd-cab1-48f2-9541-b5eb290adc60 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:53.602335 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc3f8bd-cab1-48f2-9541-b5eb290adc60 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:53.603985 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc3f8bd-cab1-48f2-9541-b5eb290adc60 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:53.617925 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-bcc3f8bd-cab1-48f2-9541-b5eb290adc60 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 01 19:22:53.617925 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:53.617925 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 19:22:53.617925 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 19:22:53.617925 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 19:22:53.617925 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 19:22:53.617925 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 19:22:53.617925 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:22:53.617925 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 01 19:22:53.617925 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:53.617925 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 19:22:53.617925 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:53.617925 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:53.617925 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:53.617925 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:53.617925 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:53.617925 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:53.619030 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:53.619030 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:53.619030 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:53.619030 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:53.619030 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:53.619030 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:53.619030 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 19:22:53.619030 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 19:22:53.619030 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 19:22:53.619030 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 19:22:53.619030 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:53.619030 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:53.619030 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:53.619030 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:53.619030 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:53.619030 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:53.619880 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:53.619880 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:53.619880 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:53.619880 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:53.619880 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:53.619880 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:53.619880 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:53.619880 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:53.619880 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:53.619880 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:53.619880 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 19:22:53.619880 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:22:53.619880 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 01 19:22:53.619880 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:53.628410 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 487/945] 10.222.0.26 () {56 vars in 1126 bytes} [Fri Jul 1 19:22:53 2022] GET /identity/v3/services/object-store => generated 93 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:22:53.630247 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed12fce-910a-4c80-b79a-48678253a900 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:53.663261 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:53.740589 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed12fce-910a-4c80-b79a-48678253a900 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:53.779611 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78cd8bf-df8b-42ce-8e85-b57e78a379fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:53.780375 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78cd8bf-df8b-42ce-8e85-b57e78a379fe None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:53.780662 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78cd8bf-df8b-42ce-8e85-b57e78a379fe None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:53.780946 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78cd8bf-df8b-42ce-8e85-b57e78a379fe None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:53.781691 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78cd8bf-df8b-42ce-8e85-b57e78a379fe None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:53.782003 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78cd8bf-df8b-42ce-8e85-b57e78a379fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:53.783896 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78cd8bf-df8b-42ce-8e85-b57e78a379fe None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:53.796400 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 459/946] 10.222.0.26 () {56 vars in 1122 bytes} [Fri Jul 1 19:22:53 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:53.798256 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc3f8bd-cab1-48f2-9541-b5eb290adc60 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:53.875051 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:53.908005 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc3f8bd-cab1-48f2-9541-b5eb290adc60 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:53.942872 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dd2a30-9c56-469d-8578-afdafdf0783a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:53.943545 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dd2a30-9c56-469d-8578-afdafdf0783a None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:53.943834 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dd2a30-9c56-469d-8578-afdafdf0783a None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:53.944113 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dd2a30-9c56-469d-8578-afdafdf0783a None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:53.944830 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dd2a30-9c56-469d-8578-afdafdf0783a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:53.945144 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dd2a30-9c56-469d-8578-afdafdf0783a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:53.946547 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dd2a30-9c56-469d-8578-afdafdf0783a None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:53.952729 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 488/947] 10.222.0.26 () {56 vars in 1122 bytes} [Fri Jul 1 19:22:53 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:53.958639 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78cd8bf-df8b-42ce-8e85-b57e78a379fe None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:53.997933 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9973a-4141-4905-b89a-bfa40e69792f None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:53.998624 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9973a-4141-4905-b89a-bfa40e69792f None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:53.999099 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9973a-4141-4905-b89a-bfa40e69792f None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:54.000889 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 489/948] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:22:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 19:22:54.006457 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5118b-4e2d-4a6d-8dbc-b6f7cb845d27 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:54.007080 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5118b-4e2d-4a6d-8dbc-b6f7cb845d27 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:54.007576 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5118b-4e2d-4a6d-8dbc-b6f7cb845d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:54.030766 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-73c5118b-4e2d-4a6d-8dbc-b6f7cb845d27 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:22:54.032886 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-73c5118b-4e2d-4a6d-8dbc-b6f7cb845d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:22:54.062520 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:54.071849 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78cd8bf-df8b-42ce-8e85-b57e78a379fe None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:54.110720 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2db7a50-1f96-4400-b855-8b4ab11f0da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:54.111379 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db7a50-1f96-4400-b855-8b4ab11f0da1 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:54.111669 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db7a50-1f96-4400-b855-8b4ab11f0da1 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:54.112014 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db7a50-1f96-4400-b855-8b4ab11f0da1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:54.112853 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2db7a50-1f96-4400-b855-8b4ab11f0da1 None admin] RBAC: Adding query filter params (interface=public, service_id=cf155c86a8a44493868f4a31c628bd83, region_id=RegionOne) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:54.113169 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2db7a50-1f96-4400-b855-8b4ab11f0da1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:54.114597 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2db7a50-1f96-4400-b855-8b4ab11f0da1 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:54.124808 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 460/949] 10.222.0.26 () {56 vars in 1251 bytes} [Fri Jul 1 19:22:53 2022] GET /identity/v3/endpoints?service_id=cf155c86a8a44493868f4a31c628bd83&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:54.128773 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2db7a50-1f96-4400-b855-8b4ab11f0da1 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:54.135204 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 490/950] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:22:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 01 19:22:54.161411 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c5118b-4e2d-4a6d-8dbc-b6f7cb845d27 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:54.240242 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:54.252383 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2db7a50-1f96-4400-b855-8b4ab11f0da1 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:54.292266 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498afccc-83f6-45ff-b4d0-86b15f49b205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:54.292932 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498afccc-83f6-45ff-b4d0-86b15f49b205 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:54.293211 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498afccc-83f6-45ff-b4d0-86b15f49b205 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:54.293552 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498afccc-83f6-45ff-b4d0-86b15f49b205 None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:54.294219 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498afccc-83f6-45ff-b4d0-86b15f49b205 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:54.295450 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c5118b-4e2d-4a6d-8dbc-b6f7cb845d27 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:54.295630 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498afccc-83f6-45ff-b4d0-86b15f49b205 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:54.309421 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 461/951] 10.222.0.26 () {56 vars in 1087 bytes} [Fri Jul 1 19:22:54 2022] GET /identity/v3/services => generated 1497 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:22:54.345760 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e4395-f0ef-4c2e-acce-50623fd81541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:54.346545 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e4395-f0ef-4c2e-acce-50623fd81541 None admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:54.346837 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e4395-f0ef-4c2e-acce-50623fd81541 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:54.347175 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e4395-f0ef-4c2e-acce-50623fd81541 None admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:54.347926 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9e4395-f0ef-4c2e-acce-50623fd81541 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:54.349514 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9e4395-f0ef-4c2e-acce-50623fd81541 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:54.351032 dv-cinder-844601-7-smb devstack@keystone.service[80246]: WARNING keystone.server.flask.common [None req-1e9e4395-f0ef-4c2e-acce-50623fd81541 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 01 19:22:54.381879 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.sql.core [None req-1e9e4395-f0ef-4c2e-acce-50623fd81541 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 01 19:22:54.381879 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 01 19:22:54.381879 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [parameters: {'id': 'c4c1b24c6baa4c7cbb6cd6b73a11d925', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 01 19:22:54.381879 dv-cinder-844601-7-smb devstack@keystone.service[80246]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80246) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 01 19:22:54.400651 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-1e9e4395-f0ef-4c2e-acce-50623fd81541 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c4c1b24c6baa4c7cbb6cd6b73a11d925.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c4c1b24c6baa4c7cbb6cd6b73a11d925. Jul 01 19:22:54.400651 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:54.400651 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 01 19:22:54.400651 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 01 19:22:54.400651 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 01 19:22:54.400651 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 01 19:22:54.400651 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 01 19:22:54.400651 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application result = self._query(query) Jul 01 19:22:54.400651 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 01 19:22:54.400651 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application conn.query(q) Jul 01 19:22:54.400651 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 01 19:22:54.400651 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 01 19:22:54.400651 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 01 19:22:54.401560 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application result.read() Jul 01 19:22:54.401560 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 01 19:22:54.401560 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 01 19:22:54.401560 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 01 19:22:54.401560 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 01 19:22:54.401560 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 01 19:22:54.401560 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 01 19:22:54.401560 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 01 19:22:54.401560 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 01 19:22:54.401560 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 01 19:22:54.401560 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:54.401560 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 01 19:22:54.401560 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:54.401560 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:54.401560 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 01 19:22:54.401560 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 01 19:22:54.401560 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 01 19:22:54.401560 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 01 19:22:54.402499 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 01 19:22:54.402499 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application next(self.gen) Jul 01 19:22:54.402499 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 01 19:22:54.402499 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application yield resource Jul 01 19:22:54.402499 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 01 19:22:54.402499 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application next(self.gen) Jul 01 19:22:54.402499 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 01 19:22:54.402499 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application self.session.rollback() Jul 01 19:22:54.402499 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 01 19:22:54.402499 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application self.force_reraise() Jul 01 19:22:54.402499 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 01 19:22:54.402499 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise self.value Jul 01 19:22:54.402499 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 01 19:22:54.402499 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 01 19:22:54.402499 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 01 19:22:54.402499 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application session.commit() Jul 01 19:22:54.402499 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 01 19:22:54.403452 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 01 19:22:54.403452 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 01 19:22:54.403452 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application self._prepare_impl() Jul 01 19:22:54.403452 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 01 19:22:54.403452 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application self.session.flush() Jul 01 19:22:54.403452 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 01 19:22:54.403452 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application self._flush(objects) Jul 01 19:22:54.403452 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 01 19:22:54.403452 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 01 19:22:54.403452 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 01 19:22:54.403452 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application compat.raise_( Jul 01 19:22:54.403452 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 01 19:22:54.403452 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception Jul 01 19:22:54.403452 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 01 19:22:54.403452 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application flush_context.execute() Jul 01 19:22:54.403452 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 01 19:22:54.403452 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rec.execute(self) Jul 01 19:22:54.404342 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 01 19:22:54.404342 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 01 19:22:54.404342 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 01 19:22:54.404342 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 01 19:22:54.404342 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 01 19:22:54.404342 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 01 19:22:54.404342 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 01 19:22:54.404342 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 01 19:22:54.404342 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 01 19:22:54.404342 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 01 19:22:54.404342 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 01 19:22:54.404342 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 01 19:22:54.404342 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 01 19:22:54.404342 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 01 19:22:54.404342 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 01 19:22:54.405132 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 01 19:22:54.405132 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 01 19:22:54.405132 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception Jul 01 19:22:54.405132 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 01 19:22:54.405132 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 01 19:22:54.405132 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 01 19:22:54.405132 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 01 19:22:54.405132 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 01 19:22:54.405132 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application result = self._query(query) Jul 01 19:22:54.405132 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 01 19:22:54.405132 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application conn.query(q) Jul 01 19:22:54.405132 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 01 19:22:54.405132 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 01 19:22:54.405132 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 01 19:22:54.405132 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application result.read() Jul 01 19:22:54.405132 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 01 19:22:54.405132 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 01 19:22:54.407908 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 01 19:22:54.407908 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 01 19:22:54.407908 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 01 19:22:54.407908 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 01 19:22:54.407908 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 01 19:22:54.407908 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 01 19:22:54.407908 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 01 19:22:54.407908 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 01 19:22:54.407908 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [parameters: {'id': 'c4c1b24c6baa4c7cbb6cd6b73a11d925', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 01 19:22:54.407908 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 01 19:22:54.407908 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:54.407908 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 19:22:54.407908 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:54.407908 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:54.407908 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 01 19:22:54.414091 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 01 19:22:54.414091 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 01 19:22:54.414091 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 01 19:22:54.414091 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 01 19:22:54.414091 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:54.414091 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 19:22:54.414091 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:54.414091 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:54.414091 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:54.414091 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:54.414091 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:54.414091 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:54.414091 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:54.414091 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:54.414091 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:54.414091 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:54.414091 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:54.415191 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:54.415191 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 01 19:22:54.415191 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 01 19:22:54.415191 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:54.415191 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:54.415191 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 01 19:22:54.415191 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 01 19:22:54.415191 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c4c1b24c6baa4c7cbb6cd6b73a11d925. Jul 01 19:22:54.415191 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:54.415191 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 491/952] 10.222.0.26 () {60 vars in 1140 bytes} [Fri Jul 1 19:22:54 2022] POST /identity/v3/projects => generated 262 bytes in 241 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:54.415754 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498afccc-83f6-45ff-b4d0-86b15f49b205 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:54.439518 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:54.525630 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498afccc-83f6-45ff-b4d0-86b15f49b205 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:54.562339 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5843cd27-05df-4836-82d9-94da5e62eb64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:54.563379 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843cd27-05df-4836-82d9-94da5e62eb64 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:54.563835 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843cd27-05df-4836-82d9-94da5e62eb64 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:54.564261 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843cd27-05df-4836-82d9-94da5e62eb64 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:54.571620 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5843cd27-05df-4836-82d9-94da5e62eb64 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:54.573319 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5843cd27-05df-4836-82d9-94da5e62eb64 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:54.587470 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-5843cd27-05df-4836-82d9-94da5e62eb64 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:22:54.587470 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:54.587470 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:54.587470 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:54.587470 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:54.587470 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:54.587470 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:54.587470 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:54.587470 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:54.587470 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:54.587470 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:54.587470 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:54.587470 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 19:22:54.587470 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 19:22:54.587470 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 19:22:54.588715 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 19:22:54.588715 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:54.588715 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:54.588715 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:54.588715 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:54.588715 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:54.588715 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:54.588715 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:54.588715 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:54.588715 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:54.588715 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:54.588715 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:54.588715 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:54.588715 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:54.588715 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:54.588715 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:54.588715 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:54.589963 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 19:22:54.589963 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 19:22:54.589963 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 19:22:54.589963 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 19:22:54.589963 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 19:22:54.589963 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 19:22:54.589963 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:22:54.589963 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:54.592115 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 462/953] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Jul 1 19:22:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:54.598328 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e4395-f0ef-4c2e-acce-50623fd81541 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:54.718014 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3bffaa-34c2-42fd-a5c3-b5649668bde8 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:54.718305 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3bffaa-34c2-42fd-a5c3-b5649668bde8 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:54.718588 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3bffaa-34c2-42fd-a5c3-b5649668bde8 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:54.720233 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 463/954] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:22:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:22:54.722804 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e4395-f0ef-4c2e-acce-50623fd81541 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:54.725217 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43262ad-a888-4711-a832-d1a9ae4f8e2b None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:54.725557 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43262ad-a888-4711-a832-d1a9ae4f8e2b None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:54.725837 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43262ad-a888-4711-a832-d1a9ae4f8e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:54.744506 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-b43262ad-a888-4711-a832-d1a9ae4f8e2b None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:22:54.745995 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-b43262ad-a888-4711-a832-d1a9ae4f8e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:22:54.755313 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:54.773903 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d395f3-0bcd-4b52-a461-657cc34aea27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:54.774920 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d395f3-0bcd-4b52-a461-657cc34aea27 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:54.775383 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d395f3-0bcd-4b52-a461-657cc34aea27 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:54.775844 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d395f3-0bcd-4b52-a461-657cc34aea27 None admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:54.776891 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d395f3-0bcd-4b52-a461-657cc34aea27 None admin] RBAC: Adding query filter params (name=service) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:54.777515 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d395f3-0bcd-4b52-a461-657cc34aea27 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:54.779425 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d395f3-0bcd-4b52-a461-657cc34aea27 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:54.802515 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 492/955] 10.222.0.26 () {56 vars in 1112 bytes} [Fri Jul 1 19:22:54 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:54.827056 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 464/956] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:22:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 01 19:22:54.851022 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d395f3-0bcd-4b52-a461-657cc34aea27 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:54.963637 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d395f3-0bcd-4b52-a461-657cc34aea27 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:55.000377 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407e27fe-c640-4679-bac6-bfd4c88c723b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:55.001195 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e27fe-c640-4679-bac6-bfd4c88c723b None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:55.001508 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e27fe-c640-4679-bac6-bfd4c88c723b None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:55.001782 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e27fe-c640-4679-bac6-bfd4c88c723b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:55.012516 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407e27fe-c640-4679-bac6-bfd4c88c723b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:22:55.020839 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-407e27fe-c640-4679-bac6-bfd4c88c723b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 01 19:22:55.020839 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:55.020839 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:55.020839 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:55.020839 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:55.020839 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:55.020839 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:55.020839 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:55.020839 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:55.020839 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:55.020839 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:55.020839 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:55.020839 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:22:55.020839 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:22:55.020839 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:22:55.020839 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:22:55.021855 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:22:55.021855 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:22:55.021855 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:22:55.021855 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:22:55.021855 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:55.021855 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:55.021855 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:55.021855 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:55.021855 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:55.021855 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:55.021855 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:55.021855 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:55.021855 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:55.021855 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:55.021855 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:55.021855 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:55.022720 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:55.022720 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:55.022720 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:55.022720 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:55.022720 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:22:55.022720 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:22:55.022720 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:22:55.022720 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:22:55.022720 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:22:55.022720 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:22:55.022720 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 01 19:22:55.022720 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:55.022720 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 493/957] 10.222.0.26 () {56 vars in 1120 bytes} [Fri Jul 1 19:22:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:55.032298 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43262ad-a888-4711-a832-d1a9ae4f8e2b None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:55.045053 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:55.138114 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43262ad-a888-4711-a832-d1a9ae4f8e2b None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:55.176641 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263b297e-b281-4fe2-8dc8-58ad7a7294b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:55.177345 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b297e-b281-4fe2-8dc8-58ad7a7294b9 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:55.177889 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b297e-b281-4fe2-8dc8-58ad7a7294b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:55.178161 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b297e-b281-4fe2-8dc8-58ad7a7294b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:55.178910 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263b297e-b281-4fe2-8dc8-58ad7a7294b9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:55.179217 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263b297e-b281-4fe2-8dc8-58ad7a7294b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:55.180588 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263b297e-b281-4fe2-8dc8-58ad7a7294b9 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:55.189691 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 465/958] 10.222.0.26 () {56 vars in 1115 bytes} [Fri Jul 1 19:22:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:55.195469 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407e27fe-c640-4679-bac6-bfd4c88c723b None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:55.242842 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:55.304313 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407e27fe-c640-4679-bac6-bfd4c88c723b None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:55.339809 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b62411-5854-4015-bba3-123327c9b67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:55.341205 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b62411-5854-4015-bba3-123327c9b67b None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:55.341531 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b62411-5854-4015-bba3-123327c9b67b None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:55.341814 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b62411-5854-4015-bba3-123327c9b67b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:55.353093 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b62411-5854-4015-bba3-123327c9b67b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:55.354624 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b62411-5854-4015-bba3-123327c9b67b None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:55.372295 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-51b62411-5854-4015-bba3-123327c9b67b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:55.372295 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:55.372295 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:55.372295 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:55.372295 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:55.372295 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:55.372295 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:55.372295 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:55.372295 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:55.372295 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:55.372295 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:55.372295 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:55.372295 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:22:55.372295 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:22:55.372295 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:22:55.373226 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:22:55.373226 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:55.373226 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:55.373226 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:55.373226 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:55.373226 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:55.373226 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:55.373226 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:55.373226 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:55.373226 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:55.373226 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:55.373226 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:55.373226 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:55.373226 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:55.373226 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:55.373226 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:55.373226 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:55.374162 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:22:55.374162 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:22:55.374162 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:55.374162 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:55.374162 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 494/959] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:22:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:55.380865 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263b297e-b281-4fe2-8dc8-58ad7a7294b9 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:55.458598 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:55.492592 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263b297e-b281-4fe2-8dc8-58ad7a7294b9 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:55.527533 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a977269c-ce3b-4857-af3a-10a7843726da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:55.529023 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a977269c-ce3b-4857-af3a-10a7843726da None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:55.529514 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a977269c-ce3b-4857-af3a-10a7843726da None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:55.529971 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a977269c-ce3b-4857-af3a-10a7843726da None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:55.530863 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a977269c-ce3b-4857-af3a-10a7843726da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:55.531352 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a977269c-ce3b-4857-af3a-10a7843726da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:55.532923 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a977269c-ce3b-4857-af3a-10a7843726da None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:55.545872 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 466/960] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Jul 1 19:22:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:55.551610 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b62411-5854-4015-bba3-123327c9b67b None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:55.646429 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991d66c-52f0-464c-aef7-a77881d4fc34 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:55.647013 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991d66c-52f0-464c-aef7-a77881d4fc34 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:55.647518 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991d66c-52f0-464c-aef7-a77881d4fc34 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:55.649476 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 467/961] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:22:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 19:22:55.654290 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c428d-0f84-496d-a8fa-4c6ec21fba94 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:55.654816 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c428d-0f84-496d-a8fa-4c6ec21fba94 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:55.655741 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c428d-0f84-496d-a8fa-4c6ec21fba94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:55.662291 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:55.671871 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b62411-5854-4015-bba3-123327c9b67b None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:55.680357 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-403c428d-0f84-496d-a8fa-4c6ec21fba94 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:22:55.682314 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-403c428d-0f84-496d-a8fa-4c6ec21fba94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:22:55.710546 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2b3a3a-4aa4-437d-a486-64efb97c1a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:55.711490 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b3a3a-4aa4-437d-a486-64efb97c1a7e None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:55.711778 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b3a3a-4aa4-437d-a486-64efb97c1a7e None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:55.712052 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b3a3a-4aa4-437d-a486-64efb97c1a7e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:55.721189 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2b3a3a-4aa4-437d-a486-64efb97c1a7e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:55.723997 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2b3a3a-4aa4-437d-a486-64efb97c1a7e None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:55.740103 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-0d2b3a3a-4aa4-437d-a486-64efb97c1a7e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 01 19:22:55.740103 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:55.740103 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:55.740103 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:55.740103 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:55.740103 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:55.740103 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:55.740103 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:55.740103 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:55.740103 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:55.740103 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:55.740103 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:55.740103 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 19:22:55.740103 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 19:22:55.740103 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 19:22:55.740103 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 19:22:55.741060 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:55.741060 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:55.741060 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 19:22:55.741060 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:22:55.741060 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 19:22:55.741060 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:22:55.741060 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:55.741060 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:55.741060 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:55.741060 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:55.741060 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:55.741060 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:55.741060 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:55.741060 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:55.741060 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:55.741060 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:55.741060 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:55.741060 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:55.742075 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:55.742075 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:55.742075 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 19:22:55.742075 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 19:22:55.742075 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 19:22:55.742075 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 19:22:55.742075 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 19:22:55.742075 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 19:22:55.742075 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 01 19:22:55.742075 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:55.744873 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 495/962] 10.222.0.26 () {56 vars in 1117 bytes} [Fri Jul 1 19:22:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:22:55.751021 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2b3a3a-4aa4-437d-a486-64efb97c1a7e None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:55.772351 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 468/963] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:22:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:22:55.791623 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403c428d-0f84-496d-a8fa-4c6ec21fba94 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:55.860396 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2b3a3a-4aa4-437d-a486-64efb97c1a7e None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:55.867268 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:55.910154 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403c428d-0f84-496d-a8fa-4c6ec21fba94 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:55.918481 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbf7685-3fc7-4513-9d36-0e7e15935f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:55.919458 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf7685-3fc7-4513-9d36-0e7e15935f5a None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:55.920427 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf7685-3fc7-4513-9d36-0e7e15935f5a None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:55.920925 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf7685-3fc7-4513-9d36-0e7e15935f5a None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:55.922557 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbf7685-3fc7-4513-9d36-0e7e15935f5a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:55.923188 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbf7685-3fc7-4513-9d36-0e7e15935f5a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:55.925702 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbf7685-3fc7-4513-9d36-0e7e15935f5a None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:55.948071 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a9b966-3cb7-42a9-af76-6ce07b6d41b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:55.948839 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9b966-3cb7-42a9-af76-6ce07b6d41b3 None admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:55.949196 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9b966-3cb7-42a9-af76-6ce07b6d41b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:55.949655 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9b966-3cb7-42a9-af76-6ce07b6d41b3 None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:55.951028 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a9b966-3cb7-42a9-af76-6ce07b6d41b3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:55.952396 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 496/964] 10.222.0.26 () {56 vars in 1149 bytes} [Fri Jul 1 19:22:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:55.953398 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a9b966-3cb7-42a9-af76-6ce07b6d41b3 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:55.958415 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbf7685-3fc7-4513-9d36-0e7e15935f5a None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:55.972155 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:55.981610 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 469/965] 10.222.0.26 () {60 vars in 1141 bytes} [Fri Jul 1 19:22:55 2022] POST /identity/v3/services => generated 242 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 19:22:56.087562 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbf7685-3fc7-4513-9d36-0e7e15935f5a None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:56.135232 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd6377d-4c2a-42f7-bd43-3e64525e3ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:56.135887 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6377d-4c2a-42f7-bd43-3e64525e3ed0 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:56.136175 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6377d-4c2a-42f7-bd43-3e64525e3ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:56.136454 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6377d-4c2a-42f7-bd43-3e64525e3ed0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:56.213299 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd6377d-4c2a-42f7-bd43-3e64525e3ed0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:56.214763 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd6377d-4c2a-42f7-bd43-3e64525e3ed0 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:56.223414 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:56.321465 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 497/966] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Jul 1 19:22:55 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 01 19:22:56.327183 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a9b966-3cb7-42a9-af76-6ce07b6d41b3 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:56.437507 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a9b966-3cb7-42a9-af76-6ce07b6d41b3 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:56.462224 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:56.476475 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4676f436-29f4-4207-9bf1-ecbd0a123b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:56.477781 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4676f436-29f4-4207-9bf1-ecbd0a123b8e None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:56.478278 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4676f436-29f4-4207-9bf1-ecbd0a123b8e None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:56.478774 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4676f436-29f4-4207-9bf1-ecbd0a123b8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:56.491325 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4676f436-29f4-4207-9bf1-ecbd0a123b8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:56.493086 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4676f436-29f4-4207-9bf1-ecbd0a123b8e None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:56.514161 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-4676f436-29f4-4207-9bf1-ecbd0a123b8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:56.514161 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:56.514161 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:56.514161 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:56.514161 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:56.514161 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:56.514161 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:56.514161 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:56.514161 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:56.514161 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:56.514161 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:56.514161 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:56.514161 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:22:56.514161 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:22:56.514161 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:22:56.515154 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:22:56.515154 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:56.515154 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:56.515154 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:56.515154 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:56.515154 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:56.515154 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:56.515154 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:56.515154 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:56.515154 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:56.515154 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:56.515154 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:56.515154 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:56.515154 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:56.515154 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:56.515154 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:56.515154 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:56.516064 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:22:56.516064 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:22:56.516064 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:22:56.516064 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:56.518452 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 470/967] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:22:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:56.523802 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd6377d-4c2a-42f7-bd43-3e64525e3ed0 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:56.548019 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb53c7b-e3c6-4589-8e16-f7c6447e4014 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:56.549260 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb53c7b-e3c6-4589-8e16-f7c6447e4014 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:56.549783 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb53c7b-e3c6-4589-8e16-f7c6447e4014 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:56.553190 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 471/968] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:22:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:22:56.558030 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f866fb5f-285f-47cc-b945-b3e68216caba None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:56.558861 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f866fb5f-285f-47cc-b945-b3e68216caba None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:56.559852 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f866fb5f-285f-47cc-b945-b3e68216caba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:56.582921 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-f866fb5f-285f-47cc-b945-b3e68216caba None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:22:56.585063 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-f866fb5f-285f-47cc-b945-b3e68216caba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:22:56.634779 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd6377d-4c2a-42f7-bd43-3e64525e3ed0 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:56.645793 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:56.681583 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 472/969] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:22:56 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:22:56.682506 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb1e025-fe66-4398-a3bd-b67538db9252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:56.683436 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1e025-fe66-4398-a3bd-b67538db9252 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:56.683980 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1e025-fe66-4398-a3bd-b67538db9252 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:56.684462 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1e025-fe66-4398-a3bd-b67538db9252 None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:56.685428 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb1e025-fe66-4398-a3bd-b67538db9252 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:56.685945 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb1e025-fe66-4398-a3bd-b67538db9252 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:56.687573 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb1e025-fe66-4398-a3bd-b67538db9252 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:56.697943 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f866fb5f-285f-47cc-b945-b3e68216caba None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:56.701461 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 498/970] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Jul 1 19:22:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:56.710395 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb1e025-fe66-4398-a3bd-b67538db9252 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:56.804838 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f866fb5f-285f-47cc-b945-b3e68216caba None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:56.808022 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:56.846578 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb1e025-fe66-4398-a3bd-b67538db9252 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:56.847488 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1660c07f-dff9-43a6-b394-a7f5f0621bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:56.848296 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660c07f-dff9-43a6-b394-a7f5f0621bb4 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:56.848565 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660c07f-dff9-43a6-b394-a7f5f0621bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:56.848840 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660c07f-dff9-43a6-b394-a7f5f0621bb4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:56.849646 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1660c07f-dff9-43a6-b394-a7f5f0621bb4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:56.851021 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1660c07f-dff9-43a6-b394-a7f5f0621bb4 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:56.863532 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-1660c07f-dff9-43a6-b394-a7f5f0621bb4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 01 19:22:56.863532 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:56.863532 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 19:22:56.863532 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 19:22:56.863532 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 19:22:56.863532 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 19:22:56.863532 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 19:22:56.863532 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:22:56.863532 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 01 19:22:56.863532 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:56.863532 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 19:22:56.863532 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:56.863532 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:56.863532 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:56.863532 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:56.863532 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:56.863532 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:56.864869 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:56.864869 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:56.864869 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:56.864869 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:56.864869 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:56.864869 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:56.864869 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 19:22:56.864869 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 19:22:56.864869 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 19:22:56.864869 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 19:22:56.864869 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:56.864869 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:56.864869 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:56.864869 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:56.864869 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:56.864869 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:56.865915 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:56.865915 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:56.865915 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:56.865915 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:56.865915 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:56.865915 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:56.865915 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:56.865915 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:56.865915 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:56.865915 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:56.865915 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 19:22:56.865915 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:22:56.865915 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 01 19:22:56.865915 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:56.869539 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 473/971] 10.222.0.26 () {56 vars in 1126 bytes} [Fri Jul 1 19:22:56 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:22:56.870743 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1660c07f-dff9-43a6-b394-a7f5f0621bb4 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:56.892664 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253df94c-3eb8-43e2-b76c-63eb0090c947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:56.893831 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253df94c-3eb8-43e2-b76c-63eb0090c947 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:56.894316 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253df94c-3eb8-43e2-b76c-63eb0090c947 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:56.895264 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253df94c-3eb8-43e2-b76c-63eb0090c947 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:56.908753 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253df94c-3eb8-43e2-b76c-63eb0090c947 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:56.908753 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253df94c-3eb8-43e2-b76c-63eb0090c947 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:56.927744 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-253df94c-3eb8-43e2-b76c-63eb0090c947 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:22:56.927744 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:56.927744 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:56.927744 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:56.927744 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:56.927744 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:56.927744 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:56.927744 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:56.927744 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:56.927744 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:56.927744 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:56.927744 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:56.927744 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 19:22:56.927744 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 19:22:56.927744 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 19:22:56.928684 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 19:22:56.928684 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:56.928684 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:56.928684 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:56.928684 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:56.928684 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:56.928684 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:56.928684 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:56.928684 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:56.928684 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:56.928684 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:56.928684 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:56.928684 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:56.928684 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:56.928684 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:56.928684 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:56.928684 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:56.929642 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 19:22:56.929642 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 19:22:56.929642 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 19:22:56.929642 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 19:22:56.929642 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 19:22:56.929642 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 19:22:56.929642 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:22:56.929642 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:56.932480 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 499/972] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Jul 1 19:22:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:56.941172 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253df94c-3eb8-43e2-b76c-63eb0090c947 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:56.967232 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:56.987109 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1660c07f-dff9-43a6-b394-a7f5f0621bb4 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:57.026555 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f578bb56-1436-4e9a-a385-da0102e61ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:57.027218 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f578bb56-1436-4e9a-a385-da0102e61ef4 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:57.027502 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f578bb56-1436-4e9a-a385-da0102e61ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:57.028322 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f578bb56-1436-4e9a-a385-da0102e61ef4 None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:57.029152 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f578bb56-1436-4e9a-a385-da0102e61ef4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:57.029504 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f578bb56-1436-4e9a-a385-da0102e61ef4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:57.031040 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f578bb56-1436-4e9a-a385-da0102e61ef4 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:57.038605 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 474/973] 10.222.0.26 () {56 vars in 1122 bytes} [Fri Jul 1 19:22:56 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:22:57.039938 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4ad98-97ee-4022-9312-ddadb126c127 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:57.040234 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4ad98-97ee-4022-9312-ddadb126c127 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:57.040522 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4ad98-97ee-4022-9312-ddadb126c127 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:57.041825 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 475/974] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:22:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:22:57.042629 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d4ad98-97ee-4022-9312-ddadb126c127 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:57.054276 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253df94c-3eb8-43e2-b76c-63eb0090c947 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:57.078061 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:57.091758 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637b0395-51c7-4470-8b47-5db2d80f5c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:57.092422 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b0395-51c7-4470-8b47-5db2d80f5c1c None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:57.092704 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b0395-51c7-4470-8b47-5db2d80f5c1c None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:57.092987 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b0395-51c7-4470-8b47-5db2d80f5c1c None admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:57.093810 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637b0395-51c7-4470-8b47-5db2d80f5c1c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:57.094123 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637b0395-51c7-4470-8b47-5db2d80f5c1c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:57.095551 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637b0395-51c7-4470-8b47-5db2d80f5c1c None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:57.107287 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 500/975] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Jul 1 19:22:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:57.108583 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae8c281-825f-4470-81d2-1ef7972d9687 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:57.108870 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae8c281-825f-4470-81d2-1ef7972d9687 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:57.109149 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae8c281-825f-4470-81d2-1ef7972d9687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:57.125895 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-3ae8c281-825f-4470-81d2-1ef7972d9687 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:22:57.127390 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-3ae8c281-825f-4470-81d2-1ef7972d9687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:22:57.172545 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d4ad98-97ee-4022-9312-ddadb126c127 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:57.201355 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 501/976] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:22:57 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:22:57.201355 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae8c281-825f-4470-81d2-1ef7972d9687 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:57.218124 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:57.222713 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9ba68d-bb84-4a3b-96e3-afdf7177bf18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:57.223380 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ba68d-bb84-4a3b-96e3-afdf7177bf18 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:57.223663 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ba68d-bb84-4a3b-96e3-afdf7177bf18 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:57.223936 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ba68d-bb84-4a3b-96e3-afdf7177bf18 None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:57.224657 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9ba68d-bb84-4a3b-96e3-afdf7177bf18 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:57.225565 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9ba68d-bb84-4a3b-96e3-afdf7177bf18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:57.227240 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9ba68d-bb84-4a3b-96e3-afdf7177bf18 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:57.232850 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 476/977] 10.222.0.26 () {56 vars in 1122 bytes} [Fri Jul 1 19:22:57 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:57.233535 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9ba68d-bb84-4a3b-96e3-afdf7177bf18 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:57.314419 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae8c281-825f-4470-81d2-1ef7972d9687 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:57.343461 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:57.350463 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9ba68d-bb84-4a3b-96e3-afdf7177bf18 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:57.352245 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753178f6-07c6-40a3-84aa-6792ea7a43d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:57.353479 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753178f6-07c6-40a3-84aa-6792ea7a43d7 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:57.353479 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753178f6-07c6-40a3-84aa-6792ea7a43d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:57.353479 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753178f6-07c6-40a3-84aa-6792ea7a43d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:57.354403 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753178f6-07c6-40a3-84aa-6792ea7a43d7 None admin] RBAC: Adding query filter params (role.id=6ce8e2867947472c8b441d47e4a4e28f, scope.project.id=69c523a41f4048cfb7df553b6feb6310, user.id=0834256bdfbc48ffbc5af6d6760ecdd9) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:57.354717 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753178f6-07c6-40a3-84aa-6792ea7a43d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:57.356171 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753178f6-07c6-40a3-84aa-6792ea7a43d7 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:57.362848 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 502/978] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Jul 1 19:22:57 2022] GET /identity/v3/role_assignments?user.id=0834256bdfbc48ffbc5af6d6760ecdd9&scope.project.id=69c523a41f4048cfb7df553b6feb6310&role.id=6ce8e2867947472c8b441d47e4a4e28f => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:57.363427 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753178f6-07c6-40a3-84aa-6792ea7a43d7 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:57.413456 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47cebca-7358-4149-9542-9285451d97f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:57.414166 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47cebca-7358-4149-9542-9285451d97f1 None admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:57.414511 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47cebca-7358-4149-9542-9285451d97f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:57.414796 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47cebca-7358-4149-9542-9285451d97f1 None admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:57.415517 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47cebca-7358-4149-9542-9285451d97f1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:57.417005 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47cebca-7358-4149-9542-9285451d97f1 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:57.419056 dv-cinder-844601-7-smb devstack@keystone.service[80247]: WARNING keystone.server.flask.common [None req-c47cebca-7358-4149-9542-9285451d97f1 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 01 19:22:57.437017 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.sql.core [None req-c47cebca-7358-4149-9542-9285451d97f1 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 01 19:22:57.437017 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 01 19:22:57.437017 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [parameters: {'user_id': '22e29e8e2eba40808e420a17af0c85f1', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 01 19:22:57.437017 dv-cinder-844601-7-smb devstack@keystone.service[80247]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80247) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 01 19:22:57.447798 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-c47cebca-7358-4149-9542-9285451d97f1 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 01 19:22:57.447798 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:57.447798 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 01 19:22:57.447798 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 01 19:22:57.447798 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 01 19:22:57.447798 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 01 19:22:57.447798 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 01 19:22:57.447798 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application result = self._query(query) Jul 01 19:22:57.447798 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 01 19:22:57.447798 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application conn.query(q) Jul 01 19:22:57.447798 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 01 19:22:57.447798 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 01 19:22:57.447798 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 01 19:22:57.447798 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application result.read() Jul 01 19:22:57.447798 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 01 19:22:57.448761 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 01 19:22:57.448761 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 01 19:22:57.448761 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 01 19:22:57.448761 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 01 19:22:57.448761 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 01 19:22:57.448761 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 01 19:22:57.448761 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 01 19:22:57.448761 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 01 19:22:57.448761 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:57.448761 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 01 19:22:57.448761 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:57.448761 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:57.448761 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 01 19:22:57.448761 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 01 19:22:57.448761 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 01 19:22:57.448761 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 01 19:22:57.448761 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 01 19:22:57.448761 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application next(self.gen) Jul 01 19:22:57.450515 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 01 19:22:57.450515 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application yield resource Jul 01 19:22:57.450515 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 01 19:22:57.450515 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application next(self.gen) Jul 01 19:22:57.450515 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 01 19:22:57.450515 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self.session.rollback() Jul 01 19:22:57.450515 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 01 19:22:57.450515 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self.force_reraise() Jul 01 19:22:57.450515 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 01 19:22:57.450515 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise self.value Jul 01 19:22:57.450515 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 01 19:22:57.450515 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 01 19:22:57.450515 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 01 19:22:57.450515 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application session.commit() Jul 01 19:22:57.450515 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 01 19:22:57.450515 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 01 19:22:57.450515 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 01 19:22:57.451476 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._prepare_impl() Jul 01 19:22:57.451476 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 01 19:22:57.451476 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self.session.flush() Jul 01 19:22:57.451476 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 01 19:22:57.451476 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._flush(objects) Jul 01 19:22:57.451476 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 01 19:22:57.451476 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 01 19:22:57.451476 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 01 19:22:57.451476 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application compat.raise_( Jul 01 19:22:57.451476 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 01 19:22:57.451476 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception Jul 01 19:22:57.451476 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 01 19:22:57.451476 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application flush_context.execute() Jul 01 19:22:57.451476 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 01 19:22:57.451476 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rec.execute(self) Jul 01 19:22:57.451476 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 01 19:22:57.451476 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 01 19:22:57.452406 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 01 19:22:57.452406 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 01 19:22:57.452406 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 01 19:22:57.452406 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 01 19:22:57.452406 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 01 19:22:57.452406 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 01 19:22:57.452406 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 01 19:22:57.452406 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 01 19:22:57.452406 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 01 19:22:57.452406 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 01 19:22:57.452406 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 01 19:22:57.452406 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 01 19:22:57.452406 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 01 19:22:57.452406 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 01 19:22:57.452406 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 01 19:22:57.452406 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception Jul 01 19:22:57.454505 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 01 19:22:57.454505 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 01 19:22:57.454505 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 01 19:22:57.454505 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 01 19:22:57.454505 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 01 19:22:57.454505 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application result = self._query(query) Jul 01 19:22:57.454505 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 01 19:22:57.454505 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application conn.query(q) Jul 01 19:22:57.454505 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 01 19:22:57.454505 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 01 19:22:57.454505 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 01 19:22:57.454505 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application result.read() Jul 01 19:22:57.454505 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 01 19:22:57.454505 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 01 19:22:57.454505 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 01 19:22:57.454505 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 01 19:22:57.455938 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 01 19:22:57.455938 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 01 19:22:57.455938 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 01 19:22:57.455938 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 01 19:22:57.455938 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 01 19:22:57.455938 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 01 19:22:57.455938 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [parameters: {'user_id': '22e29e8e2eba40808e420a17af0c85f1', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 01 19:22:57.455938 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 01 19:22:57.455938 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:57.455938 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 19:22:57.455938 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:57.455938 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:57.455938 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:57.455938 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:57.455938 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:57.457083 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:57.457083 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:57.457083 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:57.457083 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:57.457083 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:57.457083 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:57.457083 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:57.457083 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 01 19:22:57.457083 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 01 19:22:57.457083 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:57.457083 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:57.457083 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 19:22:57.457083 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:22:57.457083 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 19:22:57.457083 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:22:57.457083 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 01 19:22:57.457083 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 01 19:22:57.467088 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 01 19:22:57.467088 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 01 19:22:57.467088 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 01 19:22:57.467088 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 01 19:22:57.467088 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 01 19:22:57.467088 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:57.467088 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 477/979] 10.222.0.26 () {60 vars in 1131 bytes} [Fri Jul 1 19:22:57 2022] POST /identity/v3/users => generated 160 bytes in 216 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:57.467088 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47cebca-7358-4149-9542-9285451d97f1 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:57.475190 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:57.504411 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753178f6-07c6-40a3-84aa-6792ea7a43d7 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:57.555708 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f100160b-6fd2-4650-b0c1-261a8a5f8229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:57.556733 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100160b-6fd2-4650-b0c1-261a8a5f8229 None admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:57.557017 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100160b-6fd2-4650-b0c1-261a8a5f8229 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:57.558447 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100160b-6fd2-4650-b0c1-261a8a5f8229 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:57.558447 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f100160b-6fd2-4650-b0c1-261a8a5f8229 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:57.559954 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f100160b-6fd2-4650-b0c1-261a8a5f8229 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:57.579771 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47cebca-7358-4149-9542-9285451d97f1 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:57.583724 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 503/980] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Jul 1 19:22:57 2022] POST /identity/v3/endpoints => generated 349 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:22:57.641776 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b59a0f9-5187-40c8-af39-08bab38a0a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:57.643115 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59a0f9-5187-40c8-af39-08bab38a0a03 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:57.643394 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59a0f9-5187-40c8-af39-08bab38a0a03 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:57.643684 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59a0f9-5187-40c8-af39-08bab38a0a03 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:57.653653 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b59a0f9-5187-40c8-af39-08bab38a0a03 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:57.655454 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b59a0f9-5187-40c8-af39-08bab38a0a03 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:57.672015 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-5b59a0f9-5187-40c8-af39-08bab38a0a03 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 01 19:22:57.672015 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:57.672015 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:57.672015 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:57.672015 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:57.672015 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:57.672015 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:57.672015 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:57.672015 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:57.672015 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:57.672015 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:57.672015 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:57.672015 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 19:22:57.672015 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 19:22:57.672015 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 19:22:57.672015 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 19:22:57.673095 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:57.673095 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:57.673095 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 19:22:57.673095 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:22:57.673095 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 19:22:57.673095 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:22:57.673095 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:57.673095 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:57.673095 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:57.673095 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:57.673095 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:57.673095 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:57.673095 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:57.673095 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:57.673095 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:57.673095 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:57.673095 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:57.673095 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:57.674730 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:57.674730 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:57.674730 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 19:22:57.674730 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 19:22:57.674730 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 19:22:57.674730 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 19:22:57.674730 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 19:22:57.674730 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 19:22:57.674730 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 01 19:22:57.674730 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:57.674730 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 478/981] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Jul 1 19:22:57 2022] GET /identity/v3/users/cinder => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:57.682398 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f100160b-6fd2-4650-b0c1-261a8a5f8229 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:57.794756 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f100160b-6fd2-4650-b0c1-261a8a5f8229 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:57.831329 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234aab62-76bd-463b-9fcd-99dcfb2c0e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:57.832344 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234aab62-76bd-463b-9fcd-99dcfb2c0e63 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:57.832832 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234aab62-76bd-463b-9fcd-99dcfb2c0e63 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:57.833322 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234aab62-76bd-463b-9fcd-99dcfb2c0e63 None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:57.834313 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234aab62-76bd-463b-9fcd-99dcfb2c0e63 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:57.834803 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234aab62-76bd-463b-9fcd-99dcfb2c0e63 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:57.836411 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234aab62-76bd-463b-9fcd-99dcfb2c0e63 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:57.847446 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:57.876929 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 504/982] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Jul 1 19:22:57 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:58.227108 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae39e0-092b-46ab-a031-b187437b6aa4 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:58.227641 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae39e0-092b-46ab-a031-b187437b6aa4 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:58.227641 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae39e0-092b-46ab-a031-b187437b6aa4 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:58.229138 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 479/983] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:22:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:22:58.234519 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e099be-0727-482e-87f3-dc6c0b835601 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:58.234923 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e099be-0727-482e-87f3-dc6c0b835601 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:58.235088 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e099be-0727-482e-87f3-dc6c0b835601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:58.252060 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-89e099be-0727-482e-87f3-dc6c0b835601 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:22:58.253370 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-89e099be-0727-482e-87f3-dc6c0b835601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:22:58.323950 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 505/984] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:22:58 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:22:58.347143 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae39e0-092b-46ab-a031-b187437b6aa4 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:58.364037 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:58.452486 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae39e0-092b-46ab-a031-b187437b6aa4 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:58.486658 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba2de6-df00-4771-9efa-92c8949b5a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:58.487370 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba2de6-df00-4771-9efa-92c8949b5a2b None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:58.487757 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba2de6-df00-4771-9efa-92c8949b5a2b None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:58.488040 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba2de6-df00-4771-9efa-92c8949b5a2b None admin] PATH_INFO: `/v3/services/compute` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:58.488690 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ba2de6-df00-4771-9efa-92c8949b5a2b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:58.490108 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ba2de6-df00-4771-9efa-92c8949b5a2b None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:58.502180 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-04ba2de6-df00-4771-9efa-92c8949b5a2b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 01 19:22:58.502180 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:58.502180 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 19:22:58.502180 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 19:22:58.502180 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 19:22:58.502180 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 19:22:58.502180 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 19:22:58.502180 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:22:58.502180 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 01 19:22:58.502180 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:58.502180 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 19:22:58.502180 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:58.502180 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:58.502180 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:58.502180 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:58.502180 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:58.502180 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:58.503179 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:58.503179 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:58.503179 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:58.503179 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:58.503179 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:58.503179 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:58.503179 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 19:22:58.503179 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 19:22:58.503179 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 19:22:58.503179 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 19:22:58.503179 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:58.503179 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:58.503179 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:58.503179 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:58.503179 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:58.503179 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:58.504046 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:58.504046 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:58.504046 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:58.504046 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:58.504046 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:58.504046 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:58.504046 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:58.504046 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:58.504046 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:58.504046 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:58.504046 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 19:22:58.504046 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:22:58.504046 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 01 19:22:58.504046 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:58.511470 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 480/985] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Jul 1 19:22:58 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:58.511605 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e099be-0727-482e-87f3-dc6c0b835601 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:58.610627 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e099be-0727-482e-87f3-dc6c0b835601 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:58.641502 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:58.653800 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8033ab3e-acf7-48d4-b7bc-73492426d661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:58.654468 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033ab3e-acf7-48d4-b7bc-73492426d661 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:58.654760 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033ab3e-acf7-48d4-b7bc-73492426d661 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:58.655044 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033ab3e-acf7-48d4-b7bc-73492426d661 None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:58.655758 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8033ab3e-acf7-48d4-b7bc-73492426d661 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:58.656071 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8033ab3e-acf7-48d4-b7bc-73492426d661 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:58.657479 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8033ab3e-acf7-48d4-b7bc-73492426d661 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:58.667070 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 506/986] 10.222.0.26 () {56 vars in 1112 bytes} [Fri Jul 1 19:22:58 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:58.668755 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba2de6-df00-4771-9efa-92c8949b5a2b None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:58.750006 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:58.774392 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba2de6-df00-4771-9efa-92c8949b5a2b None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:58.808961 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ce535-5be6-4446-9277-ef6278c07f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:58.809655 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ce535-5be6-4446-9277-ef6278c07f56 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:58.809941 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ce535-5be6-4446-9277-ef6278c07f56 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:58.810216 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ce535-5be6-4446-9277-ef6278c07f56 None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:58.810915 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80ce535-5be6-4446-9277-ef6278c07f56 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:58.811224 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80ce535-5be6-4446-9277-ef6278c07f56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:58.812592 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80ce535-5be6-4446-9277-ef6278c07f56 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:58.817688 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 481/987] 10.222.0.26 () {56 vars in 1112 bytes} [Fri Jul 1 19:22:58 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:58.823188 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8033ab3e-acf7-48d4-b7bc-73492426d661 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:58.923854 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8033ab3e-acf7-48d4-b7bc-73492426d661 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:58.957820 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de83e388-7e20-405c-8475-4222daed019d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:58.958475 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de83e388-7e20-405c-8475-4222daed019d None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:58.958762 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de83e388-7e20-405c-8475-4222daed019d None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:58.959042 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de83e388-7e20-405c-8475-4222daed019d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:58.959832 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de83e388-7e20-405c-8475-4222daed019d None admin] RBAC: Adding query filter params (interface=public, service_id=b27f09b2887047ddb4540f483a65903d, region_id=RegionOne) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:58.960148 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de83e388-7e20-405c-8475-4222daed019d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:58.961528 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de83e388-7e20-405c-8475-4222daed019d None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:58.975594 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 507/988] 10.222.0.26 () {56 vars in 1251 bytes} [Fri Jul 1 19:22:58 2022] GET /identity/v3/endpoints?service_id=b27f09b2887047ddb4540f483a65903d&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:22:58.975751 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ce535-5be6-4446-9277-ef6278c07f56 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:59.078709 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ce535-5be6-4446-9277-ef6278c07f56 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:59.112160 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb1d52-2597-4c5d-898a-b27359a22671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:59.112893 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb1d52-2597-4c5d-898a-b27359a22671 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:59.113180 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb1d52-2597-4c5d-898a-b27359a22671 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:59.113490 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb1d52-2597-4c5d-898a-b27359a22671 None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:59.114175 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bb1d52-2597-4c5d-898a-b27359a22671 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:59.115553 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bb1d52-2597-4c5d-898a-b27359a22671 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:59.129279 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 482/989] 10.222.0.26 () {56 vars in 1087 bytes} [Fri Jul 1 19:22:58 2022] GET /identity/v3/services => generated 1727 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:22:59.549913 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2f128-e7d6-4d32-95ea-a76db9c5a07a None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:59.550519 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2f128-e7d6-4d32-95ea-a76db9c5a07a None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:59.550628 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2f128-e7d6-4d32-95ea-a76db9c5a07a None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:59.552084 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 508/990] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:22:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:22:59.557421 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06773a74-ac7c-4f92-941e-335a3d9ce650 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:59.557905 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06773a74-ac7c-4f92-941e-335a3d9ce650 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:59.557985 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06773a74-ac7c-4f92-941e-335a3d9ce650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:59.569626 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:59.575735 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-06773a74-ac7c-4f92-941e-335a3d9ce650 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:22:59.577261 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-06773a74-ac7c-4f92-941e-335a3d9ce650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:22:59.651086 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 483/991] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:22:59 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:22:59.674079 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be2f128-e7d6-4d32-95ea-a76db9c5a07a None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:59.705421 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d500835e-5ec2-4194-b97d-ea5cfbfebf6c None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:59.705713 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d500835e-5ec2-4194-b97d-ea5cfbfebf6c None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:59.705988 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d500835e-5ec2-4194-b97d-ea5cfbfebf6c None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:59.707478 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 484/992] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:22:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:22:59.712079 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ed06b-eec1-4c92-945e-4bc273399cc1 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:59.712365 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ed06b-eec1-4c92-945e-4bc273399cc1 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:59.712640 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ed06b-eec1-4c92-945e-4bc273399cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:59.729946 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-3c6ed06b-eec1-4c92-945e-4bc273399cc1 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:22:59.731163 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-3c6ed06b-eec1-4c92-945e-4bc273399cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:22:59.735349 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:59.790446 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be2f128-e7d6-4d32-95ea-a76db9c5a07a None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:59.803462 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 485/993] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:22:59 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 01 19:22:59.826666 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6ed06b-eec1-4c92-945e-4bc273399cc1 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:59.827621 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9061184b-1a12-475b-8455-48f5df84c693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:59.828441 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9061184b-1a12-475b-8455-48f5df84c693 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:59.828733 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9061184b-1a12-475b-8455-48f5df84c693 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:59.829007 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9061184b-1a12-475b-8455-48f5df84c693 None admin] PATH_INFO: `/v3/services/image` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:59.830453 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9061184b-1a12-475b-8455-48f5df84c693 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:59.831064 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9061184b-1a12-475b-8455-48f5df84c693 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:59.843486 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-9061184b-1a12-475b-8455-48f5df84c693 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 01 19:22:59.843486 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:59.843486 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 19:22:59.843486 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 19:22:59.843486 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 19:22:59.843486 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 19:22:59.843486 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 19:22:59.843486 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:22:59.843486 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 01 19:22:59.843486 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:59.843486 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 19:22:59.843486 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:59.843486 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:59.843486 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:59.843486 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:59.843486 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:59.843486 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:59.844489 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:59.844489 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:59.844489 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:59.844489 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:59.844489 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:59.844489 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:59.844489 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 19:22:59.844489 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 19:22:59.844489 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 19:22:59.844489 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 19:22:59.844489 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:59.844489 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:59.844489 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:59.844489 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:59.844489 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:59.844489 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:59.846049 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:59.846049 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:59.846049 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:59.846049 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:59.846049 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:59.846049 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:59.846049 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:59.846049 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:59.846049 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:59.846049 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:59.846049 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 19:22:59.846049 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:22:59.846049 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 01 19:22:59.846049 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:22:59.846049 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 509/994] 10.222.0.26 () {56 vars in 1105 bytes} [Fri Jul 1 19:22:59 2022] GET /identity/v3/services/image => generated 86 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:22:59.850515 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9061184b-1a12-475b-8455-48f5df84c693 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:59.899813 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:59.939088 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6ed06b-eec1-4c92-945e-4bc273399cc1 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:59.956686 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9061184b-1a12-475b-8455-48f5df84c693 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:22:59.973682 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:22:59.974728 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aa5930-0080-4cf2-a074-020286a7d428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:59.975620 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aa5930-0080-4cf2-a074-020286a7d428 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:59.975857 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aa5930-0080-4cf2-a074-020286a7d428 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:59.976199 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aa5930-0080-4cf2-a074-020286a7d428 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:59.977104 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aa5930-0080-4cf2-a074-020286a7d428 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:59.978754 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aa5930-0080-4cf2-a074-020286a7d428 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:22:59.990779 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-84aa5930-0080-4cf2-a074-020286a7d428 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 01 19:22:59.990779 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:59.990779 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 19:22:59.990779 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 19:22:59.990779 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 19:22:59.990779 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 19:22:59.990779 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 19:22:59.990779 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:22:59.990779 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 01 19:22:59.990779 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:59.990779 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 19:22:59.990779 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:59.990779 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:22:59.990779 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:22:59.990779 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:22:59.990779 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:22:59.990779 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:22:59.991768 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:22:59.991768 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:22:59.991768 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:22:59.991768 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:22:59.991768 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:22:59.991768 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:22:59.991768 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 19:22:59.991768 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 19:22:59.991768 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 19:22:59.991768 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 19:22:59.991768 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:22:59.991768 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:22:59.991768 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:22:59.991768 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:22:59.991768 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:22:59.991768 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:22:59.993378 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:22:59.993378 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:22:59.993378 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:22:59.993378 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:22:59.993378 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:22:59.993378 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:22:59.993378 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:22:59.993378 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:22:59.993378 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:22:59.993378 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:22:59.993378 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 19:22:59.993378 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:22:59.993378 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 01 19:22:59.993378 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:22:59.993378 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 486/995] 10.222.0.26 () {56 vars in 1126 bytes} [Fri Jul 1 19:22:59 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:22:59.994911 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5910db-8f1b-4b70-afa9-e9b8df34bf36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:22:59.995572 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5910db-8f1b-4b70-afa9-e9b8df34bf36 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:22:59.995857 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5910db-8f1b-4b70-afa9-e9b8df34bf36 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:22:59.996135 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5910db-8f1b-4b70-afa9-e9b8df34bf36 None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:22:59.996914 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5910db-8f1b-4b70-afa9-e9b8df34bf36 None admin] RBAC: Adding query filter params (name=image) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:22:59.997228 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5910db-8f1b-4b70-afa9-e9b8df34bf36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:22:59.997958 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aa5930-0080-4cf2-a074-020286a7d428 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:22:59.998613 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5910db-8f1b-4b70-afa9-e9b8df34bf36 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:00.004445 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 510/996] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:22:59 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:23:00.010031 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5910db-8f1b-4b70-afa9-e9b8df34bf36 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:00.105206 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aa5930-0080-4cf2-a074-020286a7d428 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:00.115931 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5910db-8f1b-4b70-afa9-e9b8df34bf36 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:00.135755 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:00.142707 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83767e6c-4a8c-4bf4-952c-d8d4ef8964c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:00.143369 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83767e6c-4a8c-4bf4-952c-d8d4ef8964c8 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:00.143661 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83767e6c-4a8c-4bf4-952c-d8d4ef8964c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:00.143941 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83767e6c-4a8c-4bf4-952c-d8d4ef8964c8 None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:00.144640 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83767e6c-4a8c-4bf4-952c-d8d4ef8964c8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:23:00.144951 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83767e6c-4a8c-4bf4-952c-d8d4ef8964c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:00.146361 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83767e6c-4a8c-4bf4-952c-d8d4ef8964c8 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:00.151572 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 487/997] 10.222.0.26 () {56 vars in 1122 bytes} [Fri Jul 1 19:22:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:23:00.156829 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83767e6c-4a8c-4bf4-952c-d8d4ef8964c8 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:00.158959 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97fede0-205f-47a1-9ca4-7aae3219b045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:00.160020 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fede0-205f-47a1-9ca4-7aae3219b045 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:00.160483 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fede0-205f-47a1-9ca4-7aae3219b045 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:00.160953 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fede0-205f-47a1-9ca4-7aae3219b045 None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:00.161872 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97fede0-205f-47a1-9ca4-7aae3219b045 None admin] RBAC: Adding query filter params (type=image) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:23:00.162361 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97fede0-205f-47a1-9ca4-7aae3219b045 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:00.163889 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97fede0-205f-47a1-9ca4-7aae3219b045 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:00.168900 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 511/998] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:23:00 2022] GET /identity/v3/services?type=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:23:00.282019 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83767e6c-4a8c-4bf4-952c-d8d4ef8964c8 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:00.318777 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634081ea-a29b-4311-af6c-c8d1086a2564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:00.319471 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634081ea-a29b-4311-af6c-c8d1086a2564 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:00.319754 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634081ea-a29b-4311-af6c-c8d1086a2564 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:00.320023 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634081ea-a29b-4311-af6c-c8d1086a2564 None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:00.321167 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634081ea-a29b-4311-af6c-c8d1086a2564 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:23:00.321167 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634081ea-a29b-4311-af6c-c8d1086a2564 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:00.322615 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634081ea-a29b-4311-af6c-c8d1086a2564 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:00.328654 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 488/999] 10.222.0.26 () {56 vars in 1122 bytes} [Fri Jul 1 19:23:00 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:23:00.334359 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97fede0-205f-47a1-9ca4-7aae3219b045 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:00.384606 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:00.442673 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97fede0-205f-47a1-9ca4-7aae3219b045 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:00.476906 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8519b302-2abf-4112-b3ee-feca0f79ea95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:00.477596 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519b302-2abf-4112-b3ee-feca0f79ea95 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:00.477888 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519b302-2abf-4112-b3ee-feca0f79ea95 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:00.478167 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519b302-2abf-4112-b3ee-feca0f79ea95 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:00.478958 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8519b302-2abf-4112-b3ee-feca0f79ea95 None admin] RBAC: Adding query filter params (interface=admin, service_id=cf155c86a8a44493868f4a31c628bd83, region_id=RegionOne) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:23:00.479273 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8519b302-2abf-4112-b3ee-feca0f79ea95 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:00.481268 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8519b302-2abf-4112-b3ee-feca0f79ea95 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:00.486986 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 512/1000] 10.222.0.26 () {56 vars in 1249 bytes} [Fri Jul 1 19:23:00 2022] GET /identity/v3/endpoints?service_id=cf155c86a8a44493868f4a31c628bd83&interface=admin®ion_id=RegionOne => generated 193 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:23:00.492591 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634081ea-a29b-4311-af6c-c8d1086a2564 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:00.552324 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:00.596620 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634081ea-a29b-4311-af6c-c8d1086a2564 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:00.636557 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0dbf81-118f-4e58-b10c-6fe08d4d38c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:00.637189 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0dbf81-118f-4e58-b10c-6fe08d4d38c5 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:00.637506 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0dbf81-118f-4e58-b10c-6fe08d4d38c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:00.637787 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0dbf81-118f-4e58-b10c-6fe08d4d38c5 None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:00.638479 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0dbf81-118f-4e58-b10c-6fe08d4d38c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:00.640102 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0dbf81-118f-4e58-b10c-6fe08d4d38c5 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:00.646981 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 489/1001] 10.222.0.26 () {56 vars in 1087 bytes} [Fri Jul 1 19:23:00 2022] GET /identity/v3/services => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:23:01.166215 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee73d6f-189e-4664-be59-2b3cc166d0bb None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:01.166778 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee73d6f-189e-4664-be59-2b3cc166d0bb None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:01.166778 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee73d6f-189e-4664-be59-2b3cc166d0bb None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:01.168840 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 513/1002] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:23:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:23:01.173791 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357f5ee-aaa0-4282-9ec4-40da96c29286 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:01.174171 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357f5ee-aaa0-4282-9ec4-40da96c29286 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:01.174524 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357f5ee-aaa0-4282-9ec4-40da96c29286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:01.191581 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-c357f5ee-aaa0-4282-9ec4-40da96c29286 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:23:01.192766 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-c357f5ee-aaa0-4282-9ec4-40da96c29286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:23:01.261478 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 490/1003] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:23:01 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:23:01.285414 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee73d6f-189e-4664-be59-2b3cc166d0bb None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:01.395350 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee73d6f-189e-4664-be59-2b3cc166d0bb None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:01.404936 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:01.430139 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba47d39f-eb81-4a2c-b2d5-c4adb52201b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:01.430853 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47d39f-eb81-4a2c-b2d5-c4adb52201b9 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:01.431136 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47d39f-eb81-4a2c-b2d5-c4adb52201b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:01.431412 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47d39f-eb81-4a2c-b2d5-c4adb52201b9 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:01.432056 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba47d39f-eb81-4a2c-b2d5-c4adb52201b9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:01.433440 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba47d39f-eb81-4a2c-b2d5-c4adb52201b9 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:01.444789 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-ba47d39f-eb81-4a2c-b2d5-c4adb52201b9 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 01 19:23:01.444789 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:23:01.444789 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 19:23:01.444789 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 19:23:01.444789 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 19:23:01.444789 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 19:23:01.444789 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 19:23:01.444789 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:23:01.444789 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 01 19:23:01.444789 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:23:01.444789 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 19:23:01.444789 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:23:01.444789 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:23:01.444789 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:23:01.444789 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:23:01.444789 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:23:01.444789 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:23:01.445840 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:23:01.445840 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:23:01.445840 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:23:01.445840 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:23:01.445840 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:23:01.445840 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:23:01.445840 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 19:23:01.445840 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 19:23:01.445840 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 19:23:01.445840 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 19:23:01.445840 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:23:01.445840 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:23:01.445840 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:23:01.445840 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:23:01.445840 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:23:01.445840 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:23:01.446824 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:23:01.446824 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:23:01.446824 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:23:01.446824 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:23:01.446824 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:23:01.446824 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:23:01.446824 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:23:01.446824 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:23:01.446824 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:23:01.446824 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:23:01.446824 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 19:23:01.446824 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:23:01.446824 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 01 19:23:01.446824 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:23:01.446824 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 514/1004] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Jul 1 19:23:01 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:23:01.453279 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c357f5ee-aaa0-4282-9ec4-40da96c29286 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:01.505450 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:01.553169 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c357f5ee-aaa0-4282-9ec4-40da96c29286 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:01.586824 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaf9bfe-2792-454a-b675-c1dd7dfd0c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:01.587476 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf9bfe-2792-454a-b675-c1dd7dfd0c9f None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:01.587755 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf9bfe-2792-454a-b675-c1dd7dfd0c9f None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:01.588025 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf9bfe-2792-454a-b675-c1dd7dfd0c9f None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:01.588722 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaf9bfe-2792-454a-b675-c1dd7dfd0c9f None admin] RBAC: Adding query filter params (name=compute) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:23:01.589025 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaf9bfe-2792-454a-b675-c1dd7dfd0c9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:01.590451 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaf9bfe-2792-454a-b675-c1dd7dfd0c9f None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:01.595353 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 491/1005] 10.222.0.26 () {56 vars in 1112 bytes} [Fri Jul 1 19:23:01 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:23:01.600670 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba47d39f-eb81-4a2c-b2d5-c4adb52201b9 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:01.711040 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba47d39f-eb81-4a2c-b2d5-c4adb52201b9 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:01.744204 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d014b907-d1a5-457a-92c6-c9f4383bbdd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:01.744882 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d014b907-d1a5-457a-92c6-c9f4383bbdd7 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:01.745163 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d014b907-d1a5-457a-92c6-c9f4383bbdd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:01.745471 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d014b907-d1a5-457a-92c6-c9f4383bbdd7 None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:01.746744 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d014b907-d1a5-457a-92c6-c9f4383bbdd7 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:23:01.747056 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d014b907-d1a5-457a-92c6-c9f4383bbdd7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:01.748456 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d014b907-d1a5-457a-92c6-c9f4383bbdd7 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:01.758793 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 515/1006] 10.222.0.26 () {56 vars in 1112 bytes} [Fri Jul 1 19:23:01 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:23:01.760855 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaf9bfe-2792-454a-b675-c1dd7dfd0c9f None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:01.861928 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaf9bfe-2792-454a-b675-c1dd7dfd0c9f None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:01.878804 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:01.897615 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cba6839-20b1-4a20-a812-01ccf4e7db9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:01.898272 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba6839-20b1-4a20-a812-01ccf4e7db9c None admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:01.898552 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba6839-20b1-4a20-a812-01ccf4e7db9c None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:01.898823 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba6839-20b1-4a20-a812-01ccf4e7db9c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:01.899551 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cba6839-20b1-4a20-a812-01ccf4e7db9c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:01.900917 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cba6839-20b1-4a20-a812-01ccf4e7db9c None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:01.925341 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 492/1007] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Jul 1 19:23:01 2022] POST /identity/v3/endpoints => generated 334 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:23:02.221565 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b88c4f7-ea46-42d4-9805-6be9f1354694 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:02.222116 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b88c4f7-ea46-42d4-9805-6be9f1354694 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:02.222116 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b88c4f7-ea46-42d4-9805-6be9f1354694 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:02.223867 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 516/1008] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:23:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:23:02.229328 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e4da58-9193-4078-a986-b5a6df1a70cb None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:02.229859 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e4da58-9193-4078-a986-b5a6df1a70cb None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:02.230353 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e4da58-9193-4078-a986-b5a6df1a70cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:02.249079 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-c1e4da58-9193-4078-a986-b5a6df1a70cb None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:23:02.250641 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-c1e4da58-9193-4078-a986-b5a6df1a70cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:23:02.329632 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 493/1009] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:23:02 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:23:02.352503 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b88c4f7-ea46-42d4-9805-6be9f1354694 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:02.392036 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:02.467869 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b88c4f7-ea46-42d4-9805-6be9f1354694 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:02.507464 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5bc97b-e5eb-46d0-94ea-79f40e91f3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:02.508848 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5bc97b-e5eb-46d0-94ea-79f40e91f3a3 None admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:02.509380 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5bc97b-e5eb-46d0-94ea-79f40e91f3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:02.509907 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5bc97b-e5eb-46d0-94ea-79f40e91f3a3 None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:02.510903 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5bc97b-e5eb-46d0-94ea-79f40e91f3a3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:02.513081 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5bc97b-e5eb-46d0-94ea-79f40e91f3a3 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:02.537857 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 517/1010] 10.222.0.26 () {60 vars in 1141 bytes} [Fri Jul 1 19:23:02 2022] POST /identity/v3/services => generated 242 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:23:02.708973 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db920380-a3b9-477e-8e1d-a7ad08124d34 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:02.709296 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db920380-a3b9-477e-8e1d-a7ad08124d34 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:02.709589 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db920380-a3b9-477e-8e1d-a7ad08124d34 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:02.711005 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 494/1011] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:23:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:23:02.716462 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af12b3cc-e499-4692-874f-956cc2fa3110 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:02.716763 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af12b3cc-e499-4692-874f-956cc2fa3110 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:02.717050 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af12b3cc-e499-4692-874f-956cc2fa3110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:02.736001 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-af12b3cc-e499-4692-874f-956cc2fa3110 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:23:02.737207 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-af12b3cc-e499-4692-874f-956cc2fa3110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:23:02.813821 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 518/1012] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:23:02 2022] POST /identity/v3/auth/tokens => generated 1812 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:23:02.836791 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db920380-a3b9-477e-8e1d-a7ad08124d34 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:02.935540 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:02.940949 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db920380-a3b9-477e-8e1d-a7ad08124d34 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:02.977470 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae491515-9d56-4b65-9a1c-8786649da631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:02.978550 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae491515-9d56-4b65-9a1c-8786649da631 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:02.979068 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae491515-9d56-4b65-9a1c-8786649da631 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:02.979546 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae491515-9d56-4b65-9a1c-8786649da631 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:02.980377 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae491515-9d56-4b65-9a1c-8786649da631 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:02.982011 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae491515-9d56-4b65-9a1c-8786649da631 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:02.994422 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-ae491515-9d56-4b65-9a1c-8786649da631 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 01 19:23:02.994422 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:23:02.994422 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 19:23:02.994422 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 19:23:02.994422 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 19:23:02.994422 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 19:23:02.994422 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 19:23:02.994422 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:23:02.994422 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 01 19:23:02.994422 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:23:02.994422 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 19:23:02.994422 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:23:02.994422 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:23:02.994422 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:23:02.994422 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:23:02.994422 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:23:02.994422 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:23:02.995461 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:23:02.995461 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:23:02.995461 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:23:02.995461 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:23:02.995461 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:23:02.995461 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:23:02.995461 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 19:23:02.995461 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 19:23:02.995461 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 19:23:02.995461 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 19:23:02.995461 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:23:02.995461 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:23:02.995461 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:23:02.995461 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:23:02.995461 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:23:02.995461 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:23:02.996394 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:23:02.996394 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:23:02.996394 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:23:02.996394 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:23:02.996394 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:23:02.996394 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:23:02.996394 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:23:02.996394 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:23:02.996394 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:23:02.996394 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:23:02.996394 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 19:23:02.996394 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:23:02.996394 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 01 19:23:02.996394 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:23:03.001310 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 495/1013] 10.222.0.26 () {56 vars in 1126 bytes} [Fri Jul 1 19:23:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:23:03.002677 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af12b3cc-e499-4692-874f-956cc2fa3110 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:03.029147 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:03.107566 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af12b3cc-e499-4692-874f-956cc2fa3110 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:03.142960 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9409a4-0396-47ab-91aa-d49fd8c67dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:03.143632 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9409a4-0396-47ab-91aa-d49fd8c67dff None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:03.143917 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9409a4-0396-47ab-91aa-d49fd8c67dff None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:03.144193 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9409a4-0396-47ab-91aa-d49fd8c67dff None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:03.144900 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9409a4-0396-47ab-91aa-d49fd8c67dff None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:23:03.145211 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9409a4-0396-47ab-91aa-d49fd8c67dff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:03.146658 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9409a4-0396-47ab-91aa-d49fd8c67dff None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:03.156260 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 519/1014] 10.222.0.26 () {56 vars in 1122 bytes} [Fri Jul 1 19:23:03 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:23:03.157363 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae491515-9d56-4b65-9a1c-8786649da631 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:03.265833 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae491515-9d56-4b65-9a1c-8786649da631 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:03.300044 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3e17da-22c9-4273-b9bd-5553ad173a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:03.300612 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e17da-22c9-4273-b9bd-5553ad173a89 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:03.300894 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e17da-22c9-4273-b9bd-5553ad173a89 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:03.301170 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e17da-22c9-4273-b9bd-5553ad173a89 None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:03.301905 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3e17da-22c9-4273-b9bd-5553ad173a89 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:23:03.302216 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3e17da-22c9-4273-b9bd-5553ad173a89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:03.303849 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3e17da-22c9-4273-b9bd-5553ad173a89 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:03.309493 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 496/1015] 10.222.0.26 () {56 vars in 1122 bytes} [Fri Jul 1 19:23:03 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:23:03.314961 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9409a4-0396-47ab-91aa-d49fd8c67dff None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:03.398919 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:03.419193 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9409a4-0396-47ab-91aa-d49fd8c67dff None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:03.453276 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bfc496-cb78-49cb-92db-3cc83a123c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:03.453928 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bfc496-cb78-49cb-92db-3cc83a123c3f None admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:03.454213 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bfc496-cb78-49cb-92db-3cc83a123c3f None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:03.454492 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bfc496-cb78-49cb-92db-3cc83a123c3f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:03.455241 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bfc496-cb78-49cb-92db-3cc83a123c3f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:03.456600 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bfc496-cb78-49cb-92db-3cc83a123c3f None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:03.472312 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 520/1016] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Jul 1 19:23:03 2022] POST /identity/v3/endpoints => generated 325 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:23:04.091863 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a4ff75-5dea-4316-aae9-1e04cf4c3bb5 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:04.092396 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a4ff75-5dea-4316-aae9-1e04cf4c3bb5 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:04.092396 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a4ff75-5dea-4316-aae9-1e04cf4c3bb5 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:04.093940 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 497/1017] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:23:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:23:04.098945 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f38f298-9141-4584-b7f7-08d7629b79c3 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:04.099240 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f38f298-9141-4584-b7f7-08d7629b79c3 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:04.099520 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f38f298-9141-4584-b7f7-08d7629b79c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:04.116771 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-6f38f298-9141-4584-b7f7-08d7629b79c3 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:23:04.117970 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-6f38f298-9141-4584-b7f7-08d7629b79c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:23:04.190017 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 521/1018] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:23:04 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:23:04.213336 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a4ff75-5dea-4316-aae9-1e04cf4c3bb5 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:04.242137 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:04.322420 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a4ff75-5dea-4316-aae9-1e04cf4c3bb5 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:04.356908 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982faed2-525d-47e8-86c8-a08374d1e2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:04.357764 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982faed2-525d-47e8-86c8-a08374d1e2ef None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:04.358038 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982faed2-525d-47e8-86c8-a08374d1e2ef None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:04.358310 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982faed2-525d-47e8-86c8-a08374d1e2ef None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:04.370248 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982faed2-525d-47e8-86c8-a08374d1e2ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:23:04.379105 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-982faed2-525d-47e8-86c8-a08374d1e2ef None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 01 19:23:04.379105 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:23:04.379105 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:23:04.379105 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:23:04.379105 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:23:04.379105 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:23:04.379105 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:23:04.379105 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:23:04.379105 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:23:04.379105 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:23:04.379105 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:23:04.379105 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:23:04.379105 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:23:04.379105 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:23:04.379105 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:23:04.379105 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:23:04.380052 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:23:04.380052 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:23:04.380052 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:23:04.380052 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:23:04.380052 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:23:04.380052 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:23:04.380052 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:23:04.380052 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:23:04.380052 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:23:04.380052 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:23:04.380052 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:23:04.380052 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:23:04.380052 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:23:04.380052 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:23:04.380052 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:23:04.380052 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:23:04.380939 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:23:04.380939 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:23:04.380939 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:23:04.380939 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:23:04.380939 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:23:04.380939 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:23:04.380939 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:23:04.380939 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:23:04.380939 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:23:04.380939 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:23:04.380939 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 01 19:23:04.380939 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:23:04.382276 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 498/1019] 10.222.0.26 () {56 vars in 1120 bytes} [Fri Jul 1 19:23:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:23:04.386390 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f38f298-9141-4584-b7f7-08d7629b79c3 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:04.458495 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:04.492006 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f38f298-9141-4584-b7f7-08d7629b79c3 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:04.526411 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675bdec7-ef79-4022-a259-829e5db435ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:04.527078 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675bdec7-ef79-4022-a259-829e5db435ce None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:04.527384 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675bdec7-ef79-4022-a259-829e5db435ce None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:04.527659 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675bdec7-ef79-4022-a259-829e5db435ce None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:04.528405 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675bdec7-ef79-4022-a259-829e5db435ce None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:23:04.528712 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675bdec7-ef79-4022-a259-829e5db435ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:04.530096 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675bdec7-ef79-4022-a259-829e5db435ce None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:04.538512 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 522/1020] 10.222.0.26 () {56 vars in 1115 bytes} [Fri Jul 1 19:23:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:23:04.544595 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982faed2-525d-47e8-86c8-a08374d1e2ef None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:04.623815 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f041d69-98f8-407d-ada8-f6b2be96495e None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:04.624188 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f041d69-98f8-407d-ada8-f6b2be96495e None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:04.624674 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f041d69-98f8-407d-ada8-f6b2be96495e None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:04.626948 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 523/1021] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:23:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:23:04.631993 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90de38b-c59b-4213-9d69-11065b8ad156 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:04.632282 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90de38b-c59b-4213-9d69-11065b8ad156 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:04.632559 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90de38b-c59b-4213-9d69-11065b8ad156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:04.641616 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:04.650598 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-e90de38b-c59b-4213-9d69-11065b8ad156 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:23:04.651786 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-e90de38b-c59b-4213-9d69-11065b8ad156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:23:04.658715 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982faed2-525d-47e8-86c8-a08374d1e2ef None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:04.694571 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7758dadc-6e60-47e9-b6e8-a8800a7afa66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:04.695359 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758dadc-6e60-47e9-b6e8-a8800a7afa66 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:04.695641 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758dadc-6e60-47e9-b6e8-a8800a7afa66 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:04.695913 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758dadc-6e60-47e9-b6e8-a8800a7afa66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:04.706126 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7758dadc-6e60-47e9-b6e8-a8800a7afa66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:04.707696 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7758dadc-6e60-47e9-b6e8-a8800a7afa66 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:04.725367 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 524/1022] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:23:04 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 01 19:23:04.725770 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-7758dadc-6e60-47e9-b6e8-a8800a7afa66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:23:04.725770 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:23:04.725770 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:23:04.725770 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:23:04.725770 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:23:04.725770 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:23:04.725770 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:23:04.725770 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:23:04.725770 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:23:04.725770 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:23:04.725770 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:23:04.725770 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:23:04.725770 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:23:04.725770 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:23:04.725770 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:23:04.726667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:23:04.726667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:23:04.726667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:23:04.726667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:23:04.726667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:23:04.726667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:23:04.726667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:23:04.726667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:23:04.726667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:23:04.726667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:23:04.726667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:23:04.726667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:23:04.726667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:23:04.726667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:23:04.726667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:23:04.726667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:23:04.726667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:23:04.727603 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:23:04.727603 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:23:04.727603 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:23:04.727603 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:23:04.727603 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 499/1023] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:23:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:23:04.736316 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90de38b-c59b-4213-9d69-11065b8ad156 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:04.753027 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7758dadc-6e60-47e9-b6e8-a8800a7afa66 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:04.799618 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:04.840883 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90de38b-c59b-4213-9d69-11065b8ad156 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:04.861988 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7758dadc-6e60-47e9-b6e8-a8800a7afa66 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:04.879408 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150a58ca-950f-4737-acb8-4edca926cb37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:04.880429 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a58ca-950f-4737-acb8-4edca926cb37 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:04.880954 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a58ca-950f-4737-acb8-4edca926cb37 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:04.881540 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a58ca-950f-4737-acb8-4edca926cb37 None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:04.882559 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150a58ca-950f-4737-acb8-4edca926cb37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:23:04.883045 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150a58ca-950f-4737-acb8-4edca926cb37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:04.884675 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150a58ca-950f-4737-acb8-4edca926cb37 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:04.901035 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 525/1024] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Jul 1 19:23:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:23:04.901191 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62aef3-97d3-4082-af4d-5e93be94cd9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:04.901191 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62aef3-97d3-4082-af4d-5e93be94cd9c None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:04.901191 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62aef3-97d3-4082-af4d-5e93be94cd9c None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:04.901191 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62aef3-97d3-4082-af4d-5e93be94cd9c None admin] PATH_INFO: `/v3/services/image` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:04.901512 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb62aef3-97d3-4082-af4d-5e93be94cd9c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:04.902064 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb62aef3-97d3-4082-af4d-5e93be94cd9c None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:04.902757 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150a58ca-950f-4737-acb8-4edca926cb37 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:04.916406 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-eb62aef3-97d3-4082-af4d-5e93be94cd9c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 01 19:23:04.916406 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:23:04.916406 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 19:23:04.916406 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 19:23:04.916406 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 19:23:04.916406 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 19:23:04.916406 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 19:23:04.916406 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:23:04.916406 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 01 19:23:04.916406 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:23:04.916406 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 19:23:04.916406 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:23:04.916406 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:23:04.916406 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:23:04.916406 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:23:04.916406 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:23:04.916406 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:23:04.917786 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:23:04.917786 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:23:04.917786 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:23:04.917786 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:23:04.917786 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:23:04.917786 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:23:04.917786 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 19:23:04.917786 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 19:23:04.917786 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 19:23:04.917786 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 19:23:04.917786 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:23:04.917786 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:23:04.917786 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:23:04.917786 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:23:04.917786 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:23:04.917786 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:23:04.919793 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:23:04.919793 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:23:04.919793 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:23:04.919793 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:23:04.919793 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:23:04.919793 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:23:04.919793 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:23:04.919793 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:23:04.919793 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:23:04.919793 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:23:04.919793 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 19:23:04.919793 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:23:04.919793 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 01 19:23:04.919793 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:23:04.919793 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 500/1025] 10.222.0.26 () {56 vars in 1105 bytes} [Fri Jul 1 19:23:04 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:23:04.924231 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62aef3-97d3-4082-af4d-5e93be94cd9c None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:04.927032 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:05.014640 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150a58ca-950f-4737-acb8-4edca926cb37 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:05.034035 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62aef3-97d3-4082-af4d-5e93be94cd9c None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:05.043599 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:05.055231 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48f4fdc-6c31-4c91-8b6f-21d095453de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:05.056027 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48f4fdc-6c31-4c91-8b6f-21d095453de3 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:05.056574 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48f4fdc-6c31-4c91-8b6f-21d095453de3 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:05.056574 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48f4fdc-6c31-4c91-8b6f-21d095453de3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:05.064811 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48f4fdc-6c31-4c91-8b6f-21d095453de3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:05.066285 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48f4fdc-6c31-4c91-8b6f-21d095453de3 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:05.077312 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157faa65-1581-4e18-8ca8-41d13a07c51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:05.077972 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157faa65-1581-4e18-8ca8-41d13a07c51c None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:05.078256 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157faa65-1581-4e18-8ca8-41d13a07c51c None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:05.078534 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157faa65-1581-4e18-8ca8-41d13a07c51c None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:05.079235 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157faa65-1581-4e18-8ca8-41d13a07c51c None admin] RBAC: Adding query filter params (name=image) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:23:05.079544 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157faa65-1581-4e18-8ca8-41d13a07c51c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:05.080898 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157faa65-1581-4e18-8ca8-41d13a07c51c None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:05.081058 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-e48f4fdc-6c31-4c91-8b6f-21d095453de3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 01 19:23:05.081058 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:23:05.081058 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:23:05.081058 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:23:05.081058 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:23:05.081058 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:23:05.081058 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:23:05.081058 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:23:05.081058 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:23:05.081058 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:23:05.081058 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:23:05.081058 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:23:05.081058 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 19:23:05.081058 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 19:23:05.081058 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 19:23:05.081058 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 19:23:05.082238 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:23:05.082238 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:23:05.082238 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 19:23:05.082238 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:23:05.082238 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 19:23:05.082238 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:23:05.082238 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:23:05.082238 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:23:05.082238 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:23:05.082238 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:23:05.082238 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:23:05.082238 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:23:05.082238 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:23:05.082238 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:23:05.082238 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:23:05.082238 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:23:05.082238 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:23:05.082238 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:23:05.083287 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:23:05.083287 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:23:05.083287 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 19:23:05.083287 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 19:23:05.083287 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 19:23:05.083287 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 19:23:05.083287 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 19:23:05.083287 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 19:23:05.083287 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 01 19:23:05.083287 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:23:05.083287 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 526/1026] 10.222.0.26 () {56 vars in 1093 bytes} [Fri Jul 1 19:23:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:23:05.087840 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48f4fdc-6c31-4c91-8b6f-21d095453de3 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:05.093603 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 501/1027] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:23:04 2022] GET /identity/v3/services?name=image => generated 122 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:23:05.095229 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157faa65-1581-4e18-8ca8-41d13a07c51c None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:05.163843 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:05.203631 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48f4fdc-6c31-4c91-8b6f-21d095453de3 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:05.203879 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157faa65-1581-4e18-8ca8-41d13a07c51c None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:05.237320 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79a1715-d872-46b9-95d3-1e20ac812433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:05.237981 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a1715-d872-46b9-95d3-1e20ac812433 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:05.238262 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a1715-d872-46b9-95d3-1e20ac812433 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:05.238532 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a1715-d872-46b9-95d3-1e20ac812433 None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:05.239228 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79a1715-d872-46b9-95d3-1e20ac812433 None admin] RBAC: Adding query filter params (type=image) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:23:05.239537 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79a1715-d872-46b9-95d3-1e20ac812433 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:05.240927 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79a1715-d872-46b9-95d3-1e20ac812433 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:05.241037 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06b3a0c-b5f0-4688-9228-6fe0af1f486c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:05.241741 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b3a0c-b5f0-4688-9228-6fe0af1f486c None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:05.242157 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b3a0c-b5f0-4688-9228-6fe0af1f486c None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:05.242442 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b3a0c-b5f0-4688-9228-6fe0af1f486c None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:05.243402 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06b3a0c-b5f0-4688-9228-6fe0af1f486c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:23:05.243715 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06b3a0c-b5f0-4688-9228-6fe0af1f486c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:05.245121 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06b3a0c-b5f0-4688-9228-6fe0af1f486c None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:05.246729 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 502/1028] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:23:05 2022] GET /identity/v3/services?type=image => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:23:05.252182 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79a1715-d872-46b9-95d3-1e20ac812433 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:05.269180 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 527/1029] 10.222.0.26 () {56 vars in 1133 bytes} [Fri Jul 1 19:23:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:23:05.269952 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06b3a0c-b5f0-4688-9228-6fe0af1f486c None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:05.318866 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:05.359993 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79a1715-d872-46b9-95d3-1e20ac812433 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:05.378868 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06b3a0c-b5f0-4688-9228-6fe0af1f486c None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:05.390010 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:05.397086 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c99699-2dc2-476a-abc3-440c55faf503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:05.397774 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c99699-2dc2-476a-abc3-440c55faf503 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:05.398060 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c99699-2dc2-476a-abc3-440c55faf503 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:05.398338 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c99699-2dc2-476a-abc3-440c55faf503 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:05.399120 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c99699-2dc2-476a-abc3-440c55faf503 None admin] RBAC: Adding query filter params (interface=public, service_id=3fab5d461e2c40219984782b36a5dc53, region_id=RegionOne) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:23:05.399542 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c99699-2dc2-476a-abc3-440c55faf503 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:05.400923 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c99699-2dc2-476a-abc3-440c55faf503 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:05.407004 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 503/1030] 10.222.0.26 () {56 vars in 1251 bytes} [Fri Jul 1 19:23:05 2022] GET /identity/v3/endpoints?service_id=3fab5d461e2c40219984782b36a5dc53&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:23:05.412441 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c99699-2dc2-476a-abc3-440c55faf503 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:05.415952 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66005ea5-77d6-4db3-b117-ac0ddb157523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:05.416543 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66005ea5-77d6-4db3-b117-ac0ddb157523 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:05.416828 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66005ea5-77d6-4db3-b117-ac0ddb157523 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:05.417104 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66005ea5-77d6-4db3-b117-ac0ddb157523 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:05.493891 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66005ea5-77d6-4db3-b117-ac0ddb157523 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:05.495463 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66005ea5-77d6-4db3-b117-ac0ddb157523 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:05.515920 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c99699-2dc2-476a-abc3-440c55faf503 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:05.540231 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:05.553718 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8fddb4-c7c4-4e4f-a93d-463725a0fb22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:05.554375 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8fddb4-c7c4-4e4f-a93d-463725a0fb22 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:05.554710 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8fddb4-c7c4-4e4f-a93d-463725a0fb22 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:05.554987 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8fddb4-c7c4-4e4f-a93d-463725a0fb22 None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:05.555665 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8fddb4-c7c4-4e4f-a93d-463725a0fb22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:05.557075 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8fddb4-c7c4-4e4f-a93d-463725a0fb22 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:05.563800 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 504/1031] 10.222.0.26 () {56 vars in 1087 bytes} [Fri Jul 1 19:23:05 2022] GET /identity/v3/services => generated 1957 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 19:23:05.604514 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19205cc-b7cd-4854-b86f-deb4d93986f9 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:05.604876 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19205cc-b7cd-4854-b86f-deb4d93986f9 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:05.605167 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19205cc-b7cd-4854-b86f-deb4d93986f9 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:05.608328 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 505/1032] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:23:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 19:23:05.615796 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 528/1033] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Jul 1 19:23:05 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 01 19:23:05.616042 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55062d-4124-437b-a0c9-9e78581ac5a7 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:05.616042 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55062d-4124-437b-a0c9-9e78581ac5a7 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:05.616042 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55062d-4124-437b-a0c9-9e78581ac5a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:05.620125 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66005ea5-77d6-4db3-b117-ac0ddb157523 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:05.637194 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-8b55062d-4124-437b-a0c9-9e78581ac5a7 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:23:05.638918 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-8b55062d-4124-437b-a0c9-9e78581ac5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:23:05.702890 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:05.718562 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 506/1034] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:23:05 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:23:05.741412 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b55062d-4124-437b-a0c9-9e78581ac5a7 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:05.749016 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66005ea5-77d6-4db3-b117-ac0ddb157523 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:05.788506 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8ba9b4-0d86-4c5a-ba4b-ef5c0b918975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:05.789325 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ba9b4-0d86-4c5a-ba4b-ef5c0b918975 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:05.789614 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ba9b4-0d86-4c5a-ba4b-ef5c0b918975 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:05.789891 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ba9b4-0d86-4c5a-ba4b-ef5c0b918975 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:05.800495 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8ba9b4-0d86-4c5a-ba4b-ef5c0b918975 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:05.801960 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8ba9b4-0d86-4c5a-ba4b-ef5c0b918975 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:05.804055 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:05.822234 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-ab8ba9b4-0d86-4c5a-ba4b-ef5c0b918975 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:23:05.822234 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:23:05.822234 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:23:05.822234 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:23:05.822234 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:23:05.822234 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:23:05.822234 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:23:05.822234 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:23:05.822234 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:23:05.822234 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:23:05.822234 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:23:05.822234 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:23:05.822234 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:23:05.822234 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:23:05.822234 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:23:05.823221 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:23:05.823221 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:23:05.823221 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:23:05.823221 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:23:05.823221 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:23:05.823221 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:23:05.823221 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:23:05.823221 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:23:05.823221 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:23:05.823221 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:23:05.823221 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:23:05.823221 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:23:05.823221 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:23:05.823221 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:23:05.823221 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:23:05.823221 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:23:05.823221 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:23:05.824762 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:23:05.824762 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:23:05.824762 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:23:05.824762 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:23:05.824762 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 529/1035] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:23:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:23:05.831304 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8ba9b4-0d86-4c5a-ba4b-ef5c0b918975 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:05.856136 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b55062d-4124-437b-a0c9-9e78581ac5a7 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:05.892845 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973efb04-372a-4129-b4cc-358c61da5327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:05.893729 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973efb04-372a-4129-b4cc-358c61da5327 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:05.894012 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973efb04-372a-4129-b4cc-358c61da5327 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:05.894287 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973efb04-372a-4129-b4cc-358c61da5327 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:05.895449 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973efb04-372a-4129-b4cc-358c61da5327 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:05.896918 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973efb04-372a-4129-b4cc-358c61da5327 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:05.898730 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 507/1036] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:23:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:23:05.904683 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973efb04-372a-4129-b4cc-358c61da5327 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:05.941002 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8ba9b4-0d86-4c5a-ba4b-ef5c0b918975 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:05.966986 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:05.979210 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc33729-94ec-4be4-9e43-885c9343e199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:05.979881 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc33729-94ec-4be4-9e43-885c9343e199 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:05.980170 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc33729-94ec-4be4-9e43-885c9343e199 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:05.980485 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc33729-94ec-4be4-9e43-885c9343e199 None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:05.981342 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc33729-94ec-4be4-9e43-885c9343e199 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:23:05.981673 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc33729-94ec-4be4-9e43-885c9343e199 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:05.983022 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc33729-94ec-4be4-9e43-885c9343e199 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:05.994980 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 530/1037] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Jul 1 19:23:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:23:06.000495 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc33729-94ec-4be4-9e43-885c9343e199 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:06.022313 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973efb04-372a-4129-b4cc-358c61da5327 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:06.059985 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:06.062491 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd87967-e249-4791-b85a-38cf2a54937a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:06.063804 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd87967-e249-4791-b85a-38cf2a54937a None admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:06.064090 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd87967-e249-4791-b85a-38cf2a54937a None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:06.064477 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd87967-e249-4791-b85a-38cf2a54937a None admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:06.065206 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd87967-e249-4791-b85a-38cf2a54937a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:06.066650 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd87967-e249-4791-b85a-38cf2a54937a None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:06.094764 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 508/1038] 10.222.0.26 () {60 vars in 1141 bytes} [Fri Jul 1 19:23:05 2022] POST /identity/v3/projects => generated 311 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 19:23:06.120298 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc33729-94ec-4be4-9e43-885c9343e199 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:06.159453 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f170678-3b04-4bba-b3ad-13ce466d63e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:06.160270 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f170678-3b04-4bba-b3ad-13ce466d63e7 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:06.160560 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f170678-3b04-4bba-b3ad-13ce466d63e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:06.160841 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f170678-3b04-4bba-b3ad-13ce466d63e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:06.168608 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f170678-3b04-4bba-b3ad-13ce466d63e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:06.170110 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f170678-3b04-4bba-b3ad-13ce466d63e7 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:06.186056 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-0f170678-3b04-4bba-b3ad-13ce466d63e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:23:06.186056 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:23:06.186056 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:23:06.186056 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:23:06.186056 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:23:06.186056 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:23:06.186056 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:23:06.186056 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:23:06.186056 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:23:06.186056 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:23:06.186056 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:23:06.186056 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:23:06.186056 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 19:23:06.186056 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 19:23:06.186056 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 19:23:06.187071 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 19:23:06.187071 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:23:06.187071 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:23:06.187071 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:23:06.187071 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:23:06.187071 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:23:06.187071 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:23:06.187071 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:23:06.187071 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:23:06.187071 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:23:06.187071 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:23:06.187071 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:23:06.187071 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:23:06.187071 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:23:06.187071 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:23:06.187071 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:23:06.187071 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:23:06.187958 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 19:23:06.187958 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 19:23:06.187958 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 19:23:06.187958 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 19:23:06.187958 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 19:23:06.187958 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 19:23:06.187958 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:23:06.187958 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:23:06.189579 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 531/1039] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Jul 1 19:23:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:23:06.193272 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd87967-e249-4791-b85a-38cf2a54937a None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:06.303906 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd87967-e249-4791-b85a-38cf2a54937a None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:06.313915 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:06.345680 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85623de7-0330-408e-b81f-b9ee74e00443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:06.346346 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85623de7-0330-408e-b81f-b9ee74e00443 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:06.346628 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85623de7-0330-408e-b81f-b9ee74e00443 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:06.347019 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85623de7-0330-408e-b81f-b9ee74e00443 None admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:06.347806 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85623de7-0330-408e-b81f-b9ee74e00443 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:23:06.348117 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85623de7-0330-408e-b81f-b9ee74e00443 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:06.349601 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85623de7-0330-408e-b81f-b9ee74e00443 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:06.362045 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 509/1040] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Jul 1 19:23:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:23:06.367777 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f170678-3b04-4bba-b3ad-13ce466d63e7 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:06.472616 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f170678-3b04-4bba-b3ad-13ce466d63e7 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:06.487235 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:06.508781 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d565a5-155b-41ce-a491-53cdfd5717a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:06.509468 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d565a5-155b-41ce-a491-53cdfd5717a1 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:06.509755 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d565a5-155b-41ce-a491-53cdfd5717a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:06.510033 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d565a5-155b-41ce-a491-53cdfd5717a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:06.510859 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d565a5-155b-41ce-a491-53cdfd5717a1 None admin] RBAC: Adding query filter params (role.id=6ce8e2867947472c8b441d47e4a4e28f, scope.project.id=69c523a41f4048cfb7df553b6feb6310, user.id=13fd76fc7dd1410b9cde5adbaa6cb2e5) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:23:06.511170 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d565a5-155b-41ce-a491-53cdfd5717a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:06.512614 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d565a5-155b-41ce-a491-53cdfd5717a1 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:06.521320 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 532/1041] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Jul 1 19:23:06 2022] GET /identity/v3/role_assignments?user.id=13fd76fc7dd1410b9cde5adbaa6cb2e5&scope.project.id=69c523a41f4048cfb7df553b6feb6310&role.id=6ce8e2867947472c8b441d47e4a4e28f => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:23:07.644960 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3975a2ae-6f7b-45f7-a5b3-8479666d3bd2 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:07.645425 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3975a2ae-6f7b-45f7-a5b3-8479666d3bd2 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:07.645618 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3975a2ae-6f7b-45f7-a5b3-8479666d3bd2 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:07.646970 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 510/1042] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:23:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:23:07.651991 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9621700d-8c63-4d76-9fa1-2f1f8d192f76 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:07.652893 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9621700d-8c63-4d76-9fa1-2f1f8d192f76 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:07.653075 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9621700d-8c63-4d76-9fa1-2f1f8d192f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:07.670377 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-9621700d-8c63-4d76-9fa1-2f1f8d192f76 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:23:07.671559 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-9621700d-8c63-4d76-9fa1-2f1f8d192f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:23:07.741945 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 533/1043] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:23:07 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:23:07.765964 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3975a2ae-6f7b-45f7-a5b3-8479666d3bd2 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:07.867664 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3975a2ae-6f7b-45f7-a5b3-8479666d3bd2 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:07.902422 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e2c39e-2810-4eb9-972a-980f84e74862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:07.903129 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e2c39e-2810-4eb9-972a-980f84e74862 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:07.903415 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e2c39e-2810-4eb9-972a-980f84e74862 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:07.903690 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e2c39e-2810-4eb9-972a-980f84e74862 None admin] PATH_INFO: `/v3/services/image` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:07.904336 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e2c39e-2810-4eb9-972a-980f84e74862 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:07.905738 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e2c39e-2810-4eb9-972a-980f84e74862 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:07.917126 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-59e2c39e-2810-4eb9-972a-980f84e74862 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 01 19:23:07.917126 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:23:07.917126 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 19:23:07.917126 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 19:23:07.917126 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 19:23:07.917126 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 19:23:07.917126 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 19:23:07.917126 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:23:07.917126 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 01 19:23:07.917126 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:23:07.917126 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 19:23:07.917126 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:23:07.917126 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:23:07.917126 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:23:07.917126 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:23:07.917126 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:23:07.917126 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:23:07.918265 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:23:07.918265 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:23:07.918265 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:23:07.918265 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:23:07.918265 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:23:07.918265 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:23:07.918265 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 19:23:07.918265 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 19:23:07.918265 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 19:23:07.918265 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 19:23:07.918265 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:23:07.918265 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:23:07.918265 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:23:07.918265 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:23:07.918265 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:23:07.918265 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:23:07.919140 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:23:07.919140 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:23:07.919140 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:23:07.919140 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:23:07.919140 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:23:07.919140 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:23:07.919140 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:23:07.919140 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:23:07.919140 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:23:07.919140 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:23:07.919140 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 19:23:07.919140 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:23:07.919140 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 01 19:23:07.919140 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:23:07.921554 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 511/1044] 10.222.0.26 () {56 vars in 1105 bytes} [Fri Jul 1 19:23:07 2022] GET /identity/v3/services/image => generated 86 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:23:07.924251 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9621700d-8c63-4d76-9fa1-2f1f8d192f76 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:08.024932 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9621700d-8c63-4d76-9fa1-2f1f8d192f76 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:08.034264 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:08.062178 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13323fe-dd8c-4018-b7c6-125ac37120a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:08.062851 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13323fe-dd8c-4018-b7c6-125ac37120a2 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:08.063136 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13323fe-dd8c-4018-b7c6-125ac37120a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:08.063413 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13323fe-dd8c-4018-b7c6-125ac37120a2 None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:08.064124 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13323fe-dd8c-4018-b7c6-125ac37120a2 None admin] RBAC: Adding query filter params (name=image) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:23:08.064434 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13323fe-dd8c-4018-b7c6-125ac37120a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:08.065891 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13323fe-dd8c-4018-b7c6-125ac37120a2 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:08.075480 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 534/1045] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:23:07 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:23:08.076804 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e2c39e-2810-4eb9-972a-980f84e74862 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:08.110046 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:08.184358 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e2c39e-2810-4eb9-972a-980f84e74862 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:08.209976 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e92bd8a-d68b-4331-a2e6-11e383c6428e None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:08.210299 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e92bd8a-d68b-4331-a2e6-11e383c6428e None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:08.210541 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e92bd8a-d68b-4331-a2e6-11e383c6428e None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:08.212061 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 535/1046] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:23:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:23:08.216928 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb1ed9-5c5d-4921-b97b-fdc3d239b2e5 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:08.217221 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb1ed9-5c5d-4921-b97b-fdc3d239b2e5 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:08.217532 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb1ed9-5c5d-4921-b97b-fdc3d239b2e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:08.219265 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16fd495-2088-47f8-a337-fcaab100f44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:08.219934 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16fd495-2088-47f8-a337-fcaab100f44d None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:08.220222 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16fd495-2088-47f8-a337-fcaab100f44d None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:08.220502 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16fd495-2088-47f8-a337-fcaab100f44d None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:08.221217 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16fd495-2088-47f8-a337-fcaab100f44d None admin] RBAC: Adding query filter params (type=image) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:23:08.221562 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16fd495-2088-47f8-a337-fcaab100f44d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:08.224132 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16fd495-2088-47f8-a337-fcaab100f44d None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:08.234965 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 512/1047] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:23:08 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:23:08.235930 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-87bb1ed9-5c5d-4921-b97b-fdc3d239b2e5 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:23:08.237123 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-87bb1ed9-5c5d-4921-b97b-fdc3d239b2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:23:08.238138 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16fd495-2088-47f8-a337-fcaab100f44d None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:08.306516 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 536/1048] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:23:08 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 01 19:23:08.331642 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bb1ed9-5c5d-4921-b97b-fdc3d239b2e5 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:08.336362 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:08.344515 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16fd495-2088-47f8-a337-fcaab100f44d None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:08.382706 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42df588e-0552-471a-aaec-de08b89040b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:08.383761 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df588e-0552-471a-aaec-de08b89040b7 None admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:08.384048 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df588e-0552-471a-aaec-de08b89040b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:08.384328 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df588e-0552-471a-aaec-de08b89040b7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:08.385069 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42df588e-0552-471a-aaec-de08b89040b7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:08.387024 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42df588e-0552-471a-aaec-de08b89040b7 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:08.417403 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 513/1049] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Jul 1 19:23:08 2022] POST /identity/v3/endpoints => generated 327 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:23:08.449533 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bb1ed9-5c5d-4921-b97b-fdc3d239b2e5 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:08.451182 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:08.496443 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d082cd4-2b51-4b94-89b4-9f154129757f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:08.497226 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d082cd4-2b51-4b94-89b4-9f154129757f None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:08.497555 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d082cd4-2b51-4b94-89b4-9f154129757f None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:08.497823 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d082cd4-2b51-4b94-89b4-9f154129757f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:08.499121 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d082cd4-2b51-4b94-89b4-9f154129757f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:08.500570 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d082cd4-2b51-4b94-89b4-9f154129757f None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:08.507114 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 537/1050] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:23:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:23:08.508471 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42df588e-0552-471a-aaec-de08b89040b7 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:08.542889 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a3593-96de-47cc-8599-5e096c9ae5fe None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:08.543730 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a3593-96de-47cc-8599-5e096c9ae5fe None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:08.543902 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a3593-96de-47cc-8599-5e096c9ae5fe None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:08.545476 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 538/1051] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:23:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 19:23:08.550928 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afcc580-2be4-4c32-a168-d86510e7dc99 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:08.551216 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afcc580-2be4-4c32-a168-d86510e7dc99 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:08.551501 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afcc580-2be4-4c32-a168-d86510e7dc99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:08.569877 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-7afcc580-2be4-4c32-a168-d86510e7dc99 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:23:08.571205 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-7afcc580-2be4-4c32-a168-d86510e7dc99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:23:08.635366 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42df588e-0552-471a-aaec-de08b89040b7 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:08.651888 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 539/1052] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:23:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 01 19:23:08.673064 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d625a-1402-4c06-a6e7-acb619fd3215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:08.674290 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afcc580-2be4-4c32-a168-d86510e7dc99 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:08.674818 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d625a-1402-4c06-a6e7-acb619fd3215 None admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:08.674818 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d625a-1402-4c06-a6e7-acb619fd3215 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:08.675093 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d625a-1402-4c06-a6e7-acb619fd3215 None admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:08.675745 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5d625a-1402-4c06-a6e7-acb619fd3215 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:08.677190 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5d625a-1402-4c06-a6e7-acb619fd3215 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:08.701430 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 514/1053] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Jul 1 19:23:08 2022] POST /identity/v3/users => generated 285 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:23:08.796637 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:08.804458 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afcc580-2be4-4c32-a168-d86510e7dc99 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:08.841701 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a02430-758d-459e-8767-b9e3b4f6058d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:08.842574 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a02430-758d-459e-8767-b9e3b4f6058d None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:08.842863 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a02430-758d-459e-8767-b9e3b4f6058d None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:08.843139 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a02430-758d-459e-8767-b9e3b4f6058d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:08.856962 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a02430-758d-459e-8767-b9e3b4f6058d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:23:08.865202 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-59a02430-758d-459e-8767-b9e3b4f6058d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 01 19:23:08.865202 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:23:08.865202 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:23:08.865202 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:23:08.865202 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:23:08.865202 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:23:08.865202 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:23:08.865202 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:23:08.865202 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:23:08.865202 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:23:08.865202 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:23:08.865202 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:23:08.865202 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:23:08.865202 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:23:08.865202 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:23:08.865202 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:23:08.866184 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:23:08.866184 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:23:08.866184 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:23:08.866184 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:23:08.866184 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:23:08.866184 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:23:08.866184 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:23:08.866184 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:23:08.866184 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:23:08.866184 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:23:08.866184 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:23:08.866184 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:23:08.866184 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:23:08.866184 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:23:08.866184 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:23:08.866184 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:23:08.867037 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:23:08.867037 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:23:08.867037 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:23:08.867037 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:23:08.867037 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:23:08.867037 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:23:08.867037 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:23:08.867037 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:23:08.867037 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:23:08.867037 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:23:08.867037 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 01 19:23:08.867037 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:23:08.867037 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 540/1054] 10.222.0.26 () {56 vars in 1120 bytes} [Fri Jul 1 19:23:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:23:08.873156 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d625a-1402-4c06-a6e7-acb619fd3215 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:08.885911 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:08.982612 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d625a-1402-4c06-a6e7-acb619fd3215 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:09.017729 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c63b57-ec77-44e4-b4a2-4666d5632cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:09.018527 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c63b57-ec77-44e4-b4a2-4666d5632cdb None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:09.018812 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c63b57-ec77-44e4-b4a2-4666d5632cdb None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:09.019088 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c63b57-ec77-44e4-b4a2-4666d5632cdb None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:09.019832 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c63b57-ec77-44e4-b4a2-4666d5632cdb None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:23:09.020139 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c63b57-ec77-44e4-b4a2-4666d5632cdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:09.021535 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c63b57-ec77-44e4-b4a2-4666d5632cdb None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:09.033283 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 515/1055] 10.222.0.26 () {56 vars in 1115 bytes} [Fri Jul 1 19:23:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:23:09.036387 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a02430-758d-459e-8767-b9e3b4f6058d None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:09.140114 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a02430-758d-459e-8767-b9e3b4f6058d None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:09.173705 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d70ff-cdb3-4e51-a5a7-b785cb571e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:09.174495 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d70ff-cdb3-4e51-a5a7-b785cb571e89 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:09.174921 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d70ff-cdb3-4e51-a5a7-b785cb571e89 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:09.175194 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d70ff-cdb3-4e51-a5a7-b785cb571e89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:09.186804 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25d70ff-cdb3-4e51-a5a7-b785cb571e89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:09.188252 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25d70ff-cdb3-4e51-a5a7-b785cb571e89 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:09.206374 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-a25d70ff-cdb3-4e51-a5a7-b785cb571e89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:23:09.206374 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:23:09.206374 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:23:09.206374 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:23:09.206374 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:23:09.206374 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:23:09.206374 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:23:09.206374 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:23:09.206374 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:23:09.206374 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:23:09.206374 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:23:09.206374 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:23:09.206374 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:23:09.206374 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:23:09.206374 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:23:09.207310 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:23:09.207310 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:23:09.207310 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:23:09.207310 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:23:09.207310 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:23:09.207310 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:23:09.207310 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:23:09.207310 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:23:09.207310 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:23:09.207310 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:23:09.207310 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:23:09.207310 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:23:09.207310 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:23:09.207310 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:23:09.207310 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:23:09.207310 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:23:09.207310 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:23:09.208217 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:23:09.208217 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:23:09.208217 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:23:09.208217 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:23:09.208217 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 541/1056] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:23:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:23:09.214365 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c63b57-ec77-44e4-b4a2-4666d5632cdb None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:09.294636 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:09.328609 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c63b57-ec77-44e4-b4a2-4666d5632cdb None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:09.362751 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062eb97d-ce09-4e8b-9356-81764af7ddbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:09.363415 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062eb97d-ce09-4e8b-9356-81764af7ddbf None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:09.363702 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062eb97d-ce09-4e8b-9356-81764af7ddbf None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:09.363981 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062eb97d-ce09-4e8b-9356-81764af7ddbf None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:09.364694 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062eb97d-ce09-4e8b-9356-81764af7ddbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:23:09.365005 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062eb97d-ce09-4e8b-9356-81764af7ddbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:09.366410 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062eb97d-ce09-4e8b-9356-81764af7ddbf None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:09.378863 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 516/1057] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Jul 1 19:23:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:23:09.384387 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d70ff-cdb3-4e51-a5a7-b785cb571e89 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:09.396902 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:09.490039 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d70ff-cdb3-4e51-a5a7-b785cb571e89 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:09.524111 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2fb64a-68d7-4de0-b997-1a393c229024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:09.525151 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2fb64a-68d7-4de0-b997-1a393c229024 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:09.525471 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2fb64a-68d7-4de0-b997-1a393c229024 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:09.525752 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2fb64a-68d7-4de0-b997-1a393c229024 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:09.533652 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2fb64a-68d7-4de0-b997-1a393c229024 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:09.535096 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2fb64a-68d7-4de0-b997-1a393c229024 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:09.550863 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-cc2fb64a-68d7-4de0-b997-1a393c229024 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 01 19:23:09.550863 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:23:09.550863 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:23:09.550863 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:23:09.550863 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:23:09.550863 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:23:09.550863 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:23:09.550863 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:23:09.550863 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:23:09.550863 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:23:09.550863 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:23:09.550863 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:23:09.550863 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 19:23:09.550863 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 19:23:09.550863 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 19:23:09.550863 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 19:23:09.551879 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:23:09.551879 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:23:09.551879 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 19:23:09.551879 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:23:09.551879 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 19:23:09.551879 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:23:09.551879 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:23:09.551879 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:23:09.551879 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:23:09.551879 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:23:09.551879 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:23:09.551879 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:23:09.551879 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:23:09.551879 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:23:09.551879 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:23:09.551879 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:23:09.551879 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:23:09.551879 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:23:09.553111 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:23:09.553111 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:23:09.553111 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 19:23:09.553111 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 19:23:09.553111 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 19:23:09.553111 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 19:23:09.553111 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 19:23:09.553111 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 19:23:09.553111 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 01 19:23:09.553111 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:23:09.553111 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 542/1058] 10.222.0.26 () {56 vars in 1093 bytes} [Fri Jul 1 19:23:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:23:09.558379 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062eb97d-ce09-4e8b-9356-81764af7ddbf None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:09.674170 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062eb97d-ce09-4e8b-9356-81764af7ddbf None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:09.705738 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:09.712262 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d98bc-19a4-4bc4-ac33-b1b212a5b1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:09.712935 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d98bc-19a4-4bc4-ac33-b1b212a5b1fa None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:09.713221 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d98bc-19a4-4bc4-ac33-b1b212a5b1fa None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:09.713532 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d98bc-19a4-4bc4-ac33-b1b212a5b1fa None admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:09.714366 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77d98bc-19a4-4bc4-ac33-b1b212a5b1fa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:23:09.714703 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77d98bc-19a4-4bc4-ac33-b1b212a5b1fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:09.716137 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77d98bc-19a4-4bc4-ac33-b1b212a5b1fa None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:09.738702 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 517/1059] 10.222.0.26 () {56 vars in 1133 bytes} [Fri Jul 1 19:23:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:23:09.739882 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2fb64a-68d7-4de0-b997-1a393c229024 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:09.810428 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:09.845785 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2fb64a-68d7-4de0-b997-1a393c229024 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:09.882335 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c951d5cc-84d3-499b-8eea-b23c56b65960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:09.883445 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c951d5cc-84d3-499b-8eea-b23c56b65960 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:09.883878 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c951d5cc-84d3-499b-8eea-b23c56b65960 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:09.884303 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c951d5cc-84d3-499b-8eea-b23c56b65960 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:09.895765 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c951d5cc-84d3-499b-8eea-b23c56b65960 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:09.897575 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c951d5cc-84d3-499b-8eea-b23c56b65960 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:09.917161 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-c951d5cc-84d3-499b-8eea-b23c56b65960 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:23:09.917161 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:23:09.917161 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:23:09.917161 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:23:09.917161 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:23:09.917161 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:23:09.917161 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:23:09.917161 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:23:09.917161 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:23:09.917161 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:23:09.917161 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:23:09.917161 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:23:09.917161 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:23:09.917161 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:23:09.917161 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:23:09.918857 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:23:09.918857 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:23:09.918857 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:23:09.918857 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:23:09.918857 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:23:09.918857 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:23:09.918857 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:23:09.918857 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:23:09.918857 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:23:09.918857 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:23:09.918857 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:23:09.918857 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:23:09.918857 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:23:09.918857 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:23:09.918857 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:23:09.918857 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:23:09.918857 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:23:09.924815 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:23:09.924815 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:23:09.924815 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:23:09.924815 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:23:09.924815 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 543/1060] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:23:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:23:09.925722 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d98bc-19a4-4bc4-ac33-b1b212a5b1fa None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:10.028678 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d98bc-19a4-4bc4-ac33-b1b212a5b1fa None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:10.063270 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb9825c-a5e7-4f36-89ad-e4c124bc7b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:10.063854 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb9825c-a5e7-4f36-89ad-e4c124bc7b72 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:10.064139 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb9825c-a5e7-4f36-89ad-e4c124bc7b72 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:10.064413 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb9825c-a5e7-4f36-89ad-e4c124bc7b72 None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:10.065128 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb9825c-a5e7-4f36-89ad-e4c124bc7b72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:23:10.065553 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb9825c-a5e7-4f36-89ad-e4c124bc7b72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:10.066925 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb9825c-a5e7-4f36-89ad-e4c124bc7b72 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:10.082724 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 518/1061] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Jul 1 19:23:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:23:10.084034 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c951d5cc-84d3-499b-8eea-b23c56b65960 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:10.186264 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c951d5cc-84d3-499b-8eea-b23c56b65960 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:10.206663 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:10.222469 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6ab109-663e-4fcf-86c7-bc585d21c2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:10.223264 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ab109-663e-4fcf-86c7-bc585d21c2f7 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:10.223557 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ab109-663e-4fcf-86c7-bc585d21c2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:10.223838 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ab109-663e-4fcf-86c7-bc585d21c2f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:10.230731 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6ab109-663e-4fcf-86c7-bc585d21c2f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:10.232174 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6ab109-663e-4fcf-86c7-bc585d21c2f7 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:10.247086 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-2c6ab109-663e-4fcf-86c7-bc585d21c2f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:23:10.247086 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:23:10.247086 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:23:10.247086 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:23:10.247086 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:23:10.247086 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:23:10.247086 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:23:10.247086 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:23:10.247086 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:23:10.247086 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:23:10.247086 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:23:10.247086 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:23:10.247086 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 19:23:10.247086 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 19:23:10.247086 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 19:23:10.248022 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 19:23:10.248022 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:23:10.248022 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:23:10.248022 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:23:10.248022 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:23:10.248022 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:23:10.248022 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:23:10.248022 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:23:10.248022 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:23:10.248022 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:23:10.248022 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:23:10.248022 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:23:10.248022 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:23:10.248022 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:23:10.248022 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:23:10.248022 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:23:10.248022 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:23:10.254103 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 19:23:10.254103 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 19:23:10.254103 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 19:23:10.254103 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 19:23:10.254103 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 19:23:10.254103 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 19:23:10.254103 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:23:10.254103 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:23:10.254103 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 544/1062] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Jul 1 19:23:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:23:10.254615 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb9825c-a5e7-4f36-89ad-e4c124bc7b72 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:10.318598 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:10.383720 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb9825c-a5e7-4f36-89ad-e4c124bc7b72 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:10.418731 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa27e72-4b61-4677-9507-bc9cbee1a7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:10.419392 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa27e72-4b61-4677-9507-bc9cbee1a7b5 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:10.419679 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa27e72-4b61-4677-9507-bc9cbee1a7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:10.419956 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa27e72-4b61-4677-9507-bc9cbee1a7b5 None admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:10.420748 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa27e72-4b61-4677-9507-bc9cbee1a7b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:23:10.421060 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa27e72-4b61-4677-9507-bc9cbee1a7b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:10.422530 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa27e72-4b61-4677-9507-bc9cbee1a7b5 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:10.439789 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 519/1063] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Jul 1 19:23:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:23:10.441142 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6ab109-663e-4fcf-86c7-bc585d21c2f7 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:10.469115 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a198f-c439-4cc6-a9be-f59f47b85221 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:10.469520 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a198f-c439-4cc6-a9be-f59f47b85221 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:10.469806 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a198f-c439-4cc6-a9be-f59f47b85221 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:10.471176 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 520/1064] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:23:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 19:23:10.476340 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86343deb-30fe-41e3-b338-18c1ddc80b03 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:10.476819 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86343deb-30fe-41e3-b338-18c1ddc80b03 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:10.477161 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86343deb-30fe-41e3-b338-18c1ddc80b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:10.494079 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-86343deb-30fe-41e3-b338-18c1ddc80b03 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:23:10.495249 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-86343deb-30fe-41e3-b338-18c1ddc80b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:23:10.554629 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6ab109-663e-4fcf-86c7-bc585d21c2f7 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:10.574997 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 521/1065] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:23:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 01 19:23:10.591442 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e668b800-7ed9-4030-9c4e-1d4f4ae575f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:10.592378 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e668b800-7ed9-4030-9c4e-1d4f4ae575f5 None admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:10.592658 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e668b800-7ed9-4030-9c4e-1d4f4ae575f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:10.592977 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e668b800-7ed9-4030-9c4e-1d4f4ae575f5 None admin] PATH_INFO: `/v3/projects/69c523a41f4048cfb7df553b6feb6310/users/13fd76fc7dd1410b9cde5adbaa6cb2e5/roles/6ce8e2867947472c8b441d47e4a4e28f` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:10.595210 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e668b800-7ed9-4030-9c4e-1d4f4ae575f5 None admin] RBAC: Authorizing `identity:create_grant(project_id=69c523a41f4048cfb7df553b6feb6310, user_id=13fd76fc7dd1410b9cde5adbaa6cb2e5, role_id=6ce8e2867947472c8b441d47e4a4e28f)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:10.596750 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e668b800-7ed9-4030-9c4e-1d4f4ae575f5 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:10.597278 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86343deb-30fe-41e3-b338-18c1ddc80b03 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:10.621354 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 545/1066] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Jul 1 19:23:10 2022] PUT /identity/v3/projects/69c523a41f4048cfb7df553b6feb6310/users/13fd76fc7dd1410b9cde5adbaa6cb2e5/roles/6ce8e2867947472c8b441d47e4a4e28f => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 19:23:10.657845 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:10.724526 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86343deb-30fe-41e3-b338-18c1ddc80b03 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:10.763754 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafcc8b3-ab32-4007-8f91-275c7825724c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:10.763992 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafcc8b3-ab32-4007-8f91-275c7825724c None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:10.764088 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafcc8b3-ab32-4007-8f91-275c7825724c None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:10.765210 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafcc8b3-ab32-4007-8f91-275c7825724c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:10.838702 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafcc8b3-ab32-4007-8f91-275c7825724c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:10.840121 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafcc8b3-ab32-4007-8f91-275c7825724c None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:10.844915 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7e3c4-7c95-4ece-9b0d-43ad933a5da4 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:10.845401 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7e3c4-7c95-4ece-9b0d-43ad933a5da4 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:10.845586 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7e3c4-7c95-4ece-9b0d-43ad933a5da4 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:10.849706 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 546/1067] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:23:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 19:23:10.852102 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9385fc36-7797-4566-b738-6ef3de926b56 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:10.852391 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9385fc36-7797-4566-b738-6ef3de926b56 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:10.852672 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9385fc36-7797-4566-b738-6ef3de926b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:10.869715 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-9385fc36-7797-4566-b738-6ef3de926b56 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:23:10.871397 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-9385fc36-7797-4566-b738-6ef3de926b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:23:10.884605 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:10.907938 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:10.943459 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 547/1068] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:23:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 01 19:23:10.952536 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 522/1069] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Jul 1 19:23:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 01 19:23:10.958234 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9385fc36-7797-4566-b738-6ef3de926b56 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:10.968236 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafcc8b3-ab32-4007-8f91-275c7825724c None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:11.066500 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9385fc36-7797-4566-b738-6ef3de926b56 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:11.080642 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafcc8b3-ab32-4007-8f91-275c7825724c None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:11.102023 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a66c36-3c86-4be9-85c7-a4d6847fb962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:11.102825 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a66c36-3c86-4be9-85c7-a4d6847fb962 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:11.103109 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a66c36-3c86-4be9-85c7-a4d6847fb962 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:11.103385 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a66c36-3c86-4be9-85c7-a4d6847fb962 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:11.114931 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a66c36-3c86-4be9-85c7-a4d6847fb962 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:11.116384 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a66c36-3c86-4be9-85c7-a4d6847fb962 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:11.120031 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c87a36b-8210-493c-bfc3-0edd1a977555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:11.121699 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87a36b-8210-493c-bfc3-0edd1a977555 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:11.122185 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87a36b-8210-493c-bfc3-0edd1a977555 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:11.122643 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87a36b-8210-493c-bfc3-0edd1a977555 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:11.130213 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:11.134843 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c87a36b-8210-493c-bfc3-0edd1a977555 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:23:11.135001 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-20a66c36-3c86-4be9-85c7-a4d6847fb962 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:23:11.135001 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:23:11.135001 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:23:11.135001 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:23:11.135001 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:23:11.135001 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:23:11.135001 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:23:11.135001 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:23:11.135001 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:23:11.135001 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:23:11.135001 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:23:11.135001 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:23:11.135001 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:23:11.135001 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:23:11.135001 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:23:11.136044 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:23:11.136044 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:23:11.136044 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:23:11.136044 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:23:11.136044 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:23:11.136044 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:23:11.136044 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:23:11.136044 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:23:11.136044 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:23:11.136044 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:23:11.136044 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:23:11.136044 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:23:11.136044 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:23:11.136044 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:23:11.136044 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:23:11.136044 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:23:11.136044 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:23:11.137992 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:23:11.137992 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:23:11.137992 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:23:11.137992 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:23:11.137992 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 548/1070] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:23:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:23:11.142423 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a66c36-3c86-4be9-85c7-a4d6847fb962 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:11.146549 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-5c87a36b-8210-493c-bfc3-0edd1a977555 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:23:11.146549 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:23:11.146549 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:23:11.146549 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:23:11.146549 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:23:11.146549 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:23:11.146549 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:23:11.146549 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:23:11.146549 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:23:11.146549 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:23:11.146549 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:23:11.146549 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:23:11.146549 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:23:11.146549 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:23:11.146549 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:23:11.146549 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:23:11.147563 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:23:11.147563 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:23:11.147563 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:23:11.147563 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:23:11.147563 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:23:11.147563 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:23:11.147563 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:23:11.147563 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:23:11.147563 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:23:11.147563 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:23:11.147563 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:23:11.147563 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:23:11.147563 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:23:11.147563 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:23:11.147563 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:23:11.147563 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:23:11.148423 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:23:11.148423 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:23:11.148423 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:23:11.148423 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:23:11.148423 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:23:11.148423 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:23:11.148423 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:23:11.148423 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:23:11.148423 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:23:11.148423 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:23:11.148423 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:23:11.148423 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:23:11.148423 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 523/1071] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Jul 1 19:23:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:23:11.154184 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c87a36b-8210-493c-bfc3-0edd1a977555 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:11.171193 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:11.253917 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a66c36-3c86-4be9-85c7-a4d6847fb962 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:11.268602 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c87a36b-8210-493c-bfc3-0edd1a977555 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:11.289225 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da520a95-11a8-4af0-962e-130b8b01040d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:11.289924 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da520a95-11a8-4af0-962e-130b8b01040d None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:11.290209 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da520a95-11a8-4af0-962e-130b8b01040d None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:11.290487 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da520a95-11a8-4af0-962e-130b8b01040d None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:11.291213 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da520a95-11a8-4af0-962e-130b8b01040d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:23:11.291521 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da520a95-11a8-4af0-962e-130b8b01040d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:11.293445 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da520a95-11a8-4af0-962e-130b8b01040d None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:11.305782 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e387207-e895-4976-a497-af69885708e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:11.306486 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 549/1072] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Jul 1 19:23:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:23:11.306615 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e387207-e895-4976-a497-af69885708e8 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:11.306793 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e387207-e895-4976-a497-af69885708e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:11.307122 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e387207-e895-4976-a497-af69885708e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:11.307879 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e387207-e895-4976-a497-af69885708e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:23:11.308191 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e387207-e895-4976-a497-af69885708e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:11.310196 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e387207-e895-4976-a497-af69885708e8 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:11.326149 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 524/1073] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Jul 1 19:23:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:23:11.332165 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da520a95-11a8-4af0-962e-130b8b01040d None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:11.422955 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:11.444252 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da520a95-11a8-4af0-962e-130b8b01040d None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:11.482709 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea49a00e-4552-400f-a008-5339b30c364b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:11.483583 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49a00e-4552-400f-a008-5339b30c364b None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:11.483871 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49a00e-4552-400f-a008-5339b30c364b None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:11.484150 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49a00e-4552-400f-a008-5339b30c364b None admin] PATH_INFO: `/v3/users/9718be9f7bf94063b20c3d5d0643558b` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:11.498360 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea49a00e-4552-400f-a008-5339b30c364b None admin] RBAC: Authorizing `identity:get_user(user_id=9718be9f7bf94063b20c3d5d0643558b)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:11.499810 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea49a00e-4552-400f-a008-5339b30c364b None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:11.501862 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 550/1074] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Jul 1 19:23:11 2022] GET /identity/v3/users/9718be9f7bf94063b20c3d5d0643558b => generated 285 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:23:11.507693 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e387207-e895-4976-a497-af69885708e8 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:11.573592 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:11.617771 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e387207-e895-4976-a497-af69885708e8 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:11.654430 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc4e2ed-eaf5-4a99-b56c-cb893158cf8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:11.655079 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc4e2ed-eaf5-4a99-b56c-cb893158cf8b None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:11.655364 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc4e2ed-eaf5-4a99-b56c-cb893158cf8b None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:11.655643 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc4e2ed-eaf5-4a99-b56c-cb893158cf8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:11.726521 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc4e2ed-eaf5-4a99-b56c-cb893158cf8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:11.727901 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc4e2ed-eaf5-4a99-b56c-cb893158cf8b None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:11.784534 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:11.826285 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 525/1075] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Jul 1 19:23:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 01 19:23:11.832139 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea49a00e-4552-400f-a008-5339b30c364b None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:11.929790 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea49a00e-4552-400f-a008-5339b30c364b None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:11.963717 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c9d88b-e754-42f0-a0ef-11a1a020f3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:11.964582 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c9d88b-e754-42f0-a0ef-11a1a020f3a7 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:11.965414 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c9d88b-e754-42f0-a0ef-11a1a020f3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:11.965693 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c9d88b-e754-42f0-a0ef-11a1a020f3a7 None admin] PATH_INFO: `/v3/projects/d3ab4e0de40f498693e5df69037a1a10` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:11.966866 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c9d88b-e754-42f0-a0ef-11a1a020f3a7 None admin] RBAC: Authorizing `identity:get_project(project_id=d3ab4e0de40f498693e5df69037a1a10)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:11.968281 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c9d88b-e754-42f0-a0ef-11a1a020f3a7 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:11.970010 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 551/1076] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Jul 1 19:23:11 2022] GET /identity/v3/projects/d3ab4e0de40f498693e5df69037a1a10 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:23:11.976331 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc4e2ed-eaf5-4a99-b56c-cb893158cf8b None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:12.075519 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc4e2ed-eaf5-4a99-b56c-cb893158cf8b None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:12.109563 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f58f0-ee92-4c97-975a-024617ed7781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:12.110213 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f58f0-ee92-4c97-975a-024617ed7781 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:12.110498 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f58f0-ee92-4c97-975a-024617ed7781 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:12.110779 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f58f0-ee92-4c97-975a-024617ed7781 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:12.111602 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15f58f0-ee92-4c97-975a-024617ed7781 None admin] RBAC: Adding query filter params (role.id=6cb03785fb184ef587509b3174622f69, scope.project.id=d3ab4e0de40f498693e5df69037a1a10, user.id=9718be9f7bf94063b20c3d5d0643558b) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:23:12.111915 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15f58f0-ee92-4c97-975a-024617ed7781 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:12.113486 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15f58f0-ee92-4c97-975a-024617ed7781 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:12.119040 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 526/1077] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Jul 1 19:23:11 2022] GET /identity/v3/role_assignments?user.id=9718be9f7bf94063b20c3d5d0643558b&scope.project.id=d3ab4e0de40f498693e5df69037a1a10&role.id=6cb03785fb184ef587509b3174622f69 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:23:12.633871 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4778f32d-5137-4e5b-89aa-6496eba0dec6 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:12.634247 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4778f32d-5137-4e5b-89aa-6496eba0dec6 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:12.634430 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4778f32d-5137-4e5b-89aa-6496eba0dec6 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:12.635975 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 552/1078] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:23:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:23:12.641461 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0568a-c9f0-462b-9161-d8a55bade728 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:12.641761 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0568a-c9f0-462b-9161-d8a55bade728 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:12.642046 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0568a-c9f0-462b-9161-d8a55bade728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:12.659178 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-e7c0568a-c9f0-462b-9161-d8a55bade728 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:23:12.660236 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-e7c0568a-c9f0-462b-9161-d8a55bade728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:23:12.677129 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:12.726497 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 527/1079] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:23:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:23:12.749519 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4778f32d-5137-4e5b-89aa-6496eba0dec6 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:12.760839 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:12.849896 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4778f32d-5137-4e5b-89aa-6496eba0dec6 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:12.882346 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c51c4a1-62f7-4876-8403-291d689c6504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:12.883134 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51c4a1-62f7-4876-8403-291d689c6504 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:12.883413 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51c4a1-62f7-4876-8403-291d689c6504 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:12.883686 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51c4a1-62f7-4876-8403-291d689c6504 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:12.894272 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c51c4a1-62f7-4876-8403-291d689c6504 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:23:12.902208 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-9c51c4a1-62f7-4876-8403-291d689c6504 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 01 19:23:12.902208 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:23:12.902208 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:23:12.902208 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:23:12.902208 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:23:12.902208 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:23:12.902208 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:23:12.902208 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:23:12.902208 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:23:12.902208 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:23:12.902208 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:23:12.902208 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:23:12.902208 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:23:12.902208 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:23:12.902208 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:23:12.902208 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:23:12.903187 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:23:12.903187 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:23:12.903187 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:23:12.903187 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:23:12.903187 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:23:12.903187 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:23:12.903187 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:23:12.903187 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:23:12.903187 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:23:12.903187 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:23:12.903187 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:23:12.903187 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:23:12.903187 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:23:12.903187 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:23:12.903187 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:23:12.903187 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:23:12.904052 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:23:12.904052 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:23:12.904052 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:23:12.904052 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:23:12.904052 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:23:12.904052 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:23:12.904052 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:23:12.904052 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:23:12.904052 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:23:12.904052 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:23:12.904052 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 01 19:23:12.904052 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:23:12.904052 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 553/1080] 10.222.0.26 () {56 vars in 1120 bytes} [Fri Jul 1 19:23:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:23:12.909389 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c0568a-c9f0-462b-9161-d8a55bade728 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:13.006010 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c0568a-c9f0-462b-9161-d8a55bade728 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:13.039048 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1015d710-521d-40b9-9d2b-a9a0d0e6ae8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:13.039710 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1015d710-521d-40b9-9d2b-a9a0d0e6ae8d None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:13.039999 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1015d710-521d-40b9-9d2b-a9a0d0e6ae8d None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:13.040278 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1015d710-521d-40b9-9d2b-a9a0d0e6ae8d None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:13.041020 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1015d710-521d-40b9-9d2b-a9a0d0e6ae8d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:23:13.041362 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1015d710-521d-40b9-9d2b-a9a0d0e6ae8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:13.042767 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1015d710-521d-40b9-9d2b-a9a0d0e6ae8d None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:13.050788 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 528/1081] 10.222.0.26 () {56 vars in 1115 bytes} [Fri Jul 1 19:23:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:23:13.056668 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c51c4a1-62f7-4876-8403-291d689c6504 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:13.123164 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:13.157692 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c51c4a1-62f7-4876-8403-291d689c6504 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:13.191790 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed9cea-257a-4605-b89c-ac0328888264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:13.192614 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed9cea-257a-4605-b89c-ac0328888264 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:13.192902 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed9cea-257a-4605-b89c-ac0328888264 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:13.193181 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed9cea-257a-4605-b89c-ac0328888264 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:13.205576 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ed9cea-257a-4605-b89c-ac0328888264 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:13.207052 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ed9cea-257a-4605-b89c-ac0328888264 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:13.224239 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-94ed9cea-257a-4605-b89c-ac0328888264 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:23:13.224239 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:23:13.224239 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:23:13.224239 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:23:13.224239 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:23:13.224239 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:23:13.224239 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:23:13.224239 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:23:13.224239 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:23:13.224239 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:23:13.224239 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:23:13.224239 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:23:13.224239 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:23:13.224239 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:23:13.224239 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:23:13.225281 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:23:13.225281 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:23:13.225281 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:23:13.225281 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:23:13.225281 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:23:13.225281 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:23:13.225281 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:23:13.225281 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:23:13.225281 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:23:13.225281 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:23:13.225281 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:23:13.225281 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:23:13.225281 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:23:13.225281 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:23:13.225281 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:23:13.225281 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:23:13.225281 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:23:13.226203 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:23:13.226203 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:23:13.226203 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:23:13.226203 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:23:13.226203 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 554/1082] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:23:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:23:13.231585 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1015d710-521d-40b9-9d2b-a9a0d0e6ae8d None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:13.250583 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:13.331507 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1015d710-521d-40b9-9d2b-a9a0d0e6ae8d None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:13.364394 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741753ad-70c0-4eec-a027-2218633e7679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:13.365113 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741753ad-70c0-4eec-a027-2218633e7679 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:13.365434 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741753ad-70c0-4eec-a027-2218633e7679 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:13.365718 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741753ad-70c0-4eec-a027-2218633e7679 None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:13.366437 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741753ad-70c0-4eec-a027-2218633e7679 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:23:13.366750 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741753ad-70c0-4eec-a027-2218633e7679 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:13.368122 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741753ad-70c0-4eec-a027-2218633e7679 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:13.380333 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 529/1083] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Jul 1 19:23:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:23:13.385936 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed9cea-257a-4605-b89c-ac0328888264 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:13.483550 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed9cea-257a-4605-b89c-ac0328888264 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:13.504186 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:13.518220 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a6de30-537e-41f4-a388-6d2c9a824872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:13.519000 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a6de30-537e-41f4-a388-6d2c9a824872 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:13.519283 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a6de30-537e-41f4-a388-6d2c9a824872 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:13.519558 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a6de30-537e-41f4-a388-6d2c9a824872 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:13.526934 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a6de30-537e-41f4-a388-6d2c9a824872 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:13.528410 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a6de30-537e-41f4-a388-6d2c9a824872 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:13.541957 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-18a6de30-537e-41f4-a388-6d2c9a824872 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 01 19:23:13.541957 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:23:13.541957 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:23:13.541957 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:23:13.541957 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:23:13.541957 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:23:13.541957 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:23:13.541957 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:23:13.541957 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:23:13.541957 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:23:13.541957 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:23:13.541957 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:23:13.541957 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 19:23:13.541957 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 19:23:13.541957 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 19:23:13.541957 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 19:23:13.543398 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:23:13.543398 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:23:13.543398 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 19:23:13.543398 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:23:13.543398 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 19:23:13.543398 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:23:13.543398 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:23:13.543398 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:23:13.543398 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:23:13.543398 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:23:13.543398 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:23:13.543398 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:23:13.543398 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:23:13.543398 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:23:13.543398 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:23:13.543398 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:23:13.543398 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:23:13.543398 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:23:13.544361 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:23:13.544361 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:23:13.544361 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 19:23:13.544361 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 19:23:13.544361 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 19:23:13.544361 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 19:23:13.544361 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 19:23:13.544361 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 19:23:13.544361 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 01 19:23:13.544361 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:23:13.545401 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 555/1084] 10.222.0.26 () {56 vars in 1093 bytes} [Fri Jul 1 19:23:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:23:13.549403 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741753ad-70c0-4eec-a027-2218633e7679 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:13.628410 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:13.652648 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741753ad-70c0-4eec-a027-2218633e7679 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:13.686225 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49affbc1-133a-41bf-867c-d26dab56e849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:13.686890 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49affbc1-133a-41bf-867c-d26dab56e849 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:13.687177 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49affbc1-133a-41bf-867c-d26dab56e849 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:13.687458 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49affbc1-133a-41bf-867c-d26dab56e849 None admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:13.688288 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49affbc1-133a-41bf-867c-d26dab56e849 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:23:13.688601 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49affbc1-133a-41bf-867c-d26dab56e849 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:13.690160 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49affbc1-133a-41bf-867c-d26dab56e849 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:13.707192 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 530/1085] 10.222.0.26 () {56 vars in 1133 bytes} [Fri Jul 1 19:23:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:23:13.712990 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a6de30-537e-41f4-a388-6d2c9a824872 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:13.813570 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a6de30-537e-41f4-a388-6d2c9a824872 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:13.846993 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e69a8f-443f-48ed-8c1d-ba8f41a5436d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:13.847634 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e69a8f-443f-48ed-8c1d-ba8f41a5436d None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:13.847918 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e69a8f-443f-48ed-8c1d-ba8f41a5436d None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:13.848197 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e69a8f-443f-48ed-8c1d-ba8f41a5436d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:13.895109 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:13.914074 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e69a8f-443f-48ed-8c1d-ba8f41a5436d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:13.915519 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e69a8f-443f-48ed-8c1d-ba8f41a5436d None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:14.011979 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 556/1086] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Jul 1 19:23:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 01 19:23:14.017714 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49affbc1-133a-41bf-867c-d26dab56e849 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:14.117175 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49affbc1-133a-41bf-867c-d26dab56e849 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:14.124026 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c33a343-4028-4004-86cf-7b548e61d204 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:14.124497 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c33a343-4028-4004-86cf-7b548e61d204 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:14.124588 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c33a343-4028-4004-86cf-7b548e61d204 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:14.126011 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 557/1087] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:23:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 19:23:14.131072 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288f3ae-4123-4337-afba-d233fc36d94f None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:14.131362 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288f3ae-4123-4337-afba-d233fc36d94f None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:14.131644 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288f3ae-4123-4337-afba-d233fc36d94f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:14.147799 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-f288f3ae-4123-4337-afba-d233fc36d94f None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:23:14.149014 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-f288f3ae-4123-4337-afba-d233fc36d94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:23:14.152743 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f94fa-dee1-4e7a-9487-08ba53e7863d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:14.153558 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f94fa-dee1-4e7a-9487-08ba53e7863d None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:14.153847 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f94fa-dee1-4e7a-9487-08ba53e7863d None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:14.154126 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f94fa-dee1-4e7a-9487-08ba53e7863d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:14.156024 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:14.165376 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8f94fa-dee1-4e7a-9487-08ba53e7863d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:14.166828 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8f94fa-dee1-4e7a-9487-08ba53e7863d None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:14.185201 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-ab8f94fa-dee1-4e7a-9487-08ba53e7863d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:23:14.185201 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:23:14.185201 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:23:14.185201 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:23:14.185201 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:23:14.185201 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:23:14.185201 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:23:14.185201 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:23:14.185201 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:23:14.185201 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:23:14.185201 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:23:14.185201 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:23:14.185201 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:23:14.185201 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:23:14.185201 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:23:14.186127 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:23:14.186127 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:23:14.186127 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:23:14.186127 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:23:14.186127 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:23:14.186127 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:23:14.186127 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:23:14.186127 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:23:14.186127 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:23:14.186127 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:23:14.186127 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:23:14.186127 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:23:14.186127 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:23:14.186127 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:23:14.186127 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:23:14.186127 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:23:14.186127 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:23:14.187039 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:23:14.187039 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:23:14.187039 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:23:14.187039 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:23:14.187039 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 531/1088] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:23:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:23:14.191924 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f94fa-dee1-4e7a-9487-08ba53e7863d None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:14.218577 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 558/1089] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:23:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 01 19:23:14.240989 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f288f3ae-4123-4337-afba-d233fc36d94f None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:14.252690 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:14.290578 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f94fa-dee1-4e7a-9487-08ba53e7863d None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:14.326135 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210eed5a-6bf5-4c5c-9f52-c59d204991fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:14.326795 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210eed5a-6bf5-4c5c-9f52-c59d204991fd None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:14.327080 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210eed5a-6bf5-4c5c-9f52-c59d204991fd None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:14.327356 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210eed5a-6bf5-4c5c-9f52-c59d204991fd None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:14.328070 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210eed5a-6bf5-4c5c-9f52-c59d204991fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:23:14.328380 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210eed5a-6bf5-4c5c-9f52-c59d204991fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:14.329798 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210eed5a-6bf5-4c5c-9f52-c59d204991fd None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:14.341702 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 532/1090] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Jul 1 19:23:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:23:14.347146 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210eed5a-6bf5-4c5c-9f52-c59d204991fd None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:14.353601 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f288f3ae-4123-4337-afba-d233fc36d94f None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:14.388326 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a5173-838f-4d6e-aa39-29a58b8b1a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:14.389046 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a5173-838f-4d6e-aa39-29a58b8b1a5b None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:14.389377 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a5173-838f-4d6e-aa39-29a58b8b1a5b None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:14.389660 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a5173-838f-4d6e-aa39-29a58b8b1a5b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:14.394737 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:14.400126 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261a5173-838f-4d6e-aa39-29a58b8b1a5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:23:14.408186 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-261a5173-838f-4d6e-aa39-29a58b8b1a5b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:23:14.408186 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:23:14.408186 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:23:14.408186 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:23:14.408186 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:23:14.408186 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:23:14.408186 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:23:14.408186 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:23:14.408186 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:23:14.408186 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:23:14.408186 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:23:14.408186 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:23:14.408186 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:23:14.408186 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:23:14.408186 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:23:14.408186 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:23:14.413333 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:23:14.413333 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:23:14.413333 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:23:14.413333 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:23:14.413333 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:23:14.413333 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:23:14.413333 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:23:14.413333 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:23:14.413333 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:23:14.413333 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:23:14.413333 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:23:14.413333 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:23:14.413333 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:23:14.413333 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:23:14.413333 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:23:14.413333 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:23:14.414322 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:23:14.414322 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:23:14.414322 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:23:14.414322 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:23:14.414322 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:23:14.414322 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:23:14.414322 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:23:14.414322 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:23:14.414322 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:23:14.414322 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:23:14.414322 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:23:14.414322 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:23:14.414322 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 559/1091] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Jul 1 19:23:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:23:14.415768 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a5173-838f-4d6e-aa39-29a58b8b1a5b None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:14.455422 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210eed5a-6bf5-4c5c-9f52-c59d204991fd None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:14.484263 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:14.488695 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed35994-f9ff-410e-aa43-4c9c7a9fe743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:14.489542 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed35994-f9ff-410e-aa43-4c9c7a9fe743 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:14.489828 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed35994-f9ff-410e-aa43-4c9c7a9fe743 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:14.490123 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed35994-f9ff-410e-aa43-4c9c7a9fe743 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:14.497704 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed35994-f9ff-410e-aa43-4c9c7a9fe743 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:14.499150 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed35994-f9ff-410e-aa43-4c9c7a9fe743 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:14.513990 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-0ed35994-f9ff-410e-aa43-4c9c7a9fe743 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:23:14.513990 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:23:14.513990 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:23:14.513990 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:23:14.513990 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:23:14.513990 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:23:14.513990 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:23:14.513990 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:23:14.513990 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:23:14.513990 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:23:14.513990 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:23:14.513990 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:23:14.513990 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 19:23:14.513990 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 19:23:14.513990 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 19:23:14.515105 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 19:23:14.515105 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:23:14.515105 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:23:14.515105 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:23:14.515105 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:23:14.515105 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:23:14.515105 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:23:14.515105 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:23:14.515105 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:23:14.515105 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:23:14.515105 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:23:14.515105 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:23:14.515105 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:23:14.515105 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:23:14.515105 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:23:14.515105 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:23:14.515105 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:23:14.516300 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 19:23:14.516300 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 19:23:14.516300 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 19:23:14.516300 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 19:23:14.516300 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 19:23:14.516300 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 19:23:14.516300 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:23:14.516300 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:23:14.516300 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 533/1092] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Jul 1 19:23:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:23:14.520482 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a5173-838f-4d6e-aa39-29a58b8b1a5b None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:14.520773 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed35994-f9ff-410e-aa43-4c9c7a9fe743 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:14.554270 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93480d05-b2ca-4825-9dd1-785e328a9bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:14.554957 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93480d05-b2ca-4825-9dd1-785e328a9bf2 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:14.555243 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93480d05-b2ca-4825-9dd1-785e328a9bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:14.555521 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93480d05-b2ca-4825-9dd1-785e328a9bf2 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:14.556265 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93480d05-b2ca-4825-9dd1-785e328a9bf2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:23:14.556576 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93480d05-b2ca-4825-9dd1-785e328a9bf2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:14.557965 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93480d05-b2ca-4825-9dd1-785e328a9bf2 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:14.566648 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 560/1093] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Jul 1 19:23:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:23:14.572284 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93480d05-b2ca-4825-9dd1-785e328a9bf2 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:14.619574 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed35994-f9ff-410e-aa43-4c9c7a9fe743 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:14.628493 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:14.659664 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361fb146-492e-4151-92cc-6de8d6f97f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:14.660324 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361fb146-492e-4151-92cc-6de8d6f97f89 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:14.660608 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361fb146-492e-4151-92cc-6de8d6f97f89 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:14.660887 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361fb146-492e-4151-92cc-6de8d6f97f89 None admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:14.661766 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361fb146-492e-4151-92cc-6de8d6f97f89 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:23:14.662076 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361fb146-492e-4151-92cc-6de8d6f97f89 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:14.663511 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361fb146-492e-4151-92cc-6de8d6f97f89 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:14.674889 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 534/1094] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Jul 1 19:23:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:23:14.677037 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93480d05-b2ca-4825-9dd1-785e328a9bf2 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:14.680822 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361fb146-492e-4151-92cc-6de8d6f97f89 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:14.706872 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:14.712649 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f59eba-da1e-4eab-a7e8-b2bd0fefcb30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:14.713546 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f59eba-da1e-4eab-a7e8-b2bd0fefcb30 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:14.713841 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f59eba-da1e-4eab-a7e8-b2bd0fefcb30 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:14.714131 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f59eba-da1e-4eab-a7e8-b2bd0fefcb30 None admin] PATH_INFO: `/v3/users/9718be9f7bf94063b20c3d5d0643558b` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:14.715385 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f59eba-da1e-4eab-a7e8-b2bd0fefcb30 None admin] RBAC: Authorizing `identity:get_user(user_id=9718be9f7bf94063b20c3d5d0643558b)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:14.716814 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f59eba-da1e-4eab-a7e8-b2bd0fefcb30 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:14.718503 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 561/1095] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Jul 1 19:23:14 2022] GET /identity/v3/users/9718be9f7bf94063b20c3d5d0643558b => generated 285 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:23:14.724130 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f59eba-da1e-4eab-a7e8-b2bd0fefcb30 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:14.781818 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361fb146-492e-4151-92cc-6de8d6f97f89 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:14.815966 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f0b56-d215-4594-9c81-d9bef0e3afdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:14.816608 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f0b56-d215-4594-9c81-d9bef0e3afdb None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:14.816895 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f0b56-d215-4594-9c81-d9bef0e3afdb None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:14.817170 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f0b56-d215-4594-9c81-d9bef0e3afdb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:14.818022 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9f0b56-d215-4594-9c81-d9bef0e3afdb None admin] RBAC: Adding query filter params (role.id=6ce8e2867947472c8b441d47e4a4e28f, scope.project.id=69c523a41f4048cfb7df553b6feb6310, user.id=13fd76fc7dd1410b9cde5adbaa6cb2e5) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:23:14.818336 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9f0b56-d215-4594-9c81-d9bef0e3afdb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:14.819766 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9f0b56-d215-4594-9c81-d9bef0e3afdb None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:14.825366 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f59eba-da1e-4eab-a7e8-b2bd0fefcb30 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:14.825809 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 535/1096] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Jul 1 19:23:14 2022] GET /identity/v3/role_assignments?user.id=13fd76fc7dd1410b9cde5adbaa6cb2e5&scope.project.id=69c523a41f4048cfb7df553b6feb6310&role.id=6ce8e2867947472c8b441d47e4a4e28f => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:23:14.861598 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5876e308-e1e0-4724-ae0e-2341054b882e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:14.862679 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5876e308-e1e0-4724-ae0e-2341054b882e None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:14.862962 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5876e308-e1e0-4724-ae0e-2341054b882e None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:14.863237 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5876e308-e1e0-4724-ae0e-2341054b882e None admin] PATH_INFO: `/v3/projects/d3ab4e0de40f498693e5df69037a1a10` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:14.864482 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5876e308-e1e0-4724-ae0e-2341054b882e None admin] RBAC: Authorizing `identity:get_project(project_id=d3ab4e0de40f498693e5df69037a1a10)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:14.865963 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5876e308-e1e0-4724-ae0e-2341054b882e None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:14.867744 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 562/1097] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Jul 1 19:23:14 2022] GET /identity/v3/projects/d3ab4e0de40f498693e5df69037a1a10 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:23:14.874520 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f0b56-d215-4594-9c81-d9bef0e3afdb None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:14.907777 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:14.984790 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f0b56-d215-4594-9c81-d9bef0e3afdb None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:15.019067 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d0a8f-e2fa-428d-8af8-22d43fdfecd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:15.019945 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d0a8f-e2fa-428d-8af8-22d43fdfecd2 None admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:15.020224 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d0a8f-e2fa-428d-8af8-22d43fdfecd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:15.020498 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d0a8f-e2fa-428d-8af8-22d43fdfecd2 None admin] PATH_INFO: `/v3/projects/d3ab4e0de40f498693e5df69037a1a10/users/9718be9f7bf94063b20c3d5d0643558b/roles/6cb03785fb184ef587509b3174622f69` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:15.022532 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84d0a8f-e2fa-428d-8af8-22d43fdfecd2 None admin] RBAC: Authorizing `identity:create_grant(project_id=d3ab4e0de40f498693e5df69037a1a10, user_id=9718be9f7bf94063b20c3d5d0643558b, role_id=6cb03785fb184ef587509b3174622f69)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:15.023969 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84d0a8f-e2fa-428d-8af8-22d43fdfecd2 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:15.037349 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 536/1098] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Jul 1 19:23:14 2022] PUT /identity/v3/projects/d3ab4e0de40f498693e5df69037a1a10/users/9718be9f7bf94063b20c3d5d0643558b/roles/6cb03785fb184ef587509b3174622f69 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:23:17.040938 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ecc333-742b-4a0c-bd7e-9e2cbc15b9ab None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:17.041516 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ecc333-742b-4a0c-bd7e-9e2cbc15b9ab None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:17.041516 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ecc333-742b-4a0c-bd7e-9e2cbc15b9ab None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:17.042849 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 563/1099] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:23:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:23:17.047904 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0455d-deac-4de2-8877-4fc0467209a6 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:17.048295 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0455d-deac-4de2-8877-4fc0467209a6 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:17.048472 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0455d-deac-4de2-8877-4fc0467209a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:17.065197 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-b5c0455d-deac-4de2-8877-4fc0467209a6 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:23:17.066397 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-b5c0455d-deac-4de2-8877-4fc0467209a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:23:17.132652 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 537/1100] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:23:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:23:17.156795 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ecc333-742b-4a0c-bd7e-9e2cbc15b9ab None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:17.224143 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:17.258853 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ecc333-742b-4a0c-bd7e-9e2cbc15b9ab None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:17.294436 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65afb4fe-b865-416c-b2cb-5375ac69eded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:17.295156 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65afb4fe-b865-416c-b2cb-5375ac69eded None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:17.295441 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65afb4fe-b865-416c-b2cb-5375ac69eded None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:17.295715 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65afb4fe-b865-416c-b2cb-5375ac69eded None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:17.306444 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65afb4fe-b865-416c-b2cb-5375ac69eded None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:23:17.315752 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-65afb4fe-b865-416c-b2cb-5375ac69eded None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:23:17.315752 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:23:17.315752 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:23:17.315752 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:23:17.315752 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:23:17.315752 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:23:17.315752 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:23:17.315752 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:23:17.315752 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:23:17.315752 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:23:17.315752 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:23:17.315752 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:23:17.315752 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:23:17.315752 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:23:17.315752 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:23:17.315752 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:23:17.316975 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:23:17.316975 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:23:17.316975 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:23:17.316975 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:23:17.316975 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:23:17.316975 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:23:17.316975 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:23:17.316975 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:23:17.316975 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:23:17.316975 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:23:17.316975 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:23:17.316975 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:23:17.316975 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:23:17.316975 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:23:17.316975 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:23:17.316975 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:23:17.318222 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:23:17.318222 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:23:17.318222 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:23:17.318222 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:23:17.318222 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:23:17.318222 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:23:17.318222 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:23:17.318222 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:23:17.318222 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:23:17.318222 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:23:17.318222 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:23:17.318222 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:23:17.318222 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 564/1101] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Jul 1 19:23:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:23:17.323364 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c0455d-deac-4de2-8877-4fc0467209a6 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:17.344339 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:17.420962 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c0455d-deac-4de2-8877-4fc0467209a6 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:17.453583 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14052f15-70e8-4b21-91ce-244cf01123cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:17.454229 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14052f15-70e8-4b21-91ce-244cf01123cd None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:17.454510 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14052f15-70e8-4b21-91ce-244cf01123cd None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:17.454783 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14052f15-70e8-4b21-91ce-244cf01123cd None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:17.455510 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14052f15-70e8-4b21-91ce-244cf01123cd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:23:17.455814 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14052f15-70e8-4b21-91ce-244cf01123cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:17.457185 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14052f15-70e8-4b21-91ce-244cf01123cd None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:17.465720 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 538/1102] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Jul 1 19:23:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:23:17.471637 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65afb4fe-b865-416c-b2cb-5375ac69eded None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:17.569364 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65afb4fe-b865-416c-b2cb-5375ac69eded None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:17.595212 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:17.603354 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1635a46b-dc60-4328-a3c2-082703915413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:17.604235 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635a46b-dc60-4328-a3c2-082703915413 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:17.604518 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635a46b-dc60-4328-a3c2-082703915413 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:17.604795 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635a46b-dc60-4328-a3c2-082703915413 None admin] PATH_INFO: `/v3/users/9718be9f7bf94063b20c3d5d0643558b` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:17.606550 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1635a46b-dc60-4328-a3c2-082703915413 None admin] RBAC: Authorizing `identity:get_user(user_id=9718be9f7bf94063b20c3d5d0643558b)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:17.607976 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1635a46b-dc60-4328-a3c2-082703915413 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:17.609615 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 565/1103] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Jul 1 19:23:17 2022] GET /identity/v3/users/9718be9f7bf94063b20c3d5d0643558b => generated 285 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:23:17.615296 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14052f15-70e8-4b21-91ce-244cf01123cd None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:17.697040 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:17.715894 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14052f15-70e8-4b21-91ce-244cf01123cd None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:17.748298 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ee2e63-53dd-41ad-91bf-a6a5d3736452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:17.748938 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee2e63-53dd-41ad-91bf-a6a5d3736452 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:17.749226 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee2e63-53dd-41ad-91bf-a6a5d3736452 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:17.749540 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee2e63-53dd-41ad-91bf-a6a5d3736452 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:17.815552 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ee2e63-53dd-41ad-91bf-a6a5d3736452 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:17.817000 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ee2e63-53dd-41ad-91bf-a6a5d3736452 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:17.894779 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:17.913578 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 539/1104] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Jul 1 19:23:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 01 19:23:17.919576 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1635a46b-dc60-4328-a3c2-082703915413 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:18.016373 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1635a46b-dc60-4328-a3c2-082703915413 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:18.049381 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5dd32f-336a-4d20-a837-c315a984a7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:18.050215 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5dd32f-336a-4d20-a837-c315a984a7c4 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:18.050497 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5dd32f-336a-4d20-a837-c315a984a7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:18.050770 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5dd32f-336a-4d20-a837-c315a984a7c4 None admin] PATH_INFO: `/v3/projects/d3ab4e0de40f498693e5df69037a1a10` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:18.051942 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5dd32f-336a-4d20-a837-c315a984a7c4 None admin] RBAC: Authorizing `identity:get_project(project_id=d3ab4e0de40f498693e5df69037a1a10)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:18.053657 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5dd32f-336a-4d20-a837-c315a984a7c4 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:18.055333 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 566/1105] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Jul 1 19:23:17 2022] GET /identity/v3/projects/d3ab4e0de40f498693e5df69037a1a10 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:23:18.061828 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ee2e63-53dd-41ad-91bf-a6a5d3736452 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:18.158879 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ee2e63-53dd-41ad-91bf-a6a5d3736452 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:18.191686 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a25cf-93db-44cf-9f4e-feffd152afbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:18.192304 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a25cf-93db-44cf-9f4e-feffd152afbe None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:18.192581 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a25cf-93db-44cf-9f4e-feffd152afbe None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:18.192851 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a25cf-93db-44cf-9f4e-feffd152afbe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:18.193699 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652a25cf-93db-44cf-9f4e-feffd152afbe None admin] RBAC: Adding query filter params (role.id=6cb03785fb184ef587509b3174622f69, scope.project.id=d3ab4e0de40f498693e5df69037a1a10, user.id=9718be9f7bf94063b20c3d5d0643558b) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:23:18.194007 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652a25cf-93db-44cf-9f4e-feffd152afbe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:18.195424 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652a25cf-93db-44cf-9f4e-feffd152afbe None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:18.201812 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 540/1106] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Jul 1 19:23:18 2022] GET /identity/v3/role_assignments?user.id=9718be9f7bf94063b20c3d5d0643558b&scope.project.id=d3ab4e0de40f498693e5df69037a1a10&role.id=6cb03785fb184ef587509b3174622f69 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:23:20.220161 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7027d-6647-4bb1-9166-76526779ca85 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:20.220735 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7027d-6647-4bb1-9166-76526779ca85 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:20.221126 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7027d-6647-4bb1-9166-76526779ca85 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:20.223600 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 567/1107] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:23:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:23:20.228951 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620f98fe-8e31-4600-9a7c-385a2df82fe2 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:20.229397 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620f98fe-8e31-4600-9a7c-385a2df82fe2 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:20.229539 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620f98fe-8e31-4600-9a7c-385a2df82fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:20.247015 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-620f98fe-8e31-4600-9a7c-385a2df82fe2 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:23:20.248191 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-620f98fe-8e31-4600-9a7c-385a2df82fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:23:20.289643 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:20.315331 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 541/1108] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:23:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:23:20.339831 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d7027d-6647-4bb1-9166-76526779ca85 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:20.402427 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:20.440919 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d7027d-6647-4bb1-9166-76526779ca85 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:20.475042 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906422a2-63e0-4e96-8fe4-c83fe4652a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:20.475879 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906422a2-63e0-4e96-8fe4-c83fe4652a87 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:20.476162 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906422a2-63e0-4e96-8fe4-c83fe4652a87 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:20.476461 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906422a2-63e0-4e96-8fe4-c83fe4652a87 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:20.477657 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906422a2-63e0-4e96-8fe4-c83fe4652a87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:20.479072 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906422a2-63e0-4e96-8fe4-c83fe4652a87 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:20.481751 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 568/1109] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:23:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:23:20.487623 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620f98fe-8e31-4600-9a7c-385a2df82fe2 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:20.584300 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620f98fe-8e31-4600-9a7c-385a2df82fe2 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:20.618697 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cbb527-c7ea-4cfc-88cd-7346801720c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:20.619357 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cbb527-c7ea-4cfc-88cd-7346801720c0 None admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:20.619641 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cbb527-c7ea-4cfc-88cd-7346801720c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:20.619919 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cbb527-c7ea-4cfc-88cd-7346801720c0 None admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:20.620657 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cbb527-c7ea-4cfc-88cd-7346801720c0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:20.622138 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cbb527-c7ea-4cfc-88cd-7346801720c0 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:20.642607 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 542/1110] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Jul 1 19:23:20 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:23:22.701623 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b40407c-e9ab-45e5-ab93-7512893c4200 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:22.702155 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b40407c-e9ab-45e5-ab93-7512893c4200 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:22.702155 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b40407c-e9ab-45e5-ab93-7512893c4200 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:22.703539 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 569/1111] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:23:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:23:22.708756 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941919bb-6af2-4f3b-9a56-6c1063fe4a41 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:22.709161 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941919bb-6af2-4f3b-9a56-6c1063fe4a41 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:22.709363 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941919bb-6af2-4f3b-9a56-6c1063fe4a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:22.725791 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-941919bb-6af2-4f3b-9a56-6c1063fe4a41 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:23:22.726969 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-941919bb-6af2-4f3b-9a56-6c1063fe4a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:23:22.752297 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:22.793958 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 543/1112] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:23:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:23:22.817897 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b40407c-e9ab-45e5-ab93-7512893c4200 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:22.917222 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b40407c-e9ab-45e5-ab93-7512893c4200 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:22.945632 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:22.951452 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2763bb11-bbfc-4b5c-bb24-31103522c1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:22.952296 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2763bb11-bbfc-4b5c-bb24-31103522c1e3 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:22.952585 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2763bb11-bbfc-4b5c-bb24-31103522c1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:22.952866 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2763bb11-bbfc-4b5c-bb24-31103522c1e3 None admin] PATH_INFO: `/v3/roles/dd71f7898e6a4d9f99d1554dd7d27033` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:22.954359 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2763bb11-bbfc-4b5c-bb24-31103522c1e3 None admin] RBAC: Authorizing `identity:get_role(role_id=dd71f7898e6a4d9f99d1554dd7d27033)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:22.955718 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2763bb11-bbfc-4b5c-bb24-31103522c1e3 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:22.957094 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 570/1113] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Jul 1 19:23:22 2022] GET /identity/v3/roles/dd71f7898e6a4d9f99d1554dd7d27033 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:23:22.962786 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941919bb-6af2-4f3b-9a56-6c1063fe4a41 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:23.057731 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941919bb-6af2-4f3b-9a56-6c1063fe4a41 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:23.091592 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74b0805-2bea-4faf-b2e4-6bcb047f4e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:23.092454 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b0805-2bea-4faf-b2e4-6bcb047f4e82 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:23.092739 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b0805-2bea-4faf-b2e4-6bcb047f4e82 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:23.093016 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b0805-2bea-4faf-b2e4-6bcb047f4e82 None admin] PATH_INFO: `/v3/users/bd23aecc08314b97a0d2cf17da49a5ef` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:23.107266 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74b0805-2bea-4faf-b2e4-6bcb047f4e82 None admin] RBAC: Authorizing `identity:get_user(user_id=bd23aecc08314b97a0d2cf17da49a5ef)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:23.108698 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74b0805-2bea-4faf-b2e4-6bcb047f4e82 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:23.110395 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 544/1114] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Jul 1 19:23:22 2022] GET /identity/v3/users/bd23aecc08314b97a0d2cf17da49a5ef => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:23:23.116009 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2763bb11-bbfc-4b5c-bb24-31103522c1e3 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:23.212568 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2763bb11-bbfc-4b5c-bb24-31103522c1e3 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:23.246795 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9220e747-eea0-4190-8d1c-98a03fde9a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:23.247442 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9220e747-eea0-4190-8d1c-98a03fde9a5d None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:23.247726 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9220e747-eea0-4190-8d1c-98a03fde9a5d None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:23.248004 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9220e747-eea0-4190-8d1c-98a03fde9a5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:23.313045 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:23.315248 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9220e747-eea0-4190-8d1c-98a03fde9a5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:23.317199 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9220e747-eea0-4190-8d1c-98a03fde9a5d None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:23.411357 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 571/1115] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Jul 1 19:23:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 01 19:23:23.417409 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74b0805-2bea-4faf-b2e4-6bcb047f4e82 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:23.438989 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:23.516488 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74b0805-2bea-4faf-b2e4-6bcb047f4e82 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:23.549859 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a099c505-db0c-46d9-a73f-9b01338d4013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:23.550694 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099c505-db0c-46d9-a73f-9b01338d4013 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:23.550981 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099c505-db0c-46d9-a73f-9b01338d4013 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:23.551252 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099c505-db0c-46d9-a73f-9b01338d4013 None admin] PATH_INFO: `/v3/projects/d3ab4e0de40f498693e5df69037a1a10` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:23.552676 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a099c505-db0c-46d9-a73f-9b01338d4013 None admin] RBAC: Authorizing `identity:get_project(project_id=d3ab4e0de40f498693e5df69037a1a10)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:23.554135 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a099c505-db0c-46d9-a73f-9b01338d4013 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:23.555808 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 545/1116] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Jul 1 19:23:23 2022] GET /identity/v3/projects/d3ab4e0de40f498693e5df69037a1a10 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:23:23.561874 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9220e747-eea0-4190-8d1c-98a03fde9a5d None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:23.659439 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:23.663197 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9220e747-eea0-4190-8d1c-98a03fde9a5d None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:23.697877 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fae284-94dd-459f-bd1b-4ba39fe64635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:23.699042 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fae284-94dd-459f-bd1b-4ba39fe64635 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:23.699323 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fae284-94dd-459f-bd1b-4ba39fe64635 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:23.699597 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fae284-94dd-459f-bd1b-4ba39fe64635 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:23.700414 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fae284-94dd-459f-bd1b-4ba39fe64635 None admin] RBAC: Adding query filter params (role.id=dd71f7898e6a4d9f99d1554dd7d27033, scope.project.id=d3ab4e0de40f498693e5df69037a1a10, user.id=bd23aecc08314b97a0d2cf17da49a5ef) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:23:23.700722 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fae284-94dd-459f-bd1b-4ba39fe64635 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:23.702157 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fae284-94dd-459f-bd1b-4ba39fe64635 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:23.707502 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 572/1117] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Jul 1 19:23:23 2022] GET /identity/v3/role_assignments?user.id=bd23aecc08314b97a0d2cf17da49a5ef&scope.project.id=d3ab4e0de40f498693e5df69037a1a10&role.id=dd71f7898e6a4d9f99d1554dd7d27033 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:23:25.708759 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf701c-4d01-4c32-87c1-72f0bc5cb0d1 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:25.709315 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf701c-4d01-4c32-87c1-72f0bc5cb0d1 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:25.709429 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf701c-4d01-4c32-87c1-72f0bc5cb0d1 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:25.710722 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 546/1118] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:23:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:23:25.716336 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f8b03e-6759-411c-82e8-f9ec24221539 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:25.716787 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f8b03e-6759-411c-82e8-f9ec24221539 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:25.716891 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f8b03e-6759-411c-82e8-f9ec24221539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:25.734036 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-90f8b03e-6759-411c-82e8-f9ec24221539 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:23:25.735211 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-90f8b03e-6759-411c-82e8-f9ec24221539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:23:25.800382 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 573/1119] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:23:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:23:25.823076 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cf701c-4d01-4c32-87c1-72f0bc5cb0d1 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:25.912539 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:25.926035 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cf701c-4d01-4c32-87c1-72f0bc5cb0d1 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:25.959340 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05ac057-4a2c-40f1-8fb4-e25eb881a38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:25.960179 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ac057-4a2c-40f1-8fb4-e25eb881a38d None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:25.960466 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ac057-4a2c-40f1-8fb4-e25eb881a38d None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:25.960745 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ac057-4a2c-40f1-8fb4-e25eb881a38d None admin] PATH_INFO: `/v3/roles/dd71f7898e6a4d9f99d1554dd7d27033` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:25.962227 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05ac057-4a2c-40f1-8fb4-e25eb881a38d None admin] RBAC: Authorizing `identity:get_role(role_id=dd71f7898e6a4d9f99d1554dd7d27033)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:25.963603 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05ac057-4a2c-40f1-8fb4-e25eb881a38d None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:25.965599 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 547/1120] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Jul 1 19:23:25 2022] GET /identity/v3/roles/dd71f7898e6a4d9f99d1554dd7d27033 => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:23:25.971334 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f8b03e-6759-411c-82e8-f9ec24221539 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:26.063215 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:26.070496 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f8b03e-6759-411c-82e8-f9ec24221539 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:26.104220 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736177c8-1f71-4433-9ae6-add2378b663a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:26.105127 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736177c8-1f71-4433-9ae6-add2378b663a None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:26.105474 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736177c8-1f71-4433-9ae6-add2378b663a None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:26.105757 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736177c8-1f71-4433-9ae6-add2378b663a None admin] PATH_INFO: `/v3/users/bd23aecc08314b97a0d2cf17da49a5ef` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:26.106945 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736177c8-1f71-4433-9ae6-add2378b663a None admin] RBAC: Authorizing `identity:get_user(user_id=bd23aecc08314b97a0d2cf17da49a5ef)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:26.108366 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736177c8-1f71-4433-9ae6-add2378b663a None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:26.110020 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 574/1121] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Jul 1 19:23:25 2022] GET /identity/v3/users/bd23aecc08314b97a0d2cf17da49a5ef => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:23:26.115811 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05ac057-4a2c-40f1-8fb4-e25eb881a38d None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:26.213902 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05ac057-4a2c-40f1-8fb4-e25eb881a38d None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:26.247090 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3c66cb-d9fe-4cf6-a59e-671a97d76ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:26.247922 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c66cb-d9fe-4cf6-a59e-671a97d76ba9 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:26.248226 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c66cb-d9fe-4cf6-a59e-671a97d76ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:26.248521 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c66cb-d9fe-4cf6-a59e-671a97d76ba9 None admin] PATH_INFO: `/v3/projects/d3ab4e0de40f498693e5df69037a1a10` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:26.249883 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3c66cb-d9fe-4cf6-a59e-671a97d76ba9 None admin] RBAC: Authorizing `identity:get_project(project_id=d3ab4e0de40f498693e5df69037a1a10)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:26.251323 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3c66cb-d9fe-4cf6-a59e-671a97d76ba9 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:26.253119 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 548/1122] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Jul 1 19:23:26 2022] GET /identity/v3/projects/d3ab4e0de40f498693e5df69037a1a10 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:23:26.259410 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736177c8-1f71-4433-9ae6-add2378b663a None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:26.358597 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736177c8-1f71-4433-9ae6-add2378b663a None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:26.392715 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278acb78-d604-4d02-8bd7-389d34e1cb5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:26.393691 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278acb78-d604-4d02-8bd7-389d34e1cb5c None admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:26.393977 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278acb78-d604-4d02-8bd7-389d34e1cb5c None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:26.394257 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278acb78-d604-4d02-8bd7-389d34e1cb5c None admin] PATH_INFO: `/v3/projects/d3ab4e0de40f498693e5df69037a1a10/users/bd23aecc08314b97a0d2cf17da49a5ef/roles/dd71f7898e6a4d9f99d1554dd7d27033` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:26.396459 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278acb78-d604-4d02-8bd7-389d34e1cb5c None admin] RBAC: Authorizing `identity:create_grant(project_id=d3ab4e0de40f498693e5df69037a1a10, user_id=bd23aecc08314b97a0d2cf17da49a5ef, role_id=dd71f7898e6a4d9f99d1554dd7d27033)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:26.397918 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278acb78-d604-4d02-8bd7-389d34e1cb5c None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:26.410371 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 575/1123] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Jul 1 19:23:26 2022] PUT /identity/v3/projects/d3ab4e0de40f498693e5df69037a1a10/users/bd23aecc08314b97a0d2cf17da49a5ef/roles/dd71f7898e6a4d9f99d1554dd7d27033 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:23:28.404033 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b788513-c201-471e-8902-b913fd021ec6 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:28.404598 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b788513-c201-471e-8902-b913fd021ec6 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:28.404598 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b788513-c201-471e-8902-b913fd021ec6 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:28.405981 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 549/1124] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:23:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:23:28.412042 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778697f-d883-4b49-b2fc-b5c74e624fb3 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:28.412478 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778697f-d883-4b49-b2fc-b5c74e624fb3 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:28.412615 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778697f-d883-4b49-b2fc-b5c74e624fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:28.430510 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-a778697f-d883-4b49-b2fc-b5c74e624fb3 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:23:28.431701 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-a778697f-d883-4b49-b2fc-b5c74e624fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:23:28.448401 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:28.499760 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 576/1125] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:23:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:23:28.523484 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b788513-c201-471e-8902-b913fd021ec6 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:28.548595 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:28.625114 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b788513-c201-471e-8902-b913fd021ec6 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:28.660608 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaf48a7-249f-4722-bbfe-5cd96915939f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:28.661447 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf48a7-249f-4722-bbfe-5cd96915939f None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:28.661753 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf48a7-249f-4722-bbfe-5cd96915939f None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:28.662031 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf48a7-249f-4722-bbfe-5cd96915939f None admin] PATH_INFO: `/v3/roles/dd71f7898e6a4d9f99d1554dd7d27033` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:28.663487 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaf48a7-249f-4722-bbfe-5cd96915939f None admin] RBAC: Authorizing `identity:get_role(role_id=dd71f7898e6a4d9f99d1554dd7d27033)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:28.664936 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaf48a7-249f-4722-bbfe-5cd96915939f None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:28.666352 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 550/1126] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Jul 1 19:23:28 2022] GET /identity/v3/roles/dd71f7898e6a4d9f99d1554dd7d27033 => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:23:28.672929 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a778697f-d883-4b49-b2fc-b5c74e624fb3 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:28.767416 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a778697f-d883-4b49-b2fc-b5c74e624fb3 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:28.801012 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf34d80-d40e-4ef3-95b7-ca287dca0994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:28.801897 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf34d80-d40e-4ef3-95b7-ca287dca0994 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:28.802448 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf34d80-d40e-4ef3-95b7-ca287dca0994 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:28.802729 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf34d80-d40e-4ef3-95b7-ca287dca0994 None admin] PATH_INFO: `/v3/users/bd23aecc08314b97a0d2cf17da49a5ef` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:28.803928 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf34d80-d40e-4ef3-95b7-ca287dca0994 None admin] RBAC: Authorizing `identity:get_user(user_id=bd23aecc08314b97a0d2cf17da49a5ef)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:28.805386 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf34d80-d40e-4ef3-95b7-ca287dca0994 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:28.807054 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 577/1127] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Jul 1 19:23:28 2022] GET /identity/v3/users/bd23aecc08314b97a0d2cf17da49a5ef => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:23:28.813349 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaf48a7-249f-4722-bbfe-5cd96915939f None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:28.901661 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:28.910558 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaf48a7-249f-4722-bbfe-5cd96915939f None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:28.944161 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62dc645-d10e-44b2-bde4-6e7d98b6ad5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:28.944734 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62dc645-d10e-44b2-bde4-6e7d98b6ad5f None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:28.945018 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62dc645-d10e-44b2-bde4-6e7d98b6ad5f None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:28.945323 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62dc645-d10e-44b2-bde4-6e7d98b6ad5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:29.010914 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62dc645-d10e-44b2-bde4-6e7d98b6ad5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:29.012362 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62dc645-d10e-44b2-bde4-6e7d98b6ad5f None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:29.098908 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:29.108914 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 551/1128] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Jul 1 19:23:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 01 19:23:29.114996 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf34d80-d40e-4ef3-95b7-ca287dca0994 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:29.136648 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:29.212891 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf34d80-d40e-4ef3-95b7-ca287dca0994 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:29.245905 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21417bda-94f9-474c-b0e6-c7e15c9b244a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:29.246733 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21417bda-94f9-474c-b0e6-c7e15c9b244a None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:29.247012 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21417bda-94f9-474c-b0e6-c7e15c9b244a None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:29.247289 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21417bda-94f9-474c-b0e6-c7e15c9b244a None admin] PATH_INFO: `/v3/projects/d3ab4e0de40f498693e5df69037a1a10` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:29.248451 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21417bda-94f9-474c-b0e6-c7e15c9b244a None admin] RBAC: Authorizing `identity:get_project(project_id=d3ab4e0de40f498693e5df69037a1a10)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:29.249895 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21417bda-94f9-474c-b0e6-c7e15c9b244a None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:29.251578 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 578/1129] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Jul 1 19:23:29 2022] GET /identity/v3/projects/d3ab4e0de40f498693e5df69037a1a10 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:23:29.257622 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62dc645-d10e-44b2-bde4-6e7d98b6ad5f None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:29.352955 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62dc645-d10e-44b2-bde4-6e7d98b6ad5f None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:29.386296 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308560e9-1003-40ff-a5bb-56a1fe3b52f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:29.386929 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308560e9-1003-40ff-a5bb-56a1fe3b52f0 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:29.387212 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308560e9-1003-40ff-a5bb-56a1fe3b52f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:29.387490 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308560e9-1003-40ff-a5bb-56a1fe3b52f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:29.388305 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308560e9-1003-40ff-a5bb-56a1fe3b52f0 None admin] RBAC: Adding query filter params (role.id=dd71f7898e6a4d9f99d1554dd7d27033, scope.project.id=d3ab4e0de40f498693e5df69037a1a10, user.id=bd23aecc08314b97a0d2cf17da49a5ef) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:23:29.388615 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308560e9-1003-40ff-a5bb-56a1fe3b52f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:29.390071 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308560e9-1003-40ff-a5bb-56a1fe3b52f0 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:29.395830 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 552/1130] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Jul 1 19:23:29 2022] GET /identity/v3/role_assignments?user.id=bd23aecc08314b97a0d2cf17da49a5ef&scope.project.id=d3ab4e0de40f498693e5df69037a1a10&role.id=dd71f7898e6a4d9f99d1554dd7d27033 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:23:31.436321 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166f04d-62c3-41e4-9b64-05d952cff553 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:31.437707 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166f04d-62c3-41e4-9b64-05d952cff553 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:31.437707 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166f04d-62c3-41e4-9b64-05d952cff553 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:31.438490 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 579/1131] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:23:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:23:31.443569 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b165f75-7185-4e31-8f78-0756c384c338 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:31.443963 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b165f75-7185-4e31-8f78-0756c384c338 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:31.444586 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b165f75-7185-4e31-8f78-0756c384c338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:31.461144 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-7b165f75-7185-4e31-8f78-0756c384c338 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:23:31.462350 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-7b165f75-7185-4e31-8f78-0756c384c338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:23:31.512117 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:31.529074 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 553/1132] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:23:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:23:31.553116 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e166f04d-62c3-41e4-9b64-05d952cff553 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:31.641162 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:31.654194 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e166f04d-62c3-41e4-9b64-05d952cff553 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:31.687720 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93321c06-db0a-4785-a8f4-15326ef58d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:31.688445 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93321c06-db0a-4785-a8f4-15326ef58d7c None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:31.688734 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93321c06-db0a-4785-a8f4-15326ef58d7c None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:31.689014 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93321c06-db0a-4785-a8f4-15326ef58d7c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:31.690374 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93321c06-db0a-4785-a8f4-15326ef58d7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:31.691806 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93321c06-db0a-4785-a8f4-15326ef58d7c None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:31.693448 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 580/1133] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:23:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:23:31.699236 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b165f75-7185-4e31-8f78-0756c384c338 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:31.794939 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b165f75-7185-4e31-8f78-0756c384c338 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:31.829174 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4005cb03-942b-484b-9a51-b21c1344fdf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:31.829855 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005cb03-942b-484b-9a51-b21c1344fdf7 None admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:31.830216 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005cb03-942b-484b-9a51-b21c1344fdf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:31.830502 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005cb03-942b-484b-9a51-b21c1344fdf7 None admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:31.831220 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4005cb03-942b-484b-9a51-b21c1344fdf7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:31.832653 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4005cb03-942b-484b-9a51-b21c1344fdf7 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:31.857467 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 554/1134] 10.222.0.26 () {60 vars in 1141 bytes} [Fri Jul 1 19:23:31 2022] POST /identity/v3/projects => generated 311 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 19:23:33.902403 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67364d84-4408-4d0c-a9ff-f9dc911ebf58 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:33.902915 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67364d84-4408-4d0c-a9ff-f9dc911ebf58 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:33.902915 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67364d84-4408-4d0c-a9ff-f9dc911ebf58 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:33.904230 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 581/1135] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:23:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:23:33.909680 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb4fd9-3c22-4797-bd63-aadfe049bbe4 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:33.910094 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb4fd9-3c22-4797-bd63-aadfe049bbe4 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:33.910238 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb4fd9-3c22-4797-bd63-aadfe049bbe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:33.926680 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-6ecb4fd9-3c22-4797-bd63-aadfe049bbe4 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:23:33.928096 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-6ecb4fd9-3c22-4797-bd63-aadfe049bbe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:23:33.957687 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:33.994475 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 555/1136] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:23:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:23:34.020265 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67364d84-4408-4d0c-a9ff-f9dc911ebf58 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:34.119063 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67364d84-4408-4d0c-a9ff-f9dc911ebf58 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:34.152508 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f8c92b-acab-4f80-98c2-5f340d648c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:34.153214 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8c92b-acab-4f80-98c2-5f340d648c5c None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:34.153534 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8c92b-acab-4f80-98c2-5f340d648c5c None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:34.153811 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8c92b-acab-4f80-98c2-5f340d648c5c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:34.154970 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f8c92b-acab-4f80-98c2-5f340d648c5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:34.156393 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f8c92b-acab-4f80-98c2-5f340d648c5c None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:34.158015 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 582/1137] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:23:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:23:34.163731 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb4fd9-3c22-4797-bd63-aadfe049bbe4 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:34.259539 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb4fd9-3c22-4797-bd63-aadfe049bbe4 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:34.293260 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33187e76-96ea-4e04-b6f9-d0edbd87ae68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:34.293930 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33187e76-96ea-4e04-b6f9-d0edbd87ae68 None admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:34.294213 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33187e76-96ea-4e04-b6f9-d0edbd87ae68 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:34.294486 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33187e76-96ea-4e04-b6f9-d0edbd87ae68 None admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:34.295184 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33187e76-96ea-4e04-b6f9-d0edbd87ae68 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:34.296611 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33187e76-96ea-4e04-b6f9-d0edbd87ae68 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:34.316671 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 556/1138] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Jul 1 19:23:34 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:23:36.350768 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ee6ee-3dfd-4beb-b9f0-2a3ccdef0d8d None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:36.351315 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ee6ee-3dfd-4beb-b9f0-2a3ccdef0d8d None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:36.351425 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ee6ee-3dfd-4beb-b9f0-2a3ccdef0d8d None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:36.352726 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 583/1139] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:23:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:23:36.358608 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc77348-3594-4699-b101-e4089f271377 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:36.359019 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc77348-3594-4699-b101-e4089f271377 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:36.359163 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc77348-3594-4699-b101-e4089f271377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:36.376694 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-ccc77348-3594-4699-b101-e4089f271377 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:23:36.377993 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-ccc77348-3594-4699-b101-e4089f271377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:23:36.394969 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:36.447166 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 557/1140] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:23:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:23:36.472061 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ee6ee-3dfd-4beb-b9f0-2a3ccdef0d8d None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:36.496661 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:36.570984 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ee6ee-3dfd-4beb-b9f0-2a3ccdef0d8d None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:36.605018 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c80a772-a144-4888-9e86-51c9118905fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:36.605748 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c80a772-a144-4888-9e86-51c9118905fc None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:36.606031 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c80a772-a144-4888-9e86-51c9118905fc None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:36.606305 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c80a772-a144-4888-9e86-51c9118905fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:36.616298 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c80a772-a144-4888-9e86-51c9118905fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:23:36.623767 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-3c80a772-a144-4888-9e86-51c9118905fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:23:36.623767 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:23:36.623767 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:23:36.623767 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:23:36.623767 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:23:36.623767 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:23:36.623767 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:23:36.623767 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:23:36.623767 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:23:36.623767 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:23:36.623767 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:23:36.623767 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:23:36.623767 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:23:36.623767 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:23:36.623767 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:23:36.623767 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:23:36.624908 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:23:36.624908 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:23:36.624908 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:23:36.624908 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:23:36.624908 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:23:36.624908 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:23:36.624908 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:23:36.624908 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:23:36.624908 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:23:36.624908 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:23:36.624908 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:23:36.624908 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:23:36.624908 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:23:36.624908 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:23:36.624908 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:23:36.624908 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:23:36.625817 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:23:36.625817 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:23:36.625817 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:23:36.625817 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:23:36.625817 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:23:36.625817 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:23:36.625817 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:23:36.625817 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:23:36.625817 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:23:36.625817 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:23:36.625817 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:23:36.625817 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:23:36.625817 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 584/1141] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Jul 1 19:23:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:23:36.630963 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc77348-3594-4699-b101-e4089f271377 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:36.731878 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc77348-3594-4699-b101-e4089f271377 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:36.766296 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5907fb91-ed92-4800-9622-b0c7663e7674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:36.766959 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907fb91-ed92-4800-9622-b0c7663e7674 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:36.767245 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907fb91-ed92-4800-9622-b0c7663e7674 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:36.767538 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907fb91-ed92-4800-9622-b0c7663e7674 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:36.768260 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5907fb91-ed92-4800-9622-b0c7663e7674 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:23:36.768569 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5907fb91-ed92-4800-9622-b0c7663e7674 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:36.769973 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5907fb91-ed92-4800-9622-b0c7663e7674 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:36.778460 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 558/1142] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Jul 1 19:23:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:23:36.784259 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c80a772-a144-4888-9e86-51c9118905fc None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:36.867112 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:36.883444 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c80a772-a144-4888-9e86-51c9118905fc None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:36.916183 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cd811e-456a-445f-8ceb-1bed823ae829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:36.917032 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd811e-456a-445f-8ceb-1bed823ae829 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:36.917340 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd811e-456a-445f-8ceb-1bed823ae829 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:36.917617 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd811e-456a-445f-8ceb-1bed823ae829 None admin] PATH_INFO: `/v3/users/7b448918afb54796ad8e713ffb2f6627` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:36.930511 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cd811e-456a-445f-8ceb-1bed823ae829 None admin] RBAC: Authorizing `identity:get_user(user_id=7b448918afb54796ad8e713ffb2f6627)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:36.931936 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cd811e-456a-445f-8ceb-1bed823ae829 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:36.934102 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 585/1143] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Jul 1 19:23:36 2022] GET /identity/v3/users/7b448918afb54796ad8e713ffb2f6627 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:23:36.939805 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5907fb91-ed92-4800-9622-b0c7663e7674 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:36.958856 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:37.038610 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5907fb91-ed92-4800-9622-b0c7663e7674 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:37.071590 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840d623a-b16d-4ec5-8145-d273d7a8f1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:37.072223 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840d623a-b16d-4ec5-8145-d273d7a8f1ff None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:37.072508 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840d623a-b16d-4ec5-8145-d273d7a8f1ff None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:37.072787 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840d623a-b16d-4ec5-8145-d273d7a8f1ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:37.138713 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840d623a-b16d-4ec5-8145-d273d7a8f1ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:37.140096 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840d623a-b16d-4ec5-8145-d273d7a8f1ff None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:37.156458 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:37.236475 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 559/1144] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Jul 1 19:23:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 01 19:23:37.242295 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cd811e-456a-445f-8ceb-1bed823ae829 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:37.339063 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cd811e-456a-445f-8ceb-1bed823ae829 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:37.372207 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93f4181-779c-4dae-aa80-dd93099426f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:37.373051 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f4181-779c-4dae-aa80-dd93099426f2 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:37.373367 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f4181-779c-4dae-aa80-dd93099426f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:37.373646 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f4181-779c-4dae-aa80-dd93099426f2 None admin] PATH_INFO: `/v3/projects/3bfd03d5bd1243948f83469633c2f2e2` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:37.374822 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93f4181-779c-4dae-aa80-dd93099426f2 None admin] RBAC: Authorizing `identity:get_project(project_id=3bfd03d5bd1243948f83469633c2f2e2)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:37.376232 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93f4181-779c-4dae-aa80-dd93099426f2 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:37.378025 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 586/1145] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Jul 1 19:23:37 2022] GET /identity/v3/projects/3bfd03d5bd1243948f83469633c2f2e2 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:23:37.384197 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840d623a-b16d-4ec5-8145-d273d7a8f1ff None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:37.481422 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840d623a-b16d-4ec5-8145-d273d7a8f1ff None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:37.497946 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:37.515663 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339638a4-5d4f-4892-940d-fe92cb806575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:37.516300 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339638a4-5d4f-4892-940d-fe92cb806575 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:37.516582 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339638a4-5d4f-4892-940d-fe92cb806575 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:37.516858 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339638a4-5d4f-4892-940d-fe92cb806575 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:37.517705 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339638a4-5d4f-4892-940d-fe92cb806575 None admin] RBAC: Adding query filter params (role.id=6cb03785fb184ef587509b3174622f69, scope.project.id=3bfd03d5bd1243948f83469633c2f2e2, user.id=7b448918afb54796ad8e713ffb2f6627) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:23:37.518012 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339638a4-5d4f-4892-940d-fe92cb806575 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:37.519437 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339638a4-5d4f-4892-940d-fe92cb806575 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:37.524765 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 560/1146] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Jul 1 19:23:37 2022] GET /identity/v3/role_assignments?user.id=7b448918afb54796ad8e713ffb2f6627&scope.project.id=3bfd03d5bd1243948f83469633c2f2e2&role.id=6cb03785fb184ef587509b3174622f69 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:23:39.488462 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda40e9-8f28-41de-b104-9ac4c89e5dfd None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:39.489049 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda40e9-8f28-41de-b104-9ac4c89e5dfd None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:39.489150 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda40e9-8f28-41de-b104-9ac4c89e5dfd None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:39.490493 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 587/1147] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:23:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:23:39.495747 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64753a8c-21e6-4dc8-ab00-3b49600d0752 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:39.496187 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64753a8c-21e6-4dc8-ab00-3b49600d0752 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:39.496315 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64753a8c-21e6-4dc8-ab00-3b49600d0752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:39.513202 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-64753a8c-21e6-4dc8-ab00-3b49600d0752 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:23:39.514416 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-64753a8c-21e6-4dc8-ab00-3b49600d0752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:23:39.580054 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 561/1148] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:23:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:23:39.603134 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dda40e9-8f28-41de-b104-9ac4c89e5dfd None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:39.615239 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:39.703923 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dda40e9-8f28-41de-b104-9ac4c89e5dfd None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:39.736933 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14cc2ca-b5ba-4184-a611-05972eec90b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:39.737750 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14cc2ca-b5ba-4184-a611-05972eec90b8 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:39.738037 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14cc2ca-b5ba-4184-a611-05972eec90b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:39.738315 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14cc2ca-b5ba-4184-a611-05972eec90b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:39.748245 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14cc2ca-b5ba-4184-a611-05972eec90b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:23:39.755987 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-a14cc2ca-b5ba-4184-a611-05972eec90b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:23:39.755987 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:23:39.755987 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:23:39.755987 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:23:39.755987 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:23:39.755987 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:23:39.755987 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:23:39.755987 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:23:39.755987 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:23:39.755987 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:23:39.755987 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:23:39.755987 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:23:39.755987 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:23:39.755987 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:23:39.755987 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:23:39.755987 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:23:39.757153 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:23:39.757153 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:23:39.757153 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:23:39.757153 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:23:39.757153 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:23:39.757153 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:23:39.757153 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:23:39.757153 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:23:39.757153 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:23:39.757153 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:23:39.757153 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:23:39.757153 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:23:39.757153 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:23:39.757153 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:23:39.757153 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:23:39.757153 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:23:39.758272 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:23:39.758272 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:23:39.758272 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:23:39.758272 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:23:39.758272 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:23:39.758272 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:23:39.758272 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:23:39.758272 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:23:39.758272 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:23:39.758272 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:23:39.758272 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:23:39.758272 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:23:39.758272 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 588/1149] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Jul 1 19:23:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:23:39.763962 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64753a8c-21e6-4dc8-ab00-3b49600d0752 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:39.862088 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64753a8c-21e6-4dc8-ab00-3b49600d0752 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:39.872811 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:39.896621 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d54f89-2602-431f-a54a-fee7d9c0f112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:39.897299 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d54f89-2602-431f-a54a-fee7d9c0f112 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:39.897583 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d54f89-2602-431f-a54a-fee7d9c0f112 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:39.897857 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d54f89-2602-431f-a54a-fee7d9c0f112 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:39.898588 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d54f89-2602-431f-a54a-fee7d9c0f112 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:23:39.898898 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d54f89-2602-431f-a54a-fee7d9c0f112 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:39.900263 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d54f89-2602-431f-a54a-fee7d9c0f112 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:39.908164 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 562/1150] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Jul 1 19:23:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:23:39.913923 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14cc2ca-b5ba-4184-a611-05972eec90b8 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:39.982639 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:40.015155 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14cc2ca-b5ba-4184-a611-05972eec90b8 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:40.047354 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bdf79c-cc47-4f42-9bf8-11042fb3a2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:40.048220 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bdf79c-cc47-4f42-9bf8-11042fb3a2b6 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:40.048526 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bdf79c-cc47-4f42-9bf8-11042fb3a2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:40.048864 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bdf79c-cc47-4f42-9bf8-11042fb3a2b6 None admin] PATH_INFO: `/v3/users/7b448918afb54796ad8e713ffb2f6627` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:40.050078 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bdf79c-cc47-4f42-9bf8-11042fb3a2b6 None admin] RBAC: Authorizing `identity:get_user(user_id=7b448918afb54796ad8e713ffb2f6627)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:40.051508 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bdf79c-cc47-4f42-9bf8-11042fb3a2b6 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:40.053406 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 589/1151] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Jul 1 19:23:39 2022] GET /identity/v3/users/7b448918afb54796ad8e713ffb2f6627 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:23:40.059631 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d54f89-2602-431f-a54a-fee7d9c0f112 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:40.157370 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d54f89-2602-431f-a54a-fee7d9c0f112 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:40.190457 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853b1abd-3634-4f1a-bcda-415e8fea0cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:40.191301 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b1abd-3634-4f1a-bcda-415e8fea0cbd None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:40.191585 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b1abd-3634-4f1a-bcda-415e8fea0cbd None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:40.191863 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b1abd-3634-4f1a-bcda-415e8fea0cbd None admin] PATH_INFO: `/v3/projects/3bfd03d5bd1243948f83469633c2f2e2` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:40.193033 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853b1abd-3634-4f1a-bcda-415e8fea0cbd None admin] RBAC: Authorizing `identity:get_project(project_id=3bfd03d5bd1243948f83469633c2f2e2)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:40.194500 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853b1abd-3634-4f1a-bcda-415e8fea0cbd None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:40.196180 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 563/1152] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Jul 1 19:23:40 2022] GET /identity/v3/projects/3bfd03d5bd1243948f83469633c2f2e2 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:23:40.202777 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bdf79c-cc47-4f42-9bf8-11042fb3a2b6 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:40.298532 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bdf79c-cc47-4f42-9bf8-11042fb3a2b6 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:40.331109 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6845f9c3-e1c6-402c-b2d2-ef2c63171e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:40.331980 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845f9c3-e1c6-402c-b2d2-ef2c63171e97 None admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:40.332264 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845f9c3-e1c6-402c-b2d2-ef2c63171e97 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:40.332541 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845f9c3-e1c6-402c-b2d2-ef2c63171e97 None admin] PATH_INFO: `/v3/projects/3bfd03d5bd1243948f83469633c2f2e2/users/7b448918afb54796ad8e713ffb2f6627/roles/6cb03785fb184ef587509b3174622f69` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:40.334516 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6845f9c3-e1c6-402c-b2d2-ef2c63171e97 None admin] RBAC: Authorizing `identity:create_grant(project_id=3bfd03d5bd1243948f83469633c2f2e2, user_id=7b448918afb54796ad8e713ffb2f6627, role_id=6cb03785fb184ef587509b3174622f69)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:40.335939 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6845f9c3-e1c6-402c-b2d2-ef2c63171e97 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:40.346278 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:40.352944 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 590/1153] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Jul 1 19:23:40 2022] PUT /identity/v3/projects/3bfd03d5bd1243948f83469633c2f2e2/users/7b448918afb54796ad8e713ffb2f6627/roles/6cb03785fb184ef587509b3174622f69 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:23:42.351194 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157cfc09-0025-41c0-9975-6f859334cc87 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:42.351737 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157cfc09-0025-41c0-9975-6f859334cc87 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:42.351737 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157cfc09-0025-41c0-9975-6f859334cc87 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:42.353124 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 564/1154] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:23:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:23:42.358349 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca294df-d9db-487c-a720-3b348ad8c31f None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:42.358794 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca294df-d9db-487c-a720-3b348ad8c31f None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:42.358921 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca294df-d9db-487c-a720-3b348ad8c31f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:42.376318 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-cca294df-d9db-487c-a720-3b348ad8c31f None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:23:42.377714 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-cca294df-d9db-487c-a720-3b348ad8c31f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:23:42.443761 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 591/1155] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:23:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:23:42.467593 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157cfc09-0025-41c0-9975-6f859334cc87 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:42.510681 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:42.568937 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157cfc09-0025-41c0-9975-6f859334cc87 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:42.603095 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a79fa28-e347-4a2b-a904-8553fccf5039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:42.603805 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a79fa28-e347-4a2b-a904-8553fccf5039 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:42.604600 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a79fa28-e347-4a2b-a904-8553fccf5039 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:42.604884 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a79fa28-e347-4a2b-a904-8553fccf5039 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:42.615360 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a79fa28-e347-4a2b-a904-8553fccf5039 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:23:42.623507 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-7a79fa28-e347-4a2b-a904-8553fccf5039 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:23:42.623507 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:23:42.623507 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:23:42.623507 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:23:42.623507 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:23:42.623507 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:23:42.623507 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:23:42.623507 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:23:42.623507 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:23:42.623507 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:23:42.623507 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:23:42.623507 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:23:42.623507 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:23:42.623507 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:23:42.623507 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:23:42.623507 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:23:42.624447 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:23:42.624447 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:23:42.624447 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:23:42.624447 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:23:42.624447 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:23:42.624447 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:23:42.624447 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:23:42.624447 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:23:42.624447 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:23:42.624447 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:23:42.624447 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:23:42.624447 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:23:42.624447 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:23:42.624447 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:23:42.624447 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:23:42.624447 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:23:42.625362 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:23:42.625362 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:23:42.625362 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:23:42.625362 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:23:42.625362 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:23:42.625362 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:23:42.625362 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:23:42.625362 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:23:42.625362 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:23:42.625362 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:23:42.625362 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:23:42.625362 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:23:42.625362 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 565/1156] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Jul 1 19:23:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:23:42.630725 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca294df-d9db-487c-a720-3b348ad8c31f None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:42.733631 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca294df-d9db-487c-a720-3b348ad8c31f None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:42.760135 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:42.768102 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9220499-6898-4dc8-bee4-4b63afaf53c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:42.768765 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9220499-6898-4dc8-bee4-4b63afaf53c1 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:42.769127 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9220499-6898-4dc8-bee4-4b63afaf53c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:42.769470 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9220499-6898-4dc8-bee4-4b63afaf53c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:42.770248 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9220499-6898-4dc8-bee4-4b63afaf53c1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:23:42.770553 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9220499-6898-4dc8-bee4-4b63afaf53c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:42.771909 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9220499-6898-4dc8-bee4-4b63afaf53c1 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:42.779874 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 592/1157] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Jul 1 19:23:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:23:42.785828 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a79fa28-e347-4a2b-a904-8553fccf5039 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:42.888877 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:42.891955 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a79fa28-e347-4a2b-a904-8553fccf5039 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:42.926468 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446d267-eabc-4e6f-929d-7161fa3c9fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:42.927587 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446d267-eabc-4e6f-929d-7161fa3c9fea None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:42.927870 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446d267-eabc-4e6f-929d-7161fa3c9fea None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:42.928146 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446d267-eabc-4e6f-929d-7161fa3c9fea None admin] PATH_INFO: `/v3/users/7b448918afb54796ad8e713ffb2f6627` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:42.929354 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9446d267-eabc-4e6f-929d-7161fa3c9fea None admin] RBAC: Authorizing `identity:get_user(user_id=7b448918afb54796ad8e713ffb2f6627)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:42.930790 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9446d267-eabc-4e6f-929d-7161fa3c9fea None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:42.932438 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 566/1158] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Jul 1 19:23:42 2022] GET /identity/v3/users/7b448918afb54796ad8e713ffb2f6627 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:23:42.938381 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9220499-6898-4dc8-bee4-4b63afaf53c1 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:43.035244 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9220499-6898-4dc8-bee4-4b63afaf53c1 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:43.068000 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548e7256-215e-40ce-893c-7a6425b369f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:43.068638 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e7256-215e-40ce-893c-7a6425b369f0 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:43.068922 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e7256-215e-40ce-893c-7a6425b369f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:43.069199 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e7256-215e-40ce-893c-7a6425b369f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:43.124225 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:43.134993 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548e7256-215e-40ce-893c-7a6425b369f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:43.136483 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548e7256-215e-40ce-893c-7a6425b369f0 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:43.235554 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 593/1159] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Jul 1 19:23:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 01 19:23:43.241356 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446d267-eabc-4e6f-929d-7161fa3c9fea None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:43.340241 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446d267-eabc-4e6f-929d-7161fa3c9fea None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:43.373876 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b42252b-1bb3-4b86-9a82-fdd48846aa76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:43.374719 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b42252b-1bb3-4b86-9a82-fdd48846aa76 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:43.375006 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b42252b-1bb3-4b86-9a82-fdd48846aa76 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:43.375287 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b42252b-1bb3-4b86-9a82-fdd48846aa76 None admin] PATH_INFO: `/v3/projects/3bfd03d5bd1243948f83469633c2f2e2` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:43.376463 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b42252b-1bb3-4b86-9a82-fdd48846aa76 None admin] RBAC: Authorizing `identity:get_project(project_id=3bfd03d5bd1243948f83469633c2f2e2)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:43.377933 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b42252b-1bb3-4b86-9a82-fdd48846aa76 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:43.379611 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 567/1160] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Jul 1 19:23:43 2022] GET /identity/v3/projects/3bfd03d5bd1243948f83469633c2f2e2 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:23:43.386469 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548e7256-215e-40ce-893c-7a6425b369f0 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:43.474203 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:43.484200 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548e7256-215e-40ce-893c-7a6425b369f0 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:43.517709 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cc164a-6e8e-41b0-8375-705f4ca70a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:43.518286 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc164a-6e8e-41b0-8375-705f4ca70a0a None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:43.518571 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc164a-6e8e-41b0-8375-705f4ca70a0a None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:43.518848 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc164a-6e8e-41b0-8375-705f4ca70a0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:43.519669 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cc164a-6e8e-41b0-8375-705f4ca70a0a None admin] RBAC: Adding query filter params (role.id=6cb03785fb184ef587509b3174622f69, scope.project.id=3bfd03d5bd1243948f83469633c2f2e2, user.id=7b448918afb54796ad8e713ffb2f6627) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:23:43.519980 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cc164a-6e8e-41b0-8375-705f4ca70a0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:43.521412 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cc164a-6e8e-41b0-8375-705f4ca70a0a None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:43.527789 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 594/1161] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Jul 1 19:23:43 2022] GET /identity/v3/role_assignments?user.id=7b448918afb54796ad8e713ffb2f6627&scope.project.id=3bfd03d5bd1243948f83469633c2f2e2&role.id=6cb03785fb184ef587509b3174622f69 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:23:45.544905 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c7461-b838-4396-b80d-ea6d68b7c7ac None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:45.545511 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c7461-b838-4396-b80d-ea6d68b7c7ac None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:45.545511 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c7461-b838-4396-b80d-ea6d68b7c7ac None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:45.546851 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 568/1162] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:23:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:23:45.552160 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb912a-a506-4fa0-a10d-257ebe9d9acd None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:45.552589 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb912a-a506-4fa0-a10d-257ebe9d9acd None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:45.552711 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb912a-a506-4fa0-a10d-257ebe9d9acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:45.569742 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-47eb912a-a506-4fa0-a10d-257ebe9d9acd None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:23:45.570910 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-47eb912a-a506-4fa0-a10d-257ebe9d9acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:23:45.634620 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 595/1163] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:23:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:23:45.656756 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c7461-b838-4396-b80d-ea6d68b7c7ac None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:45.692567 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:45.759771 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c7461-b838-4396-b80d-ea6d68b7c7ac None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:45.792346 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b33340-e0f2-4035-b006-b0bab7ac0f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:45.792968 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b33340-e0f2-4035-b006-b0bab7ac0f7d None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:45.793267 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b33340-e0f2-4035-b006-b0bab7ac0f7d None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:45.793546 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b33340-e0f2-4035-b006-b0bab7ac0f7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:45.859786 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b33340-e0f2-4035-b006-b0bab7ac0f7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:45.861261 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b33340-e0f2-4035-b006-b0bab7ac0f7d None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:45.892597 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:45.955381 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 569/1164] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Jul 1 19:23:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 01 19:23:45.961247 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eb912a-a506-4fa0-a10d-257ebe9d9acd None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:46.043921 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:46.060288 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eb912a-a506-4fa0-a10d-257ebe9d9acd None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:46.093217 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4fc81e-51a3-4fc1-918a-f7875b744755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:46.094033 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4fc81e-51a3-4fc1-918a-f7875b744755 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:46.094323 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4fc81e-51a3-4fc1-918a-f7875b744755 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:46.094596 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4fc81e-51a3-4fc1-918a-f7875b744755 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:46.101082 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4fc81e-51a3-4fc1-918a-f7875b744755 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:46.102534 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4fc81e-51a3-4fc1-918a-f7875b744755 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:46.116806 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-bc4fc81e-51a3-4fc1-918a-f7875b744755 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 01 19:23:46.116806 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:23:46.116806 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 01 19:23:46.116806 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 01 19:23:46.116806 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 19:23:46.116806 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 19:23:46.116806 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 19:23:46.116806 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 19:23:46.116806 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 01 19:23:46.116806 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:23:46.116806 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 19:23:46.116806 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:23:46.116806 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:23:46.116806 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:23:46.116806 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:23:46.116806 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:23:46.116806 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:23:46.118240 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:23:46.118240 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:23:46.118240 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:23:46.118240 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:23:46.118240 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:23:46.118240 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:23:46.118240 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:23:46.118240 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:23:46.118240 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:23:46.118240 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:23:46.118240 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:23:46.118240 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:23:46.118240 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:23:46.118240 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:23:46.118240 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:23:46.118240 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:23:46.119290 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:23:46.119290 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:23:46.119290 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:23:46.119290 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:23:46.119290 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:23:46.119290 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:23:46.119290 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:23:46.119290 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:23:46.119290 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:23:46.119290 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:23:46.119290 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 01 19:23:46.119290 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:23:46.119290 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 01 19:23:46.119290 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:23:46.119290 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 596/1165] 10.222.0.26 () {56 vars in 1117 bytes} [Fri Jul 1 19:23:45 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:23:46.124332 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b33340-e0f2-4035-b006-b0bab7ac0f7d None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:46.221806 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b33340-e0f2-4035-b006-b0bab7ac0f7d None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:46.254905 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ba0566-89f1-4fb6-b673-bf6bb644a32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:46.255551 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba0566-89f1-4fb6-b673-bf6bb644a32a None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:46.255836 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba0566-89f1-4fb6-b673-bf6bb644a32a None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:46.256114 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba0566-89f1-4fb6-b673-bf6bb644a32a None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:46.256827 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ba0566-89f1-4fb6-b673-bf6bb644a32a None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:23:46.257135 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ba0566-89f1-4fb6-b673-bf6bb644a32a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:46.258540 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ba0566-89f1-4fb6-b673-bf6bb644a32a None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:46.261305 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:46.266864 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 570/1166] 10.222.0.26 () {56 vars in 1115 bytes} [Fri Jul 1 19:23:46 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:23:48.257433 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282113de-a516-4b33-aba2-90ab71141a7b None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:48.257992 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282113de-a516-4b33-aba2-90ab71141a7b None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:48.257992 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282113de-a516-4b33-aba2-90ab71141a7b None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:48.259404 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 597/1167] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:23:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:23:48.265176 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80803472-8070-4ec4-bc99-bfb2bc9a1fe0 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:48.265621 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80803472-8070-4ec4-bc99-bfb2bc9a1fe0 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:48.265775 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80803472-8070-4ec4-bc99-bfb2bc9a1fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:48.282008 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-80803472-8070-4ec4-bc99-bfb2bc9a1fe0 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:23:48.283187 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-80803472-8070-4ec4-bc99-bfb2bc9a1fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:23:48.348959 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 571/1168] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:23:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:23:48.372591 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282113de-a516-4b33-aba2-90ab71141a7b None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:48.471587 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282113de-a516-4b33-aba2-90ab71141a7b None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:48.503858 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0462fe44-a94a-4a50-a1b3-475fc0563b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:48.504495 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0462fe44-a94a-4a50-a1b3-475fc0563b7e None admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:48.504776 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0462fe44-a94a-4a50-a1b3-475fc0563b7e None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:48.505050 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0462fe44-a94a-4a50-a1b3-475fc0563b7e None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:48.505817 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0462fe44-a94a-4a50-a1b3-475fc0563b7e None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:48.507169 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0462fe44-a94a-4a50-a1b3-475fc0563b7e None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:48.521219 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 598/1169] 10.222.0.26 () {60 vars in 1138 bytes} [Fri Jul 1 19:23:48 2022] POST /identity/v3/domains => generated 267 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:23:50.567880 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d6729-dfa9-4659-b972-34afb8377416 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:50.568447 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d6729-dfa9-4659-b972-34afb8377416 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:50.568447 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d6729-dfa9-4659-b972-34afb8377416 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:50.569979 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 572/1170] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:23:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:23:50.575891 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab479d24-10ad-489f-9693-b06779d3a427 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:50.576317 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab479d24-10ad-489f-9693-b06779d3a427 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:50.576458 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab479d24-10ad-489f-9693-b06779d3a427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:50.582388 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:50.593584 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-ab479d24-10ad-489f-9693-b06779d3a427 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:23:50.594763 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-ab479d24-10ad-489f-9693-b06779d3a427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:23:50.659798 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 599/1171] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:23:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:23:50.684293 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474d6729-dfa9-4659-b972-34afb8377416 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:50.783824 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474d6729-dfa9-4659-b972-34afb8377416 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:50.812471 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:50.818652 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847e4534-2a84-4845-8d9a-376aeafaa963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:50.819438 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e4534-2a84-4845-8d9a-376aeafaa963 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:50.819718 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e4534-2a84-4845-8d9a-376aeafaa963 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:50.819990 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e4534-2a84-4845-8d9a-376aeafaa963 None admin] PATH_INFO: `/v3/domains/b2e3a9be84f9432f908a6a0a82e2ad60` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:50.830323 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847e4534-2a84-4845-8d9a-376aeafaa963 None admin] RBAC: Authorizing `identity:get_domain(domain_id=b2e3a9be84f9432f908a6a0a82e2ad60)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:50.831783 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847e4534-2a84-4845-8d9a-376aeafaa963 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:50.833479 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 573/1172] 10.222.0.26 () {56 vars in 1183 bytes} [Fri Jul 1 19:23:50 2022] GET /identity/v3/domains/b2e3a9be84f9432f908a6a0a82e2ad60 => generated 267 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:23:50.839852 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab479d24-10ad-489f-9693-b06779d3a427 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:50.936948 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab479d24-10ad-489f-9693-b06779d3a427 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:50.969545 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c40f06-18aa-4e9e-b147-883f13776402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:50.970201 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c40f06-18aa-4e9e-b147-883f13776402 None admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:50.970485 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c40f06-18aa-4e9e-b147-883f13776402 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:50.970766 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c40f06-18aa-4e9e-b147-883f13776402 None admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:50.971486 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c40f06-18aa-4e9e-b147-883f13776402 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:50.972912 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c40f06-18aa-4e9e-b147-883f13776402 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:50.976137 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:50.998367 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 600/1173] 10.222.0.26 () {60 vars in 1141 bytes} [Fri Jul 1 19:23:50 2022] POST /identity/v3/projects => generated 361 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:23:53.048203 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288bb79a-7b4b-429b-ae74-6f68d5f45eca None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:53.048739 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288bb79a-7b4b-429b-ae74-6f68d5f45eca None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:53.048739 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288bb79a-7b4b-429b-ae74-6f68d5f45eca None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:53.050077 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 574/1174] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:23:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:23:53.055471 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5442d8-3c46-4643-acad-f4fe04bef1cb None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:53.055904 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5442d8-3c46-4643-acad-f4fe04bef1cb None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:53.056039 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5442d8-3c46-4643-acad-f4fe04bef1cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:53.072998 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-7c5442d8-3c46-4643-acad-f4fe04bef1cb None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:23:53.074222 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-7c5442d8-3c46-4643-acad-f4fe04bef1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:23:53.138553 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 601/1175] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:23:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:23:53.164016 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288bb79a-7b4b-429b-ae74-6f68d5f45eca None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:53.264247 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288bb79a-7b4b-429b-ae74-6f68d5f45eca None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:53.296653 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd5f643-4087-4802-bee3-ca4aa6f6bbb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:53.297513 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd5f643-4087-4802-bee3-ca4aa6f6bbb5 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:53.297798 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd5f643-4087-4802-bee3-ca4aa6f6bbb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:53.298148 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd5f643-4087-4802-bee3-ca4aa6f6bbb5 None admin] PATH_INFO: `/v3/domains/b2e3a9be84f9432f908a6a0a82e2ad60` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:53.299479 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd5f643-4087-4802-bee3-ca4aa6f6bbb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=b2e3a9be84f9432f908a6a0a82e2ad60)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:53.300760 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd5f643-4087-4802-bee3-ca4aa6f6bbb5 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:53.302624 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 575/1176] 10.222.0.26 () {56 vars in 1183 bytes} [Fri Jul 1 19:23:53 2022] GET /identity/v3/domains/b2e3a9be84f9432f908a6a0a82e2ad60 => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:23:53.308884 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5442d8-3c46-4643-acad-f4fe04bef1cb None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:53.405255 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5442d8-3c46-4643-acad-f4fe04bef1cb None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:53.421436 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:53.440952 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175fb0e1-5ae9-4524-9280-bcd7eda29468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:53.441646 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175fb0e1-5ae9-4524-9280-bcd7eda29468 None admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:53.441936 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175fb0e1-5ae9-4524-9280-bcd7eda29468 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:53.442217 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175fb0e1-5ae9-4524-9280-bcd7eda29468 None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:53.442923 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175fb0e1-5ae9-4524-9280-bcd7eda29468 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:53.444347 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175fb0e1-5ae9-4524-9280-bcd7eda29468 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:53.465318 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 602/1177] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Jul 1 19:23:53 2022] POST /identity/v3/users => generated 311 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:23:55.514814 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5736b8f9-19b3-4914-8936-14ed2c870f8e None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:55.515395 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5736b8f9-19b3-4914-8936-14ed2c870f8e None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:55.515395 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5736b8f9-19b3-4914-8936-14ed2c870f8e None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:55.516744 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 576/1178] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:23:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:23:55.521963 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb35bf1-a4ea-4c76-a962-d206f3b23e97 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:55.522405 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb35bf1-a4ea-4c76-a962-d206f3b23e97 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:55.522537 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb35bf1-a4ea-4c76-a962-d206f3b23e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:55.539905 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-4eb35bf1-a4ea-4c76-a962-d206f3b23e97 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:23:55.541608 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-4eb35bf1-a4ea-4c76-a962-d206f3b23e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:23:55.606930 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 603/1179] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:23:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:23:55.630868 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5736b8f9-19b3-4914-8936-14ed2c870f8e None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:55.690033 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:55.733255 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5736b8f9-19b3-4914-8936-14ed2c870f8e None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:55.765473 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd886dd3-4670-45ca-bf3d-21d9ab0a82de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:55.766280 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd886dd3-4670-45ca-bf3d-21d9ab0a82de None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:55.766563 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd886dd3-4670-45ca-bf3d-21d9ab0a82de None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:55.766843 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd886dd3-4670-45ca-bf3d-21d9ab0a82de None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:55.777798 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd886dd3-4670-45ca-bf3d-21d9ab0a82de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:23:55.785300 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-fd886dd3-4670-45ca-bf3d-21d9ab0a82de None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:23:55.785300 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:23:55.785300 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:23:55.785300 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:23:55.785300 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:23:55.785300 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:23:55.785300 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:23:55.785300 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:23:55.785300 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:23:55.785300 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:23:55.785300 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:23:55.785300 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:23:55.785300 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:23:55.785300 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:23:55.785300 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:23:55.785300 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:23:55.786459 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:23:55.786459 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:23:55.786459 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:23:55.786459 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:23:55.786459 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:23:55.786459 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:23:55.786459 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:23:55.786459 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:23:55.786459 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:23:55.786459 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:23:55.786459 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:23:55.786459 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:23:55.786459 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:23:55.786459 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:23:55.786459 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:23:55.786459 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:23:55.787540 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:23:55.787540 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:23:55.787540 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:23:55.787540 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:23:55.787540 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:23:55.787540 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:23:55.787540 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:23:55.787540 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:23:55.787540 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:23:55.787540 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:23:55.787540 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:23:55.787540 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:23:55.787540 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 577/1180] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Jul 1 19:23:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:23:55.793067 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb35bf1-a4ea-4c76-a962-d206f3b23e97 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:55.888433 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb35bf1-a4ea-4c76-a962-d206f3b23e97 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:55.889951 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:55.924579 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd41ddd-b8fb-461b-8ae2-6e6e9ceea8b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:55.925271 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd41ddd-b8fb-461b-8ae2-6e6e9ceea8b0 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:55.925563 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd41ddd-b8fb-461b-8ae2-6e6e9ceea8b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:55.925844 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd41ddd-b8fb-461b-8ae2-6e6e9ceea8b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:55.926842 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd41ddd-b8fb-461b-8ae2-6e6e9ceea8b0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:23:55.927151 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd41ddd-b8fb-461b-8ae2-6e6e9ceea8b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:55.928515 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd41ddd-b8fb-461b-8ae2-6e6e9ceea8b0 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:55.936911 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 604/1181] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Jul 1 19:23:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:23:55.942716 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd886dd3-4670-45ca-bf3d-21d9ab0a82de None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:56.040112 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd886dd3-4670-45ca-bf3d-21d9ab0a82de None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:56.057200 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:56.074748 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee81bd67-f5fd-4f03-a477-a33fba5d12ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:56.075607 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81bd67-f5fd-4f03-a477-a33fba5d12ff None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:56.075888 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81bd67-f5fd-4f03-a477-a33fba5d12ff None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:56.076163 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81bd67-f5fd-4f03-a477-a33fba5d12ff None admin] PATH_INFO: `/v3/users/a5c63b2880374b9fb959c81bfa362889` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:56.089782 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee81bd67-f5fd-4f03-a477-a33fba5d12ff None admin] RBAC: Authorizing `identity:get_user(user_id=a5c63b2880374b9fb959c81bfa362889)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:56.091229 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee81bd67-f5fd-4f03-a477-a33fba5d12ff None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:56.092861 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 578/1182] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Jul 1 19:23:55 2022] GET /identity/v3/users/a5c63b2880374b9fb959c81bfa362889 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:23:56.098638 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd41ddd-b8fb-461b-8ae2-6e6e9ceea8b0 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:56.194783 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd41ddd-b8fb-461b-8ae2-6e6e9ceea8b0 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:56.227643 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc5a9b1-9054-46e3-abf1-99d576ba4c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:56.228275 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc5a9b1-9054-46e3-abf1-99d576ba4c77 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:56.228579 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc5a9b1-9054-46e3-abf1-99d576ba4c77 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:56.228856 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc5a9b1-9054-46e3-abf1-99d576ba4c77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:56.257533 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:56.295896 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc5a9b1-9054-46e3-abf1-99d576ba4c77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:56.297300 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc5a9b1-9054-46e3-abf1-99d576ba4c77 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:56.393325 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 605/1183] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Jul 1 19:23:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 01 19:23:56.399234 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee81bd67-f5fd-4f03-a477-a33fba5d12ff None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:56.495677 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee81bd67-f5fd-4f03-a477-a33fba5d12ff None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:56.528693 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecdb0e8-90dc-46f6-9e04-3273d2765151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:56.529560 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecdb0e8-90dc-46f6-9e04-3273d2765151 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:56.529839 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecdb0e8-90dc-46f6-9e04-3273d2765151 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:56.530113 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecdb0e8-90dc-46f6-9e04-3273d2765151 None admin] PATH_INFO: `/v3/projects/e92598d5e3f34cfe9049f39d0e9c4a71` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:56.531281 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecdb0e8-90dc-46f6-9e04-3273d2765151 None admin] RBAC: Authorizing `identity:get_project(project_id=e92598d5e3f34cfe9049f39d0e9c4a71)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:56.532707 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecdb0e8-90dc-46f6-9e04-3273d2765151 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:56.534484 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 579/1184] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Jul 1 19:23:56 2022] GET /identity/v3/projects/e92598d5e3f34cfe9049f39d0e9c4a71 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:23:56.540655 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc5a9b1-9054-46e3-abf1-99d576ba4c77 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:56.601991 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:56.639430 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc5a9b1-9054-46e3-abf1-99d576ba4c77 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:56.672475 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23791c3-6e52-4025-beed-9035f34c797f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:56.673115 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23791c3-6e52-4025-beed-9035f34c797f None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:56.673432 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23791c3-6e52-4025-beed-9035f34c797f None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:56.673716 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23791c3-6e52-4025-beed-9035f34c797f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:56.674546 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23791c3-6e52-4025-beed-9035f34c797f None admin] RBAC: Adding query filter params (role.id=6cb03785fb184ef587509b3174622f69, scope.project.id=e92598d5e3f34cfe9049f39d0e9c4a71, user.id=a5c63b2880374b9fb959c81bfa362889) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:23:56.674862 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23791c3-6e52-4025-beed-9035f34c797f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:56.676281 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23791c3-6e52-4025-beed-9035f34c797f None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:56.682467 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 606/1185] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Jul 1 19:23:56 2022] GET /identity/v3/role_assignments?user.id=a5c63b2880374b9fb959c81bfa362889&scope.project.id=e92598d5e3f34cfe9049f39d0e9c4a71&role.id=6cb03785fb184ef587509b3174622f69 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:23:58.703265 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69dda2-3d17-4204-aa88-a9addc570226 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:58.703775 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69dda2-3d17-4204-aa88-a9addc570226 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:58.703867 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69dda2-3d17-4204-aa88-a9addc570226 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:58.705313 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 580/1186] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:23:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:23:58.710567 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a54c49-7fe2-4a68-a726-5b0ba349bd91 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:58.711008 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a54c49-7fe2-4a68-a726-5b0ba349bd91 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:58.711104 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a54c49-7fe2-4a68-a726-5b0ba349bd91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:58.728230 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-a5a54c49-7fe2-4a68-a726-5b0ba349bd91 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:23:58.730097 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-a5a54c49-7fe2-4a68-a726-5b0ba349bd91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:23:58.794409 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 607/1187] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:23:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:23:58.819385 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a69dda2-3d17-4204-aa88-a9addc570226 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:58.865915 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:58.919481 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a69dda2-3d17-4204-aa88-a9addc570226 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:58.954103 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211c4023-51f8-4efb-b8be-0e154e7d44ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:58.954883 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c4023-51f8-4efb-b8be-0e154e7d44ee None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:58.955169 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c4023-51f8-4efb-b8be-0e154e7d44ee None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:58.955444 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c4023-51f8-4efb-b8be-0e154e7d44ee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:58.965980 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211c4023-51f8-4efb-b8be-0e154e7d44ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:23:58.973409 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-211c4023-51f8-4efb-b8be-0e154e7d44ee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:23:58.973409 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:23:58.973409 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:23:58.973409 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:23:58.973409 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:23:58.973409 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:23:58.973409 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:23:58.973409 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:23:58.973409 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:23:58.973409 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:23:58.973409 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:23:58.973409 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:23:58.973409 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:23:58.973409 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:23:58.973409 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:23:58.973409 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:23:58.974627 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:23:58.974627 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:23:58.974627 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:23:58.974627 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:23:58.974627 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:23:58.974627 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:23:58.974627 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:23:58.974627 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:23:58.974627 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:23:58.974627 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:23:58.974627 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:23:58.974627 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:23:58.974627 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:23:58.974627 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:23:58.974627 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:23:58.974627 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:23:58.975907 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:23:58.975907 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:23:58.975907 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:23:58.975907 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:23:58.975907 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:23:58.975907 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:23:58.975907 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:23:58.975907 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:23:58.975907 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:23:58.975907 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:23:58.975907 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:23:58.975907 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:23:58.975907 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 581/1188] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Jul 1 19:23:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:23:58.980788 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a54c49-7fe2-4a68-a726-5b0ba349bd91 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:59.037426 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:59.078541 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a54c49-7fe2-4a68-a726-5b0ba349bd91 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:59.112127 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58244700-938d-4c10-bc1b-76935b608839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:59.112787 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58244700-938d-4c10-bc1b-76935b608839 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:59.113073 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58244700-938d-4c10-bc1b-76935b608839 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:59.113384 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58244700-938d-4c10-bc1b-76935b608839 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:59.114133 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58244700-938d-4c10-bc1b-76935b608839 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:23:59.114444 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58244700-938d-4c10-bc1b-76935b608839 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:59.115847 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58244700-938d-4c10-bc1b-76935b608839 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:59.124136 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 608/1189] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Jul 1 19:23:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:23:59.130039 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211c4023-51f8-4efb-b8be-0e154e7d44ee None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:59.228593 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211c4023-51f8-4efb-b8be-0e154e7d44ee None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:59.230809 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:59.262406 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f32dce-4081-4d96-a848-e2489e3b974f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:59.263252 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f32dce-4081-4d96-a848-e2489e3b974f None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:59.263531 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f32dce-4081-4d96-a848-e2489e3b974f None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:59.263806 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f32dce-4081-4d96-a848-e2489e3b974f None admin] PATH_INFO: `/v3/users/a5c63b2880374b9fb959c81bfa362889` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:59.264980 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f32dce-4081-4d96-a848-e2489e3b974f None admin] RBAC: Authorizing `identity:get_user(user_id=a5c63b2880374b9fb959c81bfa362889)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:59.266436 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f32dce-4081-4d96-a848-e2489e3b974f None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:59.268033 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 582/1190] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Jul 1 19:23:59 2022] GET /identity/v3/users/a5c63b2880374b9fb959c81bfa362889 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:23:59.274024 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58244700-938d-4c10-bc1b-76935b608839 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:59.372777 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58244700-938d-4c10-bc1b-76935b608839 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:59.392276 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:23:59.407126 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f06ad0a-deeb-4141-aa65-8ffaa3dc3100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:59.408001 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f06ad0a-deeb-4141-aa65-8ffaa3dc3100 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:59.408284 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f06ad0a-deeb-4141-aa65-8ffaa3dc3100 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:59.408558 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f06ad0a-deeb-4141-aa65-8ffaa3dc3100 None admin] PATH_INFO: `/v3/projects/e92598d5e3f34cfe9049f39d0e9c4a71` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:59.409745 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f06ad0a-deeb-4141-aa65-8ffaa3dc3100 None admin] RBAC: Authorizing `identity:get_project(project_id=e92598d5e3f34cfe9049f39d0e9c4a71)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:59.411166 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f06ad0a-deeb-4141-aa65-8ffaa3dc3100 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:59.412849 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 609/1191] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Jul 1 19:23:59 2022] GET /identity/v3/projects/e92598d5e3f34cfe9049f39d0e9c4a71 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:23:59.418846 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f32dce-4081-4d96-a848-e2489e3b974f None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:23:59.517115 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f32dce-4081-4d96-a848-e2489e3b974f None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:23:59.549218 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb8a3c6-7aad-488a-8ad5-288ac5d50f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:23:59.550196 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8a3c6-7aad-488a-8ad5-288ac5d50f88 None admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:23:59.550484 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8a3c6-7aad-488a-8ad5-288ac5d50f88 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:23:59.550764 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8a3c6-7aad-488a-8ad5-288ac5d50f88 None admin] PATH_INFO: `/v3/projects/e92598d5e3f34cfe9049f39d0e9c4a71/users/a5c63b2880374b9fb959c81bfa362889/roles/6cb03785fb184ef587509b3174622f69` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:23:59.553004 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb8a3c6-7aad-488a-8ad5-288ac5d50f88 None admin] RBAC: Authorizing `identity:create_grant(project_id=e92598d5e3f34cfe9049f39d0e9c4a71, user_id=a5c63b2880374b9fb959c81bfa362889, role_id=6cb03785fb184ef587509b3174622f69)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:23:59.554517 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb8a3c6-7aad-488a-8ad5-288ac5d50f88 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:23:59.567461 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 583/1192] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Jul 1 19:23:59 2022] PUT /identity/v3/projects/e92598d5e3f34cfe9049f39d0e9c4a71/users/a5c63b2880374b9fb959c81bfa362889/roles/6cb03785fb184ef587509b3174622f69 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:24:01.570407 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f9944-4857-4b1d-b867-4c4bb9afa09f None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:01.570965 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f9944-4857-4b1d-b867-4c4bb9afa09f None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:01.570965 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f9944-4857-4b1d-b867-4c4bb9afa09f None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:01.572352 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 610/1193] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:24:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:24:01.577612 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753cf4ac-9899-4aa2-a9ed-e28772c48241 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:01.578033 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753cf4ac-9899-4aa2-a9ed-e28772c48241 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:01.578181 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753cf4ac-9899-4aa2-a9ed-e28772c48241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:01.595243 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-753cf4ac-9899-4aa2-a9ed-e28772c48241 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:24:01.596425 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-753cf4ac-9899-4aa2-a9ed-e28772c48241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:24:01.622422 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:01.664850 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 584/1194] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:24:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:24:01.688671 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65f9944-4857-4b1d-b867-4c4bb9afa09f None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:01.787792 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65f9944-4857-4b1d-b867-4c4bb9afa09f None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:01.820718 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8911d7-0fc3-4445-955d-c5d167db377d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:01.821459 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8911d7-0fc3-4445-955d-c5d167db377d None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:01.821743 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8911d7-0fc3-4445-955d-c5d167db377d None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:01.822018 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8911d7-0fc3-4445-955d-c5d167db377d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:01.832742 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8911d7-0fc3-4445-955d-c5d167db377d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:24:01.840130 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-0d8911d7-0fc3-4445-955d-c5d167db377d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:24:01.840130 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:24:01.840130 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:24:01.840130 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:24:01.840130 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:24:01.840130 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:24:01.840130 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:24:01.840130 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:24:01.840130 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:24:01.840130 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:24:01.840130 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:24:01.840130 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:24:01.840130 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:24:01.840130 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:24:01.840130 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:24:01.840130 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:24:01.841286 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:24:01.841286 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:24:01.841286 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:24:01.841286 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:24:01.841286 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:24:01.841286 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:24:01.841286 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:24:01.841286 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:24:01.841286 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:24:01.841286 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:24:01.841286 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:24:01.841286 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:24:01.841286 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:24:01.841286 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:24:01.841286 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:24:01.841286 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:24:01.842405 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:24:01.842405 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:24:01.842405 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:24:01.842405 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:24:01.842405 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:24:01.842405 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:24:01.842405 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:24:01.842405 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:24:01.842405 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:24:01.842405 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:24:01.842405 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:24:01.842405 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:24:01.842405 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 611/1195] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Jul 1 19:24:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:24:01.847399 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753cf4ac-9899-4aa2-a9ed-e28772c48241 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:01.941506 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753cf4ac-9899-4aa2-a9ed-e28772c48241 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:01.974740 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f0af35-91a6-4433-826b-e6b6e83092b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:01.975392 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f0af35-91a6-4433-826b-e6b6e83092b4 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:01.975673 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f0af35-91a6-4433-826b-e6b6e83092b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:01.975947 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f0af35-91a6-4433-826b-e6b6e83092b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:01.976675 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f0af35-91a6-4433-826b-e6b6e83092b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:24:01.976980 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f0af35-91a6-4433-826b-e6b6e83092b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:01.978895 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f0af35-91a6-4433-826b-e6b6e83092b4 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:01.986882 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 585/1196] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Jul 1 19:24:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:01.992583 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8911d7-0fc3-4445-955d-c5d167db377d None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:02.040039 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:02.089478 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8911d7-0fc3-4445-955d-c5d167db377d None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:02.123611 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95cf1d7-3757-444f-aa82-7603ae25f131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:02.124460 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95cf1d7-3757-444f-aa82-7603ae25f131 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:02.124744 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95cf1d7-3757-444f-aa82-7603ae25f131 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:02.125022 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95cf1d7-3757-444f-aa82-7603ae25f131 None admin] PATH_INFO: `/v3/users/a5c63b2880374b9fb959c81bfa362889` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:02.126229 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95cf1d7-3757-444f-aa82-7603ae25f131 None admin] RBAC: Authorizing `identity:get_user(user_id=a5c63b2880374b9fb959c81bfa362889)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:02.127641 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95cf1d7-3757-444f-aa82-7603ae25f131 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:02.129277 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 612/1197] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Jul 1 19:24:01 2022] GET /identity/v3/users/a5c63b2880374b9fb959c81bfa362889 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:02.134936 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f0af35-91a6-4433-826b-e6b6e83092b4 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:02.159508 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:02.231827 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f0af35-91a6-4433-826b-e6b6e83092b4 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:02.265129 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c3c2b-024d-49a8-b02b-7ec5faf0510f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:02.265788 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c3c2b-024d-49a8-b02b-7ec5faf0510f None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:02.266068 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c3c2b-024d-49a8-b02b-7ec5faf0510f None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:02.266342 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c3c2b-024d-49a8-b02b-7ec5faf0510f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:02.331688 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138c3c2b-024d-49a8-b02b-7ec5faf0510f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:02.333130 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138c3c2b-024d-49a8-b02b-7ec5faf0510f None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:02.356826 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:02.428815 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 586/1198] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Jul 1 19:24:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 01 19:24:02.434795 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95cf1d7-3757-444f-aa82-7603ae25f131 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:02.531674 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95cf1d7-3757-444f-aa82-7603ae25f131 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:02.547782 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:02.565439 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab01a3-f0eb-4dfa-8829-2f90a9a767b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:02.566275 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab01a3-f0eb-4dfa-8829-2f90a9a767b3 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:02.566555 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab01a3-f0eb-4dfa-8829-2f90a9a767b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:02.566830 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab01a3-f0eb-4dfa-8829-2f90a9a767b3 None admin] PATH_INFO: `/v3/projects/e92598d5e3f34cfe9049f39d0e9c4a71` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:02.567989 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbab01a3-f0eb-4dfa-8829-2f90a9a767b3 None admin] RBAC: Authorizing `identity:get_project(project_id=e92598d5e3f34cfe9049f39d0e9c4a71)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:02.569448 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbab01a3-f0eb-4dfa-8829-2f90a9a767b3 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:02.571116 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 613/1199] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Jul 1 19:24:02 2022] GET /identity/v3/projects/e92598d5e3f34cfe9049f39d0e9c4a71 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:02.577628 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c3c2b-024d-49a8-b02b-7ec5faf0510f None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:02.688474 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c3c2b-024d-49a8-b02b-7ec5faf0510f None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:02.712802 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:02.724186 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab71fdd9-3d40-4d18-886c-a3413fad2d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:02.724839 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71fdd9-3d40-4d18-886c-a3413fad2d28 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:02.725127 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71fdd9-3d40-4d18-886c-a3413fad2d28 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:02.725433 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71fdd9-3d40-4d18-886c-a3413fad2d28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:02.726259 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab71fdd9-3d40-4d18-886c-a3413fad2d28 None admin] RBAC: Adding query filter params (role.id=6cb03785fb184ef587509b3174622f69, scope.project.id=e92598d5e3f34cfe9049f39d0e9c4a71, user.id=a5c63b2880374b9fb959c81bfa362889) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:24:02.726574 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab71fdd9-3d40-4d18-886c-a3413fad2d28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:02.728049 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab71fdd9-3d40-4d18-886c-a3413fad2d28 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:02.734100 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 587/1200] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Jul 1 19:24:02 2022] GET /identity/v3/role_assignments?user.id=a5c63b2880374b9fb959c81bfa362889&scope.project.id=e92598d5e3f34cfe9049f39d0e9c4a71&role.id=6cb03785fb184ef587509b3174622f69 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:12.561228 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=8 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:12.731453 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=6 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:57.938777 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d06545-802e-4c14-8a18-c9784fa88317 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:57.939485 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d06545-802e-4c14-8a18-c9784fa88317 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:57.939485 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d06545-802e-4c14-8a18-c9784fa88317 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:57.940695 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 614/1201] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:24:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:24:57.946614 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81452d-92f1-4e1b-96a1-85ad460a0d70 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:57.947600 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81452d-92f1-4e1b-96a1-85ad460a0d70 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:57.947688 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81452d-92f1-4e1b-96a1-85ad460a0d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:57.967929 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-0d81452d-92f1-4e1b-96a1-85ad460a0d70 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:24:57.969146 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-0d81452d-92f1-4e1b-96a1-85ad460a0d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:24:58.064497 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 588/1202] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:24:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 01 19:24:58.093103 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d06545-802e-4c14-8a18-c9784fa88317 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:58.231950 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d06545-802e-4c14-8a18-c9784fa88317 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:58.281658 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81de75fa-9a4b-499b-8432-775cf255bd4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:58.282496 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de75fa-9a4b-499b-8432-775cf255bd4f None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:58.282779 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de75fa-9a4b-499b-8432-775cf255bd4f None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:58.283102 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de75fa-9a4b-499b-8432-775cf255bd4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:58.297799 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81de75fa-9a4b-499b-8432-775cf255bd4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:58.299421 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81de75fa-9a4b-499b-8432-775cf255bd4f None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:58.320610 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-81de75fa-9a4b-499b-8432-775cf255bd4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:24:58.320610 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:24:58.320610 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:24:58.320610 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:24:58.320610 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:24:58.320610 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:24:58.320610 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:24:58.320610 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:24:58.320610 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:24:58.320610 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:24:58.320610 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:24:58.320610 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:24:58.320610 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:24:58.320610 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:24:58.320610 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:24:58.322008 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:24:58.322008 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:24:58.322008 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:24:58.322008 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:24:58.322008 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:24:58.322008 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:24:58.322008 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:24:58.322008 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:24:58.322008 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:24:58.322008 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:24:58.322008 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:24:58.322008 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:24:58.322008 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:24:58.322008 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:24:58.322008 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:24:58.322008 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:24:58.322008 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:24:58.323544 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:24:58.323544 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:24:58.323544 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:24:58.323544 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:24:58.323544 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 615/1203] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:24:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:24:58.328952 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d81452d-92f1-4e1b-96a1-85ad460a0d70 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:58.459502 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d81452d-92f1-4e1b-96a1-85ad460a0d70 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:58.496428 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:58.506721 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7e223c-9e70-4571-967d-26b8d9420f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:58.507414 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e223c-9e70-4571-967d-26b8d9420f37 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:58.507703 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e223c-9e70-4571-967d-26b8d9420f37 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:58.507981 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e223c-9e70-4571-967d-26b8d9420f37 None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:58.508747 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7e223c-9e70-4571-967d-26b8d9420f37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:24:58.509086 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7e223c-9e70-4571-967d-26b8d9420f37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:58.515841 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7e223c-9e70-4571-967d-26b8d9420f37 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:58.533274 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 589/1204] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Jul 1 19:24:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:58.537366 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81de75fa-9a4b-499b-8432-775cf255bd4f None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:58.608637 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:58.663714 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81de75fa-9a4b-499b-8432-775cf255bd4f None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:58.708674 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff168de-9fe2-41f3-a3c1-b5a43de12bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:58.709475 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff168de-9fe2-41f3-a3c1-b5a43de12bc3 None admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:58.709749 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff168de-9fe2-41f3-a3c1-b5a43de12bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:58.710035 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff168de-9fe2-41f3-a3c1-b5a43de12bc3 None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:58.710831 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff168de-9fe2-41f3-a3c1-b5a43de12bc3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:58.712280 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff168de-9fe2-41f3-a3c1-b5a43de12bc3 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:58.741480 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 616/1205] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Jul 1 19:24:58 2022] POST /identity/v3/users => generated 251 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:25:01.067845 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6422f4-d98f-4418-ba7a-fcc27a98078c None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:01.068413 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6422f4-d98f-4418-ba7a-fcc27a98078c None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:01.068507 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6422f4-d98f-4418-ba7a-fcc27a98078c None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:01.069953 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 590/1206] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:25:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:25:01.078000 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7268be4-82ca-4580-a5fb-20c0ea98496f None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:01.078000 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7268be4-82ca-4580-a5fb-20c0ea98496f None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:01.078000 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7268be4-82ca-4580-a5fb-20c0ea98496f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:01.096029 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-a7268be4-82ca-4580-a5fb-20c0ea98496f None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:25:01.097371 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-a7268be4-82ca-4580-a5fb-20c0ea98496f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:25:01.181358 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 617/1207] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:25:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 01 19:25:01.201607 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6422f4-d98f-4418-ba7a-fcc27a98078c None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:01.320456 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6422f4-d98f-4418-ba7a-fcc27a98078c None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:01.368123 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95705fd7-c1d7-4b99-9c56-bac9c73535fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:01.369097 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95705fd7-c1d7-4b99-9c56-bac9c73535fd None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:01.369442 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95705fd7-c1d7-4b99-9c56-bac9c73535fd None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:01.369759 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95705fd7-c1d7-4b99-9c56-bac9c73535fd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:01.383819 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95705fd7-c1d7-4b99-9c56-bac9c73535fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:25:01.392394 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-95705fd7-c1d7-4b99-9c56-bac9c73535fd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:25:01.392394 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:01.392394 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:01.392394 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:01.392394 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:01.392394 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:01.392394 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:01.392394 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:01.392394 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:01.392394 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:01.392394 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:01.392394 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:01.392394 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:25:01.392394 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:25:01.392394 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:25:01.392394 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:25:01.393517 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:25:01.393517 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:25:01.393517 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:25:01.393517 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:25:01.393517 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:01.393517 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:01.393517 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:01.393517 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:01.393517 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:01.393517 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:01.393517 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:01.393517 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:01.393517 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:01.393517 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:01.393517 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:01.393517 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:01.394378 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:01.394378 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:01.394378 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:01.394378 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:01.394378 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:25:01.394378 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:25:01.394378 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:25:01.394378 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:25:01.394378 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:25:01.394378 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:25:01.394378 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:25:01.394378 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:25:01.394378 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 591/1208] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Jul 1 19:25:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:01.399942 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7268be4-82ca-4580-a5fb-20c0ea98496f None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:01.448905 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:01.530193 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7268be4-82ca-4580-a5fb-20c0ea98496f None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:01.578423 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90e0751-930e-4cd1-918a-a726bf78ace9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:01.579102 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e0751-930e-4cd1-918a-a726bf78ace9 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:01.579426 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e0751-930e-4cd1-918a-a726bf78ace9 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:01.579783 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e0751-930e-4cd1-918a-a726bf78ace9 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:01.580588 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90e0751-930e-4cd1-918a-a726bf78ace9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:01.580966 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90e0751-930e-4cd1-918a-a726bf78ace9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:01.582577 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90e0751-930e-4cd1-918a-a726bf78ace9 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:01.592703 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 618/1209] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Jul 1 19:25:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:01.598393 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95705fd7-c1d7-4b99-9c56-bac9c73535fd None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:01.666815 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:01.725525 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95705fd7-c1d7-4b99-9c56-bac9c73535fd None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:01.762819 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a382137-12d5-42c0-b936-0b88efe7878e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:01.763669 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a382137-12d5-42c0-b936-0b88efe7878e None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:01.763961 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a382137-12d5-42c0-b936-0b88efe7878e None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:01.764269 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a382137-12d5-42c0-b936-0b88efe7878e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:01.776756 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a382137-12d5-42c0-b936-0b88efe7878e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:01.778326 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a382137-12d5-42c0-b936-0b88efe7878e None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:01.799472 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-7a382137-12d5-42c0-b936-0b88efe7878e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:01.799472 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:01.799472 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:01.799472 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:01.799472 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:01.799472 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:01.799472 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:01.799472 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:01.799472 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:01.799472 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:01.799472 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:01.799472 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:01.799472 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:25:01.799472 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:25:01.799472 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:25:01.800903 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:25:01.800903 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:01.800903 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:01.800903 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:01.800903 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:01.800903 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:01.800903 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:01.800903 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:01.800903 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:01.800903 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:01.800903 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:01.800903 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:01.800903 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:01.800903 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:01.800903 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:01.800903 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:01.800903 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:01.802359 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:25:01.802359 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:25:01.802359 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:01.802359 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:25:01.802359 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 592/1210] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:25:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:25:01.807160 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90e0751-930e-4cd1-918a-a726bf78ace9 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:01.923543 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:01.927237 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90e0751-930e-4cd1-918a-a726bf78ace9 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:01.966791 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51799e8-e4a5-4c74-82ad-ef9a81cbd9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:01.967530 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51799e8-e4a5-4c74-82ad-ef9a81cbd9da None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:01.967881 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51799e8-e4a5-4c74-82ad-ef9a81cbd9da None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:01.968216 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51799e8-e4a5-4c74-82ad-ef9a81cbd9da None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:01.969044 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51799e8-e4a5-4c74-82ad-ef9a81cbd9da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:01.969415 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51799e8-e4a5-4c74-82ad-ef9a81cbd9da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:01.970854 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51799e8-e4a5-4c74-82ad-ef9a81cbd9da None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:01.986437 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 619/1211] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Jul 1 19:25:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:01.992204 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a382137-12d5-42c0-b936-0b88efe7878e None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:02.112755 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a382137-12d5-42c0-b936-0b88efe7878e None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:02.114601 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:02.160145 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a4297-203f-4ed2-83f7-7f77318a5a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:02.161820 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a4297-203f-4ed2-83f7-7f77318a5a57 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:02.161820 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a4297-203f-4ed2-83f7-7f77318a5a57 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:02.162300 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a4297-203f-4ed2-83f7-7f77318a5a57 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:02.170717 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877a4297-203f-4ed2-83f7-7f77318a5a57 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:02.172429 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877a4297-203f-4ed2-83f7-7f77318a5a57 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:02.189709 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-877a4297-203f-4ed2-83f7-7f77318a5a57 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 01 19:25:02.189709 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:02.189709 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:02.189709 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:02.189709 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:02.189709 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:02.189709 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:02.189709 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:02.189709 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:02.189709 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:02.189709 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:02.189709 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:02.189709 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 19:25:02.189709 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 19:25:02.189709 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 19:25:02.189709 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 19:25:02.191035 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:02.191035 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:02.191035 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 19:25:02.191035 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:25:02.191035 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 19:25:02.191035 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:25:02.191035 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:02.191035 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:02.191035 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:02.191035 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:02.191035 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:02.191035 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:02.191035 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:02.191035 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:02.191035 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:02.191035 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:02.191035 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:02.191035 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:02.192012 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:02.192012 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:02.192012 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 19:25:02.192012 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 19:25:02.192012 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 19:25:02.192012 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 19:25:02.192012 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 19:25:02.192012 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 19:25:02.192012 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 01 19:25:02.192012 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:25:02.192012 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 593/1212] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:25:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:02.197788 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51799e8-e4a5-4c74-82ad-ef9a81cbd9da None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:02.322414 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51799e8-e4a5-4c74-82ad-ef9a81cbd9da None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:02.364614 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31800b7-5b01-4357-a1d3-4e61f44da526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:02.365371 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31800b7-5b01-4357-a1d3-4e61f44da526 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:02.365689 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31800b7-5b01-4357-a1d3-4e61f44da526 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:02.365975 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31800b7-5b01-4357-a1d3-4e61f44da526 None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:02.366912 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31800b7-5b01-4357-a1d3-4e61f44da526 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:02.367262 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31800b7-5b01-4357-a1d3-4e61f44da526 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:02.369429 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31800b7-5b01-4357-a1d3-4e61f44da526 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:02.392341 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 620/1213] 10.222.0.26 () {56 vars in 1143 bytes} [Fri Jul 1 19:25:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:02.398533 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a4297-203f-4ed2-83f7-7f77318a5a57 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:02.521175 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a4297-203f-4ed2-83f7-7f77318a5a57 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:02.562662 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435154fd-b25f-4cb5-bf73-e9b4dc58510a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:02.563482 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435154fd-b25f-4cb5-bf73-e9b4dc58510a None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:02.563897 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435154fd-b25f-4cb5-bf73-e9b4dc58510a None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:02.564335 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435154fd-b25f-4cb5-bf73-e9b4dc58510a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:02.609112 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:02.656046 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435154fd-b25f-4cb5-bf73-e9b4dc58510a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:02.658206 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435154fd-b25f-4cb5-bf73-e9b4dc58510a None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:02.778131 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 594/1214] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Jul 1 19:25:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 01 19:25:02.783776 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31800b7-5b01-4357-a1d3-4e61f44da526 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:02.807209 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:02.941448 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31800b7-5b01-4357-a1d3-4e61f44da526 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:02.995284 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a329f5-7c62-4fe6-ac95-cb207cff02a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:02.996787 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a329f5-7c62-4fe6-ac95-cb207cff02a6 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:02.996787 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a329f5-7c62-4fe6-ac95-cb207cff02a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:02.996787 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a329f5-7c62-4fe6-ac95-cb207cff02a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:03.009910 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a329f5-7c62-4fe6-ac95-cb207cff02a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:03.011887 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a329f5-7c62-4fe6-ac95-cb207cff02a6 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:03.037225 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-68a329f5-7c62-4fe6-ac95-cb207cff02a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:03.037225 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:03.037225 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:03.037225 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:03.037225 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:03.037225 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:03.037225 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:03.037225 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:03.037225 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:03.037225 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:03.037225 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:03.037225 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:03.037225 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:25:03.037225 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:25:03.037225 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:25:03.038218 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:25:03.038218 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:03.038218 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:03.038218 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:03.038218 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:03.038218 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:03.038218 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:03.038218 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:03.038218 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:03.038218 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:03.038218 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:03.038218 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:03.038218 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:03.038218 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:03.038218 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:03.038218 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:03.038218 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:03.039159 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:25:03.039159 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:25:03.039159 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:03.039159 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:25:03.039159 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 621/1215] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:25:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:25:03.047511 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435154fd-b25f-4cb5-bf73-e9b4dc58510a None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:03.134787 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:03.187995 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435154fd-b25f-4cb5-bf73-e9b4dc58510a None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:03.227164 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fd7569-8ad3-4545-8b03-54154c0c9382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:03.227782 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd7569-8ad3-4545-8b03-54154c0c9382 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:03.228099 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd7569-8ad3-4545-8b03-54154c0c9382 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:03.228390 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd7569-8ad3-4545-8b03-54154c0c9382 None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:03.229099 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fd7569-8ad3-4545-8b03-54154c0c9382 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:03.229458 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fd7569-8ad3-4545-8b03-54154c0c9382 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:03.230839 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fd7569-8ad3-4545-8b03-54154c0c9382 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:03.248921 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 595/1216] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Jul 1 19:25:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:03.250653 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a329f5-7c62-4fe6-ac95-cb207cff02a6 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:03.366869 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:03.413117 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a329f5-7c62-4fe6-ac95-cb207cff02a6 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:03.455604 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8679c381-b207-44f0-a9d8-f249fc809be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:03.456197 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679c381-b207-44f0-a9d8-f249fc809be8 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:03.456627 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679c381-b207-44f0-a9d8-f249fc809be8 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:03.457008 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679c381-b207-44f0-a9d8-f249fc809be8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:03.465106 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8679c381-b207-44f0-a9d8-f249fc809be8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:03.466696 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8679c381-b207-44f0-a9d8-f249fc809be8 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:03.481712 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-8679c381-b207-44f0-a9d8-f249fc809be8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:25:03.481712 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:03.481712 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:03.481712 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:03.481712 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:03.481712 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:03.481712 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:03.481712 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:03.481712 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:03.481712 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:03.481712 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:03.481712 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:03.481712 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 19:25:03.481712 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 19:25:03.481712 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 19:25:03.482906 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 19:25:03.482906 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:03.482906 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:03.482906 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:03.482906 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:03.482906 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:03.482906 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:03.482906 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:03.482906 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:03.482906 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:03.482906 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:03.482906 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:03.482906 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:03.482906 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:03.482906 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:03.482906 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:03.482906 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:03.484131 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 19:25:03.484131 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 19:25:03.484131 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 19:25:03.484131 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 19:25:03.484131 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 19:25:03.484131 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 19:25:03.484131 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:25:03.484131 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:25:03.490321 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 622/1217] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Jul 1 19:25:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:03.490454 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fd7569-8ad3-4545-8b03-54154c0c9382 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:03.607927 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fd7569-8ad3-4545-8b03-54154c0c9382 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:03.653649 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:03.667405 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8215695e-fbd9-4c9c-835e-0bf37ac59ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:03.668082 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215695e-fbd9-4c9c-835e-0bf37ac59ab4 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:03.668436 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215695e-fbd9-4c9c-835e-0bf37ac59ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:03.668738 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215695e-fbd9-4c9c-835e-0bf37ac59ab4 None admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:03.669578 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8215695e-fbd9-4c9c-835e-0bf37ac59ab4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:03.669902 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8215695e-fbd9-4c9c-835e-0bf37ac59ab4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:03.671424 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8215695e-fbd9-4c9c-835e-0bf37ac59ab4 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:03.689336 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 596/1218] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Jul 1 19:25:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:03.693711 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8679c381-b207-44f0-a9d8-f249fc809be8 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:03.836250 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8679c381-b207-44f0-a9d8-f249fc809be8 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:03.871733 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:03.880875 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2923f0-c6e7-4c55-9515-59b92e8be7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:03.881719 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2923f0-c6e7-4c55-9515-59b92e8be7b1 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:03.882102 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2923f0-c6e7-4c55-9515-59b92e8be7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:03.882480 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2923f0-c6e7-4c55-9515-59b92e8be7b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:03.883419 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2923f0-c6e7-4c55-9515-59b92e8be7b1 None admin] RBAC: Adding query filter params (role.id=35ca0f0b9a964300a63780ec435e730b, scope.project.id=69c523a41f4048cfb7df553b6feb6310, user.id=941e65d95bcd4e66a6489280520c12de) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:03.883834 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2923f0-c6e7-4c55-9515-59b92e8be7b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:03.885942 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2923f0-c6e7-4c55-9515-59b92e8be7b1 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:03.892106 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 623/1219] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Jul 1 19:25:03 2022] GET /identity/v3/role_assignments?user.id=941e65d95bcd4e66a6489280520c12de&scope.project.id=69c523a41f4048cfb7df553b6feb6310&role.id=35ca0f0b9a964300a63780ec435e730b => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:25:06.022115 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a9252-a5ff-499c-84fd-3f5d3e5a602d None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:06.022620 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a9252-a5ff-499c-84fd-3f5d3e5a602d None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:06.022721 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a9252-a5ff-499c-84fd-3f5d3e5a602d None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:06.024253 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 597/1220] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:25:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:25:06.031048 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a59beef-2667-4230-9aa4-cbdfd88c3279 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:06.031528 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a59beef-2667-4230-9aa4-cbdfd88c3279 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:06.031730 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a59beef-2667-4230-9aa4-cbdfd88c3279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:06.052029 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-6a59beef-2667-4230-9aa4-cbdfd88c3279 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:25:06.053448 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-6a59beef-2667-4230-9aa4-cbdfd88c3279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:25:06.132666 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 624/1221] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:25:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:25:06.158288 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170a9252-a5ff-499c-84fd-3f5d3e5a602d None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:06.281229 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170a9252-a5ff-499c-84fd-3f5d3e5a602d None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:06.333324 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f0c4f3-0155-4d5c-9fd1-95e2d4035648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:06.334241 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0c4f3-0155-4d5c-9fd1-95e2d4035648 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:06.334545 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0c4f3-0155-4d5c-9fd1-95e2d4035648 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:06.334864 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0c4f3-0155-4d5c-9fd1-95e2d4035648 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:06.348140 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f0c4f3-0155-4d5c-9fd1-95e2d4035648 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:25:06.357199 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-71f0c4f3-0155-4d5c-9fd1-95e2d4035648 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:25:06.357199 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:06.357199 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:06.357199 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:06.357199 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:06.357199 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:06.357199 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:06.357199 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:06.357199 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:06.357199 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:06.357199 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:06.357199 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:06.357199 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:25:06.357199 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:25:06.357199 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:25:06.357199 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:25:06.358443 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:25:06.358443 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:25:06.358443 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:25:06.358443 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:25:06.358443 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:06.358443 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:06.358443 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:06.358443 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:06.358443 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:06.358443 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:06.358443 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:06.358443 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:06.358443 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:06.358443 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:06.358443 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:06.358443 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:06.362144 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:06.362144 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:06.362144 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:06.362144 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:06.362144 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:25:06.362144 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:25:06.362144 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:25:06.362144 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:25:06.362144 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:25:06.362144 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:25:06.362144 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:25:06.362144 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:25:06.362144 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 598/1222] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Jul 1 19:25:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:06.364944 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a59beef-2667-4230-9aa4-cbdfd88c3279 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:06.477441 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a59beef-2667-4230-9aa4-cbdfd88c3279 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:06.501646 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:06.514943 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604745e1-70bd-41fc-95b6-8c5916c481e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:06.515729 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604745e1-70bd-41fc-95b6-8c5916c481e1 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:06.516075 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604745e1-70bd-41fc-95b6-8c5916c481e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:06.516355 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604745e1-70bd-41fc-95b6-8c5916c481e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:06.517166 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604745e1-70bd-41fc-95b6-8c5916c481e1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:06.517511 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604745e1-70bd-41fc-95b6-8c5916c481e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:06.519080 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604745e1-70bd-41fc-95b6-8c5916c481e1 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:06.528669 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 625/1223] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Jul 1 19:25:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:06.535018 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f0c4f3-0155-4d5c-9fd1-95e2d4035648 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:06.581974 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:06.651622 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f0c4f3-0155-4d5c-9fd1-95e2d4035648 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:06.692518 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8de97f-96ec-426b-b741-42d65aab84ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:06.693428 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8de97f-96ec-426b-b741-42d65aab84ab None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:06.693730 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8de97f-96ec-426b-b741-42d65aab84ab None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:06.694037 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8de97f-96ec-426b-b741-42d65aab84ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:06.708003 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8de97f-96ec-426b-b741-42d65aab84ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:06.709640 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8de97f-96ec-426b-b741-42d65aab84ab None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:06.729714 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-2d8de97f-96ec-426b-b741-42d65aab84ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:06.729714 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:06.729714 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:06.729714 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:06.729714 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:06.729714 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:06.729714 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:06.729714 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:06.729714 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:06.729714 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:06.729714 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:06.729714 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:06.729714 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:25:06.729714 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:25:06.729714 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:25:06.730931 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:25:06.730931 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:06.730931 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:06.730931 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:06.730931 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:06.730931 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:06.730931 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:06.730931 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:06.730931 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:06.730931 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:06.730931 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:06.730931 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:06.730931 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:06.730931 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:06.730931 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:06.730931 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:06.730931 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:06.732105 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:25:06.732105 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:25:06.732105 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:06.732105 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:25:06.736849 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 599/1224] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:25:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:06.738077 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604745e1-70bd-41fc-95b6-8c5916c481e1 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:06.845171 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604745e1-70bd-41fc-95b6-8c5916c481e1 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:06.880793 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb4bf8e-3829-4169-9176-aeda75e161b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:06.881819 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb4bf8e-3829-4169-9176-aeda75e161b1 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:06.882280 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb4bf8e-3829-4169-9176-aeda75e161b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:06.882608 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb4bf8e-3829-4169-9176-aeda75e161b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:06.883513 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb4bf8e-3829-4169-9176-aeda75e161b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:06.883966 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb4bf8e-3829-4169-9176-aeda75e161b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:06.886508 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb4bf8e-3829-4169-9176-aeda75e161b1 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:06.902333 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 626/1225] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Jul 1 19:25:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:06.909967 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8de97f-96ec-426b-b741-42d65aab84ab None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:07.009877 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:07.019487 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8de97f-96ec-426b-b741-42d65aab84ab None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:07.069795 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f2b78-128c-4917-aaf5-74d4e0062b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:07.071125 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f2b78-128c-4917-aaf5-74d4e0062b5a None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:07.072138 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f2b78-128c-4917-aaf5-74d4e0062b5a None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:07.072628 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f2b78-128c-4917-aaf5-74d4e0062b5a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:07.082338 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9f2b78-128c-4917-aaf5-74d4e0062b5a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:07.083804 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9f2b78-128c-4917-aaf5-74d4e0062b5a None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:07.099135 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-dd9f2b78-128c-4917-aaf5-74d4e0062b5a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 01 19:25:07.099135 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:07.099135 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:07.099135 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:07.099135 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:07.099135 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:07.099135 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:07.099135 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:07.099135 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:07.099135 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:07.099135 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:07.099135 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:07.099135 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 19:25:07.099135 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 19:25:07.099135 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 19:25:07.099135 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 19:25:07.100136 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:07.100136 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:07.100136 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 19:25:07.100136 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:25:07.100136 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 19:25:07.100136 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:25:07.100136 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:07.100136 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:07.100136 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:07.100136 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:07.100136 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:07.100136 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:07.100136 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:07.100136 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:07.100136 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:07.100136 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:07.100136 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:07.100136 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:07.101360 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:07.101360 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:07.101360 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 19:25:07.101360 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 19:25:07.101360 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 19:25:07.101360 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 19:25:07.101360 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 19:25:07.101360 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 19:25:07.101360 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 01 19:25:07.101360 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:25:07.106219 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 600/1226] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:25:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:07.106592 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb4bf8e-3829-4169-9176-aeda75e161b1 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:07.157019 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:07.216831 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb4bf8e-3829-4169-9176-aeda75e161b1 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:07.251349 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feedc1e8-42d0-4a92-830a-d3a92b03eb82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:07.252046 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feedc1e8-42d0-4a92-830a-d3a92b03eb82 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:07.252326 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feedc1e8-42d0-4a92-830a-d3a92b03eb82 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:07.252599 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feedc1e8-42d0-4a92-830a-d3a92b03eb82 None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:07.253565 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feedc1e8-42d0-4a92-830a-d3a92b03eb82 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:07.253896 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feedc1e8-42d0-4a92-830a-d3a92b03eb82 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:07.255385 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feedc1e8-42d0-4a92-830a-d3a92b03eb82 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:07.274346 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 627/1227] 10.222.0.26 () {56 vars in 1143 bytes} [Fri Jul 1 19:25:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:07.280660 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f2b78-128c-4917-aaf5-74d4e0062b5a None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:07.394311 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f2b78-128c-4917-aaf5-74d4e0062b5a None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:07.434600 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6647d260-bbb1-4bf6-b2ed-43248cd1ddc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:07.435396 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6647d260-bbb1-4bf6-b2ed-43248cd1ddc9 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:07.435680 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6647d260-bbb1-4bf6-b2ed-43248cd1ddc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:07.435949 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6647d260-bbb1-4bf6-b2ed-43248cd1ddc9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:07.448215 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6647d260-bbb1-4bf6-b2ed-43248cd1ddc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:07.449935 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6647d260-bbb1-4bf6-b2ed-43248cd1ddc9 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:07.468782 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-6647d260-bbb1-4bf6-b2ed-43248cd1ddc9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:07.468782 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:07.468782 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:07.468782 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:07.468782 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:07.468782 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:07.468782 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:07.468782 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:07.468782 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:07.468782 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:07.468782 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:07.468782 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:07.468782 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:25:07.468782 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:25:07.468782 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:25:07.470167 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:25:07.470167 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:07.470167 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:07.470167 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:07.470167 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:07.470167 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:07.470167 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:07.470167 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:07.470167 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:07.470167 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:07.470167 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:07.470167 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:07.470167 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:07.470167 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:07.470167 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:07.470167 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:07.470167 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:07.471471 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:25:07.471471 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:25:07.471471 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:07.471471 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:25:07.471471 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 601/1228] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:25:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:07.476208 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feedc1e8-42d0-4a92-830a-d3a92b03eb82 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:07.597406 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feedc1e8-42d0-4a92-830a-d3a92b03eb82 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:07.600060 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:07.638144 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a9f13b-8715-4a5d-906b-4dcfd8d3d1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:07.639164 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9f13b-8715-4a5d-906b-4dcfd8d3d1d2 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:07.639164 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9f13b-8715-4a5d-906b-4dcfd8d3d1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:07.639522 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9f13b-8715-4a5d-906b-4dcfd8d3d1d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:07.640333 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a9f13b-8715-4a5d-906b-4dcfd8d3d1d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:07.640661 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a9f13b-8715-4a5d-906b-4dcfd8d3d1d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:07.642349 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a9f13b-8715-4a5d-906b-4dcfd8d3d1d2 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:07.655504 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 628/1229] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Jul 1 19:25:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:07.661900 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6647d260-bbb1-4bf6-b2ed-43248cd1ddc9 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:07.674085 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:07.771727 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6647d260-bbb1-4bf6-b2ed-43248cd1ddc9 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:07.807751 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d088f4e-2a94-4f73-bc9f-91640a8a5b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:07.808543 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d088f4e-2a94-4f73-bc9f-91640a8a5b91 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:07.808801 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d088f4e-2a94-4f73-bc9f-91640a8a5b91 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:07.809063 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d088f4e-2a94-4f73-bc9f-91640a8a5b91 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:07.817160 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d088f4e-2a94-4f73-bc9f-91640a8a5b91 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:07.818751 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d088f4e-2a94-4f73-bc9f-91640a8a5b91 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:07.834064 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-1d088f4e-2a94-4f73-bc9f-91640a8a5b91 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:25:07.834064 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:07.834064 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:07.834064 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:07.834064 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:07.834064 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:07.834064 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:07.834064 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:07.834064 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:07.834064 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:07.834064 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:07.834064 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:07.834064 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 19:25:07.834064 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 19:25:07.834064 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 19:25:07.835188 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 19:25:07.835188 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:07.835188 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:07.835188 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:07.835188 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:07.835188 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:07.835188 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:07.835188 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:07.835188 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:07.835188 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:07.835188 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:07.835188 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:07.835188 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:07.835188 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:07.835188 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:07.835188 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:07.835188 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:07.836412 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 19:25:07.836412 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 19:25:07.836412 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 19:25:07.836412 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 19:25:07.836412 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 19:25:07.836412 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 19:25:07.836412 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:25:07.836412 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:25:07.840796 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 602/1230] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Jul 1 19:25:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:07.841825 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a9f13b-8715-4a5d-906b-4dcfd8d3d1d2 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:07.957554 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a9f13b-8715-4a5d-906b-4dcfd8d3d1d2 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:07.997062 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11edf859-08d4-4b67-9fba-9f7f2d513c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:07.997820 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11edf859-08d4-4b67-9fba-9f7f2d513c8b None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:07.998186 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11edf859-08d4-4b67-9fba-9f7f2d513c8b None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:07.998436 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11edf859-08d4-4b67-9fba-9f7f2d513c8b None admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:07.999311 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11edf859-08d4-4b67-9fba-9f7f2d513c8b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:07.999627 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11edf859-08d4-4b67-9fba-9f7f2d513c8b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:08.001263 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11edf859-08d4-4b67-9fba-9f7f2d513c8b None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:08.015515 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 629/1231] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Jul 1 19:25:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:08.021697 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d088f4e-2a94-4f73-bc9f-91640a8a5b91 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:08.097114 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:08.136657 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d088f4e-2a94-4f73-bc9f-91640a8a5b91 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:08.173115 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c451d535-1756-40b3-855e-21007b177a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:08.174026 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c451d535-1756-40b3-855e-21007b177a4c None admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:08.174307 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c451d535-1756-40b3-855e-21007b177a4c None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:08.174580 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c451d535-1756-40b3-855e-21007b177a4c None admin] PATH_INFO: `/v3/projects/69c523a41f4048cfb7df553b6feb6310/users/941e65d95bcd4e66a6489280520c12de/roles/35ca0f0b9a964300a63780ec435e730b` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:08.190213 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c451d535-1756-40b3-855e-21007b177a4c None admin] RBAC: Authorizing `identity:create_grant(project_id=69c523a41f4048cfb7df553b6feb6310, user_id=941e65d95bcd4e66a6489280520c12de, role_id=35ca0f0b9a964300a63780ec435e730b)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:08.191692 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c451d535-1756-40b3-855e-21007b177a4c None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:08.204607 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 603/1232] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Jul 1 19:25:08 2022] PUT /identity/v3/projects/69c523a41f4048cfb7df553b6feb6310/users/941e65d95bcd4e66a6489280520c12de/roles/35ca0f0b9a964300a63780ec435e730b => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:25:10.477212 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38864d5-220b-4bc9-9843-eb3ca9d2966a None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:10.477861 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38864d5-220b-4bc9-9843-eb3ca9d2966a None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:10.477861 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38864d5-220b-4bc9-9843-eb3ca9d2966a None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:10.479400 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 630/1233] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:25:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:25:10.485054 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1cf3ae-d66a-4625-a958-e4b4e900c8d2 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:10.485522 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1cf3ae-d66a-4625-a958-e4b4e900c8d2 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:10.485634 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1cf3ae-d66a-4625-a958-e4b4e900c8d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:10.503435 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-5d1cf3ae-d66a-4625-a958-e4b4e900c8d2 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:25:10.504706 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-5d1cf3ae-d66a-4625-a958-e4b4e900c8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:25:10.574618 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 604/1234] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:25:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:25:10.598313 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38864d5-220b-4bc9-9843-eb3ca9d2966a None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:10.631291 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:10.719662 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38864d5-220b-4bc9-9843-eb3ca9d2966a None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:10.756878 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02102835-25a5-4120-b91d-d2f837337690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:10.757649 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02102835-25a5-4120-b91d-d2f837337690 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:10.757939 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02102835-25a5-4120-b91d-d2f837337690 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:10.758290 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02102835-25a5-4120-b91d-d2f837337690 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:10.769365 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02102835-25a5-4120-b91d-d2f837337690 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:25:10.777577 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-02102835-25a5-4120-b91d-d2f837337690 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:25:10.777577 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:10.777577 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:10.777577 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:10.777577 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:10.777577 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:10.777577 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:10.777577 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:10.777577 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:10.777577 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:10.777577 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:10.777577 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:10.777577 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:25:10.777577 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:25:10.777577 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:25:10.777577 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:25:10.778760 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:25:10.778760 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:25:10.778760 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:25:10.778760 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:25:10.778760 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:10.778760 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:10.778760 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:10.778760 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:10.778760 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:10.778760 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:10.778760 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:10.778760 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:10.778760 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:10.778760 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:10.778760 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:10.778760 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:10.779713 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:10.779713 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:10.779713 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:10.779713 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:10.779713 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:25:10.779713 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:25:10.779713 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:25:10.779713 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:25:10.779713 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:25:10.779713 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:25:10.779713 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:25:10.779713 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:25:10.779713 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 631/1235] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Jul 1 19:25:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:25:10.784960 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1cf3ae-d66a-4625-a958-e4b4e900c8d2 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:10.837781 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:10.900886 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1cf3ae-d66a-4625-a958-e4b4e900c8d2 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:10.941115 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7576634c-bdf3-4bcd-8737-ceafcfc5354a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:10.941826 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7576634c-bdf3-4bcd-8737-ceafcfc5354a None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:10.942116 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7576634c-bdf3-4bcd-8737-ceafcfc5354a None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:10.942402 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7576634c-bdf3-4bcd-8737-ceafcfc5354a None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:10.943149 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7576634c-bdf3-4bcd-8737-ceafcfc5354a None admin] RBAC: Adding query filter params (name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:10.943467 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7576634c-bdf3-4bcd-8737-ceafcfc5354a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:10.944888 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7576634c-bdf3-4bcd-8737-ceafcfc5354a None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:10.955866 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 605/1236] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Jul 1 19:25:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:10.962826 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02102835-25a5-4120-b91d-d2f837337690 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:11.061926 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:11.080118 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02102835-25a5-4120-b91d-d2f837337690 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:11.119862 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83303601-a0f1-4012-b0aa-d78738efabe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:11.120660 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83303601-a0f1-4012-b0aa-d78738efabe6 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:11.120947 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83303601-a0f1-4012-b0aa-d78738efabe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:11.121220 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83303601-a0f1-4012-b0aa-d78738efabe6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:11.131964 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83303601-a0f1-4012-b0aa-d78738efabe6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:11.133647 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83303601-a0f1-4012-b0aa-d78738efabe6 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:11.152296 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-83303601-a0f1-4012-b0aa-d78738efabe6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:11.152296 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:11.152296 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:11.152296 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:11.152296 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:11.152296 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:11.152296 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:11.152296 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:11.152296 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:11.152296 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:11.152296 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:11.152296 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:11.152296 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:25:11.152296 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:25:11.152296 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:25:11.153386 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:25:11.153386 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:11.153386 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:11.153386 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:11.153386 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:11.153386 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:11.153386 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:11.153386 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:11.153386 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:11.153386 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:11.153386 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:11.153386 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:11.153386 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:11.153386 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:11.153386 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:11.153386 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:11.153386 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:11.154414 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:25:11.154414 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:25:11.154414 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:11.154414 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:25:11.154414 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 632/1237] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:25:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:11.159860 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7576634c-bdf3-4bcd-8737-ceafcfc5354a None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:11.270422 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7576634c-bdf3-4bcd-8737-ceafcfc5354a None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:11.282554 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:11.317524 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8524f2ba-12ec-451d-b0aa-5ce688ee2fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:11.318614 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8524f2ba-12ec-451d-b0aa-5ce688ee2fc5 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:11.319187 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8524f2ba-12ec-451d-b0aa-5ce688ee2fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:11.319704 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8524f2ba-12ec-451d-b0aa-5ce688ee2fc5 None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:11.321300 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8524f2ba-12ec-451d-b0aa-5ce688ee2fc5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:11.322538 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8524f2ba-12ec-451d-b0aa-5ce688ee2fc5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:11.325021 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8524f2ba-12ec-451d-b0aa-5ce688ee2fc5 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:11.343918 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 606/1238] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Jul 1 19:25:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:11.352790 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83303601-a0f1-4012-b0aa-d78738efabe6 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:11.470959 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83303601-a0f1-4012-b0aa-d78738efabe6 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:11.507271 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c5e1f9-5482-4bc4-a6f2-a39c2af82d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:11.508087 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5e1f9-5482-4bc4-a6f2-a39c2af82d0b None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:11.508348 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5e1f9-5482-4bc4-a6f2-a39c2af82d0b None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:11.508621 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5e1f9-5482-4bc4-a6f2-a39c2af82d0b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:11.512276 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:11.518288 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c5e1f9-5482-4bc4-a6f2-a39c2af82d0b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:11.520003 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c5e1f9-5482-4bc4-a6f2-a39c2af82d0b None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:11.536131 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-c2c5e1f9-5482-4bc4-a6f2-a39c2af82d0b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 01 19:25:11.536131 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:11.536131 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:11.536131 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:11.536131 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:11.536131 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:11.536131 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:11.536131 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:11.536131 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:11.536131 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:11.536131 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:11.536131 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:11.536131 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 19:25:11.536131 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 19:25:11.536131 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 19:25:11.536131 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 19:25:11.537257 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:11.537257 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:11.537257 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 19:25:11.537257 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:25:11.537257 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 19:25:11.537257 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:25:11.537257 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:11.537257 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:11.537257 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:11.537257 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:11.537257 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:11.537257 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:11.537257 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:11.537257 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:11.537257 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:11.537257 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:11.537257 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:11.537257 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:11.538772 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:11.538772 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:11.538772 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 19:25:11.538772 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 19:25:11.538772 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 19:25:11.538772 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 19:25:11.538772 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 19:25:11.538772 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 19:25:11.538772 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 01 19:25:11.538772 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:25:11.538772 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 633/1239] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:25:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:11.543328 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8524f2ba-12ec-451d-b0aa-5ce688ee2fc5 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:11.665610 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8524f2ba-12ec-451d-b0aa-5ce688ee2fc5 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:11.707920 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e9c853-6d2e-4ff6-a3fb-42424c951fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:11.708607 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9c853-6d2e-4ff6-a3fb-42424c951fe3 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:11.708907 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9c853-6d2e-4ff6-a3fb-42424c951fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:11.709181 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9c853-6d2e-4ff6-a3fb-42424c951fe3 None admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:11.710107 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e9c853-6d2e-4ff6-a3fb-42424c951fe3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:11.710428 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e9c853-6d2e-4ff6-a3fb-42424c951fe3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:11.711881 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e9c853-6d2e-4ff6-a3fb-42424c951fe3 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:11.731495 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 607/1240] 10.222.0.26 () {56 vars in 1143 bytes} [Fri Jul 1 19:25:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:25:11.737886 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c5e1f9-5482-4bc4-a6f2-a39c2af82d0b None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:11.853423 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c5e1f9-5482-4bc4-a6f2-a39c2af82d0b None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:11.890201 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2065b677-6ebd-4526-9f01-b02042d2b428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:11.891197 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2065b677-6ebd-4526-9f01-b02042d2b428 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:11.891485 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2065b677-6ebd-4526-9f01-b02042d2b428 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:11.891763 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2065b677-6ebd-4526-9f01-b02042d2b428 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:11.964252 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:11.972880 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2065b677-6ebd-4526-9f01-b02042d2b428 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:11.975264 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2065b677-6ebd-4526-9f01-b02042d2b428 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:12.083991 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 634/1241] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Jul 1 19:25:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 01 19:25:12.090047 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e9c853-6d2e-4ff6-a3fb-42424c951fe3 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:12.120120 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:12.205934 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e9c853-6d2e-4ff6-a3fb-42424c951fe3 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:12.245997 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c47d05b-b47c-4748-b487-82259daba26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:12.247019 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c47d05b-b47c-4748-b487-82259daba26a None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:12.247425 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c47d05b-b47c-4748-b487-82259daba26a None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:12.247784 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c47d05b-b47c-4748-b487-82259daba26a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:12.261191 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c47d05b-b47c-4748-b487-82259daba26a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:12.262717 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c47d05b-b47c-4748-b487-82259daba26a None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:12.282536 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-0c47d05b-b47c-4748-b487-82259daba26a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:12.282536 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:12.282536 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:12.282536 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:12.282536 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:12.282536 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:12.282536 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:12.282536 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:12.282536 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:12.282536 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:12.282536 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:12.282536 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:12.282536 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:25:12.282536 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:25:12.282536 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:25:12.283730 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:25:12.283730 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:12.283730 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:12.283730 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:12.283730 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:12.283730 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:12.283730 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:12.283730 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:12.283730 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:12.283730 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:12.283730 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:12.283730 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:12.283730 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:12.283730 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:12.283730 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:12.283730 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:12.283730 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:12.284653 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:25:12.284653 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:25:12.284653 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:12.284653 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:25:12.284653 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 608/1242] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:25:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:12.289745 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2065b677-6ebd-4526-9f01-b02042d2b428 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:12.407220 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:12.414864 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2065b677-6ebd-4526-9f01-b02042d2b428 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:12.454055 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3575f251-3fb5-4286-9333-6e7e7ed17c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:12.454721 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575f251-3fb5-4286-9333-6e7e7ed17c29 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:12.455002 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575f251-3fb5-4286-9333-6e7e7ed17c29 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:12.455275 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575f251-3fb5-4286-9333-6e7e7ed17c29 None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:12.456047 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3575f251-3fb5-4286-9333-6e7e7ed17c29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:12.456302 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3575f251-3fb5-4286-9333-6e7e7ed17c29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:12.457696 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3575f251-3fb5-4286-9333-6e7e7ed17c29 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:12.469567 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 635/1243] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Jul 1 19:25:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:25:12.475430 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c47d05b-b47c-4748-b487-82259daba26a None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:12.571082 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:12.592241 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c47d05b-b47c-4748-b487-82259daba26a None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:12.631330 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017429a6-fb05-4643-9e99-d21e4da63939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:12.632189 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017429a6-fb05-4643-9e99-d21e4da63939 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:12.632543 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017429a6-fb05-4643-9e99-d21e4da63939 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:12.632882 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017429a6-fb05-4643-9e99-d21e4da63939 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:12.641521 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017429a6-fb05-4643-9e99-d21e4da63939 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:12.643185 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017429a6-fb05-4643-9e99-d21e4da63939 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:12.658496 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-017429a6-fb05-4643-9e99-d21e4da63939 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:25:12.658496 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:12.658496 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:12.658496 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:12.658496 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:12.658496 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:12.658496 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:12.658496 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:12.658496 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:12.658496 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:12.658496 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:12.658496 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:12.658496 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 19:25:12.658496 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 19:25:12.658496 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 19:25:12.659687 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 19:25:12.659687 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:12.659687 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:12.659687 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:12.659687 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:12.659687 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:12.659687 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:12.659687 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:12.659687 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:12.659687 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:12.659687 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:12.659687 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:12.659687 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:12.659687 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:12.659687 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:12.659687 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:12.659687 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:12.660904 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 19:25:12.660904 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 19:25:12.660904 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 19:25:12.660904 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 19:25:12.660904 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 19:25:12.660904 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 19:25:12.660904 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:25:12.660904 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:25:12.664919 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 609/1244] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Jul 1 19:25:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:12.666100 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3575f251-3fb5-4286-9333-6e7e7ed17c29 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:12.786372 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3575f251-3fb5-4286-9333-6e7e7ed17c29 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:12.830519 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32de1e01-001b-476b-958c-0cffde678c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:12.831184 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de1e01-001b-476b-958c-0cffde678c92 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:12.831474 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de1e01-001b-476b-958c-0cffde678c92 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:12.831757 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de1e01-001b-476b-958c-0cffde678c92 None admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:12.832550 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32de1e01-001b-476b-958c-0cffde678c92 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:12.832888 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32de1e01-001b-476b-958c-0cffde678c92 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:12.834335 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32de1e01-001b-476b-958c-0cffde678c92 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:12.846416 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 636/1245] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Jul 1 19:25:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:12.852490 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017429a6-fb05-4643-9e99-d21e4da63939 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:12.962088 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017429a6-fb05-4643-9e99-d21e4da63939 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:13.003153 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f70b923-d2e2-4188-8312-014cbe8295e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:13.003834 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70b923-d2e2-4188-8312-014cbe8295e5 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:13.004134 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70b923-d2e2-4188-8312-014cbe8295e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:13.004489 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70b923-d2e2-4188-8312-014cbe8295e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:13.005349 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f70b923-d2e2-4188-8312-014cbe8295e5 None admin] RBAC: Adding query filter params (role.id=35ca0f0b9a964300a63780ec435e730b, scope.project.id=69c523a41f4048cfb7df553b6feb6310, user.id=941e65d95bcd4e66a6489280520c12de) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:13.005675 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f70b923-d2e2-4188-8312-014cbe8295e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:13.007127 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f70b923-d2e2-4188-8312-014cbe8295e5 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:13.014314 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 610/1246] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Jul 1 19:25:12 2022] GET /identity/v3/role_assignments?user.id=941e65d95bcd4e66a6489280520c12de&scope.project.id=69c523a41f4048cfb7df553b6feb6310&role.id=35ca0f0b9a964300a63780ec435e730b => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:15.401387 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404220f1-fca6-4f65-95b1-fba69426cabb None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:15.401962 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404220f1-fca6-4f65-95b1-fba69426cabb None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:15.401962 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404220f1-fca6-4f65-95b1-fba69426cabb None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:15.403290 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 637/1247] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:25:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:25:15.408783 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e587f1-6a05-4759-8a23-dbaf48a7e8f3 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:15.409228 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e587f1-6a05-4759-8a23-dbaf48a7e8f3 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:15.409397 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e587f1-6a05-4759-8a23-dbaf48a7e8f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:15.414746 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:15.428736 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-d6e587f1-6a05-4759-8a23-dbaf48a7e8f3 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:25:15.430046 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-d6e587f1-6a05-4759-8a23-dbaf48a7e8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:25:15.504625 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 611/1248] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:25:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:25:15.534455 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404220f1-fca6-4f65-95b1-fba69426cabb None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:15.553691 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:15.650548 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404220f1-fca6-4f65-95b1-fba69426cabb None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:15.689684 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1abe264-0474-4541-9f1e-ee4c44735953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:15.690397 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1abe264-0474-4541-9f1e-ee4c44735953 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:15.690684 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1abe264-0474-4541-9f1e-ee4c44735953 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:15.690957 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1abe264-0474-4541-9f1e-ee4c44735953 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:15.703061 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1abe264-0474-4541-9f1e-ee4c44735953 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:25:15.711511 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-d1abe264-0474-4541-9f1e-ee4c44735953 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:25:15.711511 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:15.711511 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:15.711511 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:15.711511 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:15.711511 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:15.711511 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:15.711511 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:15.711511 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:15.711511 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:15.711511 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:15.711511 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:15.711511 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:25:15.711511 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:25:15.711511 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:25:15.711511 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:25:15.712702 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:25:15.712702 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:25:15.712702 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:25:15.712702 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:25:15.712702 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:15.712702 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:15.712702 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:15.712702 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:15.712702 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:15.712702 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:15.712702 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:15.712702 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:15.712702 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:15.712702 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:15.712702 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:15.712702 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:15.713697 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:15.713697 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:15.713697 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:15.713697 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:15.713697 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:25:15.713697 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:25:15.713697 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:25:15.713697 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:25:15.713697 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:25:15.713697 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:25:15.713697 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:25:15.713697 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:25:15.713697 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 638/1249] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Jul 1 19:25:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:15.719174 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e587f1-6a05-4759-8a23-dbaf48a7e8f3 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:15.829081 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e587f1-6a05-4759-8a23-dbaf48a7e8f3 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:15.862241 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:15.867596 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38262912-1f2d-42a3-9c73-d081c2b3a4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:15.869077 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38262912-1f2d-42a3-9c73-d081c2b3a4c4 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:15.869564 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38262912-1f2d-42a3-9c73-d081c2b3a4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:15.869989 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38262912-1f2d-42a3-9c73-d081c2b3a4c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:15.870815 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38262912-1f2d-42a3-9c73-d081c2b3a4c4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:15.871226 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38262912-1f2d-42a3-9c73-d081c2b3a4c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:15.872873 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38262912-1f2d-42a3-9c73-d081c2b3a4c4 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:15.883626 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 612/1250] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Jul 1 19:25:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:15.889455 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1abe264-0474-4541-9f1e-ee4c44735953 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:15.987218 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:16.017858 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1abe264-0474-4541-9f1e-ee4c44735953 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:16.061479 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2913f4e4-2174-457b-90f6-dd2c3ec12e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:16.062593 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2913f4e4-2174-457b-90f6-dd2c3ec12e52 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:16.063042 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2913f4e4-2174-457b-90f6-dd2c3ec12e52 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:16.063331 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2913f4e4-2174-457b-90f6-dd2c3ec12e52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:16.075765 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2913f4e4-2174-457b-90f6-dd2c3ec12e52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:16.077437 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2913f4e4-2174-457b-90f6-dd2c3ec12e52 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:16.097278 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-2913f4e4-2174-457b-90f6-dd2c3ec12e52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:16.097278 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:16.097278 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:16.097278 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:16.097278 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:16.097278 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:16.097278 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:16.097278 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:16.097278 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:16.097278 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:16.097278 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:16.097278 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:16.097278 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:25:16.097278 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:25:16.097278 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:25:16.098246 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:25:16.098246 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:16.098246 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:16.098246 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:16.098246 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:16.098246 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:16.098246 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:16.098246 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:16.098246 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:16.098246 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:16.098246 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:16.098246 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:16.098246 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:16.098246 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:16.098246 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:16.098246 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:16.098246 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:16.099153 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:25:16.099153 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:25:16.099153 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:16.099153 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:25:16.099153 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 639/1251] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:25:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:16.106388 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38262912-1f2d-42a3-9c73-d081c2b3a4c4 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:16.221590 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38262912-1f2d-42a3-9c73-d081c2b3a4c4 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:16.260580 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb73cc3-b996-4ee0-9e93-d177418af10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:16.261263 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb73cc3-b996-4ee0-9e93-d177418af10d None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:16.261538 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb73cc3-b996-4ee0-9e93-d177418af10d None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:16.261817 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb73cc3-b996-4ee0-9e93-d177418af10d None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:16.262594 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb73cc3-b996-4ee0-9e93-d177418af10d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:16.262975 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb73cc3-b996-4ee0-9e93-d177418af10d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:16.264551 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb73cc3-b996-4ee0-9e93-d177418af10d None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:16.278575 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 613/1252] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Jul 1 19:25:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:25:16.285491 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2913f4e4-2174-457b-90f6-dd2c3ec12e52 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:16.399058 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2913f4e4-2174-457b-90f6-dd2c3ec12e52 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:16.431660 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:16.443077 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e847d9c-8301-4a7d-b219-1983cc164391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:16.443888 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e847d9c-8301-4a7d-b219-1983cc164391 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:16.444177 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e847d9c-8301-4a7d-b219-1983cc164391 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:16.444456 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e847d9c-8301-4a7d-b219-1983cc164391 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:16.453132 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e847d9c-8301-4a7d-b219-1983cc164391 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:16.454714 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e847d9c-8301-4a7d-b219-1983cc164391 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:16.470778 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-1e847d9c-8301-4a7d-b219-1983cc164391 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 01 19:25:16.470778 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:16.470778 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:16.470778 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:16.470778 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:16.470778 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:16.470778 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:16.470778 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:16.470778 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:16.470778 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:16.470778 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:16.470778 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:16.470778 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 19:25:16.470778 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 19:25:16.470778 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 19:25:16.470778 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 19:25:16.471880 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:16.471880 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:16.471880 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 19:25:16.471880 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:25:16.471880 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 19:25:16.471880 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:25:16.471880 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:16.471880 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:16.471880 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:16.471880 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:16.471880 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:16.471880 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:16.471880 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:16.471880 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:16.471880 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:16.471880 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:16.471880 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:16.471880 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:16.472942 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:16.472942 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:16.472942 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 19:25:16.472942 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 19:25:16.472942 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 19:25:16.472942 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 19:25:16.472942 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 19:25:16.472942 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 19:25:16.472942 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 01 19:25:16.472942 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:25:16.472942 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 640/1253] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:25:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:16.478601 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb73cc3-b996-4ee0-9e93-d177418af10d None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:16.541944 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:16.595542 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb73cc3-b996-4ee0-9e93-d177418af10d None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:16.641976 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6d839e-5e01-4274-a3fc-a966822c42d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:16.642677 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6d839e-5e01-4274-a3fc-a966822c42d6 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:16.643035 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6d839e-5e01-4274-a3fc-a966822c42d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:16.643321 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6d839e-5e01-4274-a3fc-a966822c42d6 None admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:16.644167 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6d839e-5e01-4274-a3fc-a966822c42d6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:16.644472 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6d839e-5e01-4274-a3fc-a966822c42d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:16.646068 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6d839e-5e01-4274-a3fc-a966822c42d6 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:16.664184 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 614/1254] 10.222.0.26 () {56 vars in 1143 bytes} [Fri Jul 1 19:25:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:16.670328 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e847d9c-8301-4a7d-b219-1983cc164391 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:16.789732 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e847d9c-8301-4a7d-b219-1983cc164391 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:16.828860 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f114a1-d649-41c7-a77f-27d6735c65ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:16.829498 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f114a1-d649-41c7-a77f-27d6735c65ae None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:16.829788 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f114a1-d649-41c7-a77f-27d6735c65ae None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:16.830148 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f114a1-d649-41c7-a77f-27d6735c65ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:16.890278 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:16.907611 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f114a1-d649-41c7-a77f-27d6735c65ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:16.909801 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f114a1-d649-41c7-a77f-27d6735c65ae None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:17.033979 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 641/1255] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Jul 1 19:25:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 01 19:25:17.040365 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6d839e-5e01-4274-a3fc-a966822c42d6 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:17.148407 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6d839e-5e01-4274-a3fc-a966822c42d6 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:17.162588 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:17.187292 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0e6f4e-c856-4693-8486-6bdb17137af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:17.188115 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e6f4e-c856-4693-8486-6bdb17137af1 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:17.188457 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e6f4e-c856-4693-8486-6bdb17137af1 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:17.188745 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e6f4e-c856-4693-8486-6bdb17137af1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:17.200748 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0e6f4e-c856-4693-8486-6bdb17137af1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:17.202407 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0e6f4e-c856-4693-8486-6bdb17137af1 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:17.219878 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-5d0e6f4e-c856-4693-8486-6bdb17137af1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:17.219878 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:17.219878 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:17.219878 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:17.219878 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:17.219878 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:17.219878 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:17.219878 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:17.219878 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:17.219878 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:17.219878 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:17.219878 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:17.219878 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:25:17.219878 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:25:17.219878 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:25:17.221063 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:25:17.221063 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:17.221063 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:17.221063 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:17.221063 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:17.221063 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:17.221063 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:17.221063 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:17.221063 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:17.221063 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:17.221063 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:17.221063 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:17.221063 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:17.221063 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:17.221063 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:17.221063 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:17.221063 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:17.222324 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:25:17.222324 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:25:17.222324 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:17.222324 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:25:17.222324 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 615/1256] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:25:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:17.230198 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f114a1-d649-41c7-a77f-27d6735c65ae None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:17.345149 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:17.360191 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f114a1-d649-41c7-a77f-27d6735c65ae None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:17.400245 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d25fc4a-11e2-4bfa-a7b3-89bcb1deaef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:17.400881 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d25fc4a-11e2-4bfa-a7b3-89bcb1deaef7 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:17.401171 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d25fc4a-11e2-4bfa-a7b3-89bcb1deaef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:17.402690 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d25fc4a-11e2-4bfa-a7b3-89bcb1deaef7 None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:17.403855 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d25fc4a-11e2-4bfa-a7b3-89bcb1deaef7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:17.404172 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d25fc4a-11e2-4bfa-a7b3-89bcb1deaef7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:17.406128 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d25fc4a-11e2-4bfa-a7b3-89bcb1deaef7 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:17.419080 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 642/1257] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Jul 1 19:25:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:17.425601 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0e6f4e-c856-4693-8486-6bdb17137af1 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:17.542116 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0e6f4e-c856-4693-8486-6bdb17137af1 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:17.579768 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a9d67-f891-4914-baf6-0cbd3c94ded4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:17.580544 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a9d67-f891-4914-baf6-0cbd3c94ded4 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:17.580827 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a9d67-f891-4914-baf6-0cbd3c94ded4 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:17.581097 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a9d67-f891-4914-baf6-0cbd3c94ded4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:17.587983 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43a9d67-f891-4914-baf6-0cbd3c94ded4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:17.589429 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43a9d67-f891-4914-baf6-0cbd3c94ded4 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:17.614678 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-c43a9d67-f891-4914-baf6-0cbd3c94ded4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:25:17.614678 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:17.614678 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:17.614678 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:17.614678 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:17.614678 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:17.614678 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:17.614678 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:17.614678 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:17.614678 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:17.614678 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:17.614678 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:17.614678 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 19:25:17.614678 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 19:25:17.614678 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 19:25:17.615892 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 19:25:17.615892 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:17.615892 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:17.615892 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:17.615892 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:17.615892 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:17.615892 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:17.615892 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:17.615892 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:17.615892 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:17.615892 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:17.615892 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:17.615892 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:17.615892 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:17.615892 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:17.615892 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:17.615892 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:17.617171 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 19:25:17.617171 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 19:25:17.617171 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 19:25:17.617171 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 19:25:17.617171 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 19:25:17.617171 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 19:25:17.617171 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:25:17.617171 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:25:17.623958 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 616/1258] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Jul 1 19:25:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:25:17.625728 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d25fc4a-11e2-4bfa-a7b3-89bcb1deaef7 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:17.749190 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d25fc4a-11e2-4bfa-a7b3-89bcb1deaef7 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:17.785195 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4908c218-d960-40af-a2a7-df8a77902492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:17.786040 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908c218-d960-40af-a2a7-df8a77902492 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:17.786324 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908c218-d960-40af-a2a7-df8a77902492 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:17.786603 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908c218-d960-40af-a2a7-df8a77902492 None admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:17.787391 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4908c218-d960-40af-a2a7-df8a77902492 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:17.787758 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4908c218-d960-40af-a2a7-df8a77902492 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:17.789140 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4908c218-d960-40af-a2a7-df8a77902492 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:17.808703 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 643/1259] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Jul 1 19:25:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:17.810018 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a9d67-f891-4914-baf6-0cbd3c94ded4 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:17.839100 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:17.926548 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a9d67-f891-4914-baf6-0cbd3c94ded4 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:17.963511 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07e2e0c-c4b4-4f1f-85fe-496266f5d0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:17.964187 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e2e0c-c4b4-4f1f-85fe-496266f5d0ce None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:17.964471 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e2e0c-c4b4-4f1f-85fe-496266f5d0ce None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:17.964749 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e2e0c-c4b4-4f1f-85fe-496266f5d0ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:17.965631 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07e2e0c-c4b4-4f1f-85fe-496266f5d0ce None admin] RBAC: Adding query filter params (role.id=6cb03785fb184ef587509b3174622f69, scope.project.id=69c523a41f4048cfb7df553b6feb6310, user.id=941e65d95bcd4e66a6489280520c12de) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:17.965947 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07e2e0c-c4b4-4f1f-85fe-496266f5d0ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:17.967434 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07e2e0c-c4b4-4f1f-85fe-496266f5d0ce None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:17.973965 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 617/1260] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Jul 1 19:25:17 2022] GET /identity/v3/role_assignments?user.id=941e65d95bcd4e66a6489280520c12de&scope.project.id=69c523a41f4048cfb7df553b6feb6310&role.id=6cb03785fb184ef587509b3174622f69 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:19.998947 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858d181-eced-4d1e-8782-361c53e0556c None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:19.999491 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858d181-eced-4d1e-8782-361c53e0556c None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:19.999491 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858d181-eced-4d1e-8782-361c53e0556c None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:20.000773 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 644/1261] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:25:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:25:20.005839 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28810f-073c-4b52-ade5-bc1b3247296f None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:20.006222 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28810f-073c-4b52-ade5-bc1b3247296f None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:20.006407 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28810f-073c-4b52-ade5-bc1b3247296f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:20.023332 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-cc28810f-073c-4b52-ade5-bc1b3247296f None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:25:20.024506 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-cc28810f-073c-4b52-ade5-bc1b3247296f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:25:20.089420 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 618/1262] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:25:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:25:20.112563 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8858d181-eced-4d1e-8782-361c53e0556c None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:20.124275 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:20.213535 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8858d181-eced-4d1e-8782-361c53e0556c None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:20.246279 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbc8d5c-f717-4e18-b7c2-5851d3e5eda2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:20.247052 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc8d5c-f717-4e18-b7c2-5851d3e5eda2 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:20.247334 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc8d5c-f717-4e18-b7c2-5851d3e5eda2 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:20.247605 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc8d5c-f717-4e18-b7c2-5851d3e5eda2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:20.257454 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbc8d5c-f717-4e18-b7c2-5851d3e5eda2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:25:20.265349 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-7fbc8d5c-f717-4e18-b7c2-5851d3e5eda2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:25:20.265349 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:20.265349 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:20.265349 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:20.265349 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:20.265349 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:20.265349 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:20.265349 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:20.265349 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:20.265349 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:20.265349 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:20.265349 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:20.265349 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:25:20.265349 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:25:20.265349 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:25:20.265349 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:25:20.266570 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:25:20.266570 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:25:20.266570 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:25:20.266570 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:25:20.266570 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:20.266570 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:20.266570 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:20.266570 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:20.266570 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:20.266570 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:20.266570 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:20.266570 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:20.266570 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:20.266570 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:20.266570 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:20.266570 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:20.267759 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:20.267759 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:20.267759 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:20.267759 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:20.267759 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:25:20.267759 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:25:20.267759 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:25:20.267759 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:25:20.267759 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:25:20.267759 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:25:20.267759 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:25:20.267759 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:25:20.267759 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 645/1263] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Jul 1 19:25:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:20.272743 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc28810f-073c-4b52-ade5-bc1b3247296f None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:20.293862 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:20.386193 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc28810f-073c-4b52-ade5-bc1b3247296f None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:20.419221 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461e0346-ea84-431c-b513-abd1b828988f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:20.419882 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e0346-ea84-431c-b513-abd1b828988f None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:20.420165 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e0346-ea84-431c-b513-abd1b828988f None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:20.420442 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e0346-ea84-431c-b513-abd1b828988f None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:20.421180 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461e0346-ea84-431c-b513-abd1b828988f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:20.421589 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461e0346-ea84-431c-b513-abd1b828988f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:20.422961 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461e0346-ea84-431c-b513-abd1b828988f None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:20.431729 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 619/1264] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Jul 1 19:25:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:20.437578 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbc8d5c-f717-4e18-b7c2-5851d3e5eda2 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:20.501628 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:20.533844 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbc8d5c-f717-4e18-b7c2-5851d3e5eda2 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:20.566661 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b7ad9c-9b28-4b44-a643-32de09cd7aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:20.567428 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7ad9c-9b28-4b44-a643-32de09cd7aa8 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:20.567700 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7ad9c-9b28-4b44-a643-32de09cd7aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:20.568001 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7ad9c-9b28-4b44-a643-32de09cd7aa8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:20.578090 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b7ad9c-9b28-4b44-a643-32de09cd7aa8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:20.579519 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b7ad9c-9b28-4b44-a643-32de09cd7aa8 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:20.595716 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-27b7ad9c-9b28-4b44-a643-32de09cd7aa8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:20.595716 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:20.595716 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:20.595716 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:20.595716 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:20.595716 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:20.595716 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:20.595716 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:20.595716 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:20.595716 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:20.595716 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:20.595716 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:20.595716 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:25:20.595716 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:25:20.595716 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:25:20.596829 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:25:20.596829 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:20.596829 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:20.596829 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:20.596829 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:20.596829 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:20.596829 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:20.596829 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:20.596829 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:20.596829 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:20.596829 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:20.596829 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:20.596829 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:20.596829 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:20.596829 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:20.596829 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:20.596829 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:20.598083 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:25:20.598083 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:25:20.598083 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:20.598083 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:25:20.598083 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 646/1265] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:25:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:20.603222 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461e0346-ea84-431c-b513-abd1b828988f None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:20.683861 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:20.702844 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461e0346-ea84-431c-b513-abd1b828988f None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:20.736331 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3838f09c-a13f-47cf-a666-20410a939f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:20.736983 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3838f09c-a13f-47cf-a666-20410a939f20 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:20.737294 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3838f09c-a13f-47cf-a666-20410a939f20 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:20.737578 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3838f09c-a13f-47cf-a666-20410a939f20 None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:20.738296 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3838f09c-a13f-47cf-a666-20410a939f20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:20.738610 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3838f09c-a13f-47cf-a666-20410a939f20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:20.739982 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3838f09c-a13f-47cf-a666-20410a939f20 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:20.751512 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 620/1266] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Jul 1 19:25:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:20.757218 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b7ad9c-9b28-4b44-a643-32de09cd7aa8 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:20.855746 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b7ad9c-9b28-4b44-a643-32de09cd7aa8 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:20.875480 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:20.890484 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e4ace-e520-4355-bdb3-723a19b7da65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:20.891270 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e4ace-e520-4355-bdb3-723a19b7da65 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:20.891558 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e4ace-e520-4355-bdb3-723a19b7da65 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:20.891838 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e4ace-e520-4355-bdb3-723a19b7da65 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:20.899093 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2e4ace-e520-4355-bdb3-723a19b7da65 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:20.900549 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2e4ace-e520-4355-bdb3-723a19b7da65 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:20.914477 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-5a2e4ace-e520-4355-bdb3-723a19b7da65 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 01 19:25:20.914477 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:20.914477 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:20.914477 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:20.914477 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:20.914477 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:20.914477 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:20.914477 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:20.914477 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:20.914477 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:20.914477 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:20.914477 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:20.914477 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 19:25:20.914477 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 19:25:20.914477 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 19:25:20.914477 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 19:25:20.915942 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:20.915942 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:20.915942 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 19:25:20.915942 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:25:20.915942 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 19:25:20.915942 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:25:20.915942 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:20.915942 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:20.915942 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:20.915942 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:20.915942 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:20.915942 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:20.915942 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:20.915942 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:20.915942 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:20.915942 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:20.915942 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:20.915942 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:20.917114 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:20.917114 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:20.917114 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 19:25:20.917114 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 19:25:20.917114 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 19:25:20.917114 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 19:25:20.917114 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 19:25:20.917114 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 19:25:20.917114 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 01 19:25:20.917114 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:25:20.917114 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 647/1267] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:25:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:20.921434 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3838f09c-a13f-47cf-a666-20410a939f20 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:21.018121 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3838f09c-a13f-47cf-a666-20410a939f20 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:21.051177 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a983e683-8044-4e4d-af7d-88e861afe510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:21.051830 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a983e683-8044-4e4d-af7d-88e861afe510 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:21.052116 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a983e683-8044-4e4d-af7d-88e861afe510 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:21.052392 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a983e683-8044-4e4d-af7d-88e861afe510 None admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:21.053221 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a983e683-8044-4e4d-af7d-88e861afe510 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:21.053562 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a983e683-8044-4e4d-af7d-88e861afe510 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:21.054993 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a983e683-8044-4e4d-af7d-88e861afe510 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:21.064222 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:21.073745 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 621/1268] 10.222.0.26 () {56 vars in 1143 bytes} [Fri Jul 1 19:25:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:21.079306 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e4ace-e520-4355-bdb3-723a19b7da65 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:21.177886 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e4ace-e520-4355-bdb3-723a19b7da65 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:21.211328 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd86ff-1b92-4f66-acbe-d2380506311b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:21.212102 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd86ff-1b92-4f66-acbe-d2380506311b None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:21.212385 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd86ff-1b92-4f66-acbe-d2380506311b None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:21.212659 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd86ff-1b92-4f66-acbe-d2380506311b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:21.222941 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dd86ff-1b92-4f66-acbe-d2380506311b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:21.224387 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dd86ff-1b92-4f66-acbe-d2380506311b None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:21.241572 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-76dd86ff-1b92-4f66-acbe-d2380506311b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:21.241572 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:21.241572 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:21.241572 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:21.241572 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:21.241572 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:21.241572 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:21.241572 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:21.241572 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:21.241572 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:21.241572 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:21.241572 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:21.241572 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:25:21.241572 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:25:21.241572 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:25:21.242651 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:25:21.242651 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:21.242651 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:21.242651 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:21.242651 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:21.242651 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:21.242651 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:21.242651 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:21.242651 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:21.242651 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:21.242651 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:21.242651 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:21.242651 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:21.242651 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:21.242651 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:21.242651 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:21.242651 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:21.244203 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:25:21.244203 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:25:21.244203 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:21.244203 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:25:21.244203 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 648/1269] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:25:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:21.248913 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a983e683-8044-4e4d-af7d-88e861afe510 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:21.355108 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a983e683-8044-4e4d-af7d-88e861afe510 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:21.387811 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab20b169-e3e2-4138-989f-0a5284d4d8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:21.388467 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab20b169-e3e2-4138-989f-0a5284d4d8a6 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:21.388744 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab20b169-e3e2-4138-989f-0a5284d4d8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:21.389020 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab20b169-e3e2-4138-989f-0a5284d4d8a6 None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:21.389760 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab20b169-e3e2-4138-989f-0a5284d4d8a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:21.390067 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab20b169-e3e2-4138-989f-0a5284d4d8a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:21.391426 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab20b169-e3e2-4138-989f-0a5284d4d8a6 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:21.402728 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 622/1270] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Jul 1 19:25:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:21.408343 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd86ff-1b92-4f66-acbe-d2380506311b None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:21.440988 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:21.507091 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd86ff-1b92-4f66-acbe-d2380506311b None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:21.539225 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2c9c26-c865-4493-87a1-c4894b7e079b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:21.540569 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c9c26-c865-4493-87a1-c4894b7e079b None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:21.540848 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c9c26-c865-4493-87a1-c4894b7e079b None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:21.541121 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c9c26-c865-4493-87a1-c4894b7e079b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:21.547547 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2c9c26-c865-4493-87a1-c4894b7e079b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:21.548966 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2c9c26-c865-4493-87a1-c4894b7e079b None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:21.562780 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-bd2c9c26-c865-4493-87a1-c4894b7e079b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:25:21.562780 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:21.562780 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:21.562780 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:21.562780 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:21.562780 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:21.562780 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:21.562780 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:21.562780 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:21.562780 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:21.562780 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:21.562780 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:21.562780 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 19:25:21.562780 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 19:25:21.562780 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 19:25:21.563863 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 19:25:21.563863 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:21.563863 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:21.563863 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:21.563863 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:21.563863 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:21.563863 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:21.563863 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:21.563863 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:21.563863 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:21.563863 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:21.563863 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:21.563863 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:21.563863 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:21.563863 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:21.563863 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:21.563863 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:21.565177 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 19:25:21.565177 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 19:25:21.565177 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 19:25:21.565177 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 19:25:21.565177 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 19:25:21.565177 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 19:25:21.565177 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:25:21.565177 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:25:21.565177 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 649/1271] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Jul 1 19:25:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:21.569702 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab20b169-e3e2-4138-989f-0a5284d4d8a6 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:21.626392 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:21.667408 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab20b169-e3e2-4138-989f-0a5284d4d8a6 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:21.700075 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5060f76-a222-4fb2-9d4b-61adb9a33cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:21.700653 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5060f76-a222-4fb2-9d4b-61adb9a33cc5 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:21.700955 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5060f76-a222-4fb2-9d4b-61adb9a33cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:21.701208 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5060f76-a222-4fb2-9d4b-61adb9a33cc5 None admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:21.702011 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5060f76-a222-4fb2-9d4b-61adb9a33cc5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:21.702320 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5060f76-a222-4fb2-9d4b-61adb9a33cc5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:21.703749 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5060f76-a222-4fb2-9d4b-61adb9a33cc5 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:21.717311 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 623/1272] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Jul 1 19:25:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:21.723379 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2c9c26-c865-4493-87a1-c4894b7e079b None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:21.812794 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:21.821951 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2c9c26-c865-4493-87a1-c4894b7e079b None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:21.855318 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e93614-01e1-4f39-b584-400c9eb1e99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:21.856194 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e93614-01e1-4f39-b584-400c9eb1e99e None admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:21.856481 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e93614-01e1-4f39-b584-400c9eb1e99e None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:21.856761 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e93614-01e1-4f39-b584-400c9eb1e99e None admin] PATH_INFO: `/v3/projects/69c523a41f4048cfb7df553b6feb6310/users/941e65d95bcd4e66a6489280520c12de/roles/6cb03785fb184ef587509b3174622f69` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:21.858748 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e93614-01e1-4f39-b584-400c9eb1e99e None admin] RBAC: Authorizing `identity:create_grant(project_id=69c523a41f4048cfb7df553b6feb6310, user_id=941e65d95bcd4e66a6489280520c12de, role_id=6cb03785fb184ef587509b3174622f69)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:21.860181 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e93614-01e1-4f39-b584-400c9eb1e99e None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:21.872286 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 650/1273] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Jul 1 19:25:21 2022] PUT /identity/v3/projects/69c523a41f4048cfb7df553b6feb6310/users/941e65d95bcd4e66a6489280520c12de/roles/6cb03785fb184ef587509b3174622f69 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:25:23.838552 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a531208-22eb-41a6-a62f-bb0f8dac634d None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:23.839108 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a531208-22eb-41a6-a62f-bb0f8dac634d None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:23.839108 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a531208-22eb-41a6-a62f-bb0f8dac634d None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:23.840488 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 624/1274] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:25:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:25:23.845468 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9047e8-6450-497c-9c4a-cd4e3dada922 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:23.845916 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9047e8-6450-497c-9c4a-cd4e3dada922 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:23.846019 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9047e8-6450-497c-9c4a-cd4e3dada922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:23.862500 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-3c9047e8-6450-497c-9c4a-cd4e3dada922 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:25:23.863684 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-3c9047e8-6450-497c-9c4a-cd4e3dada922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:25:23.928161 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 651/1275] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:25:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:25:23.952673 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a531208-22eb-41a6-a62f-bb0f8dac634d None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:24.050731 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a531208-22eb-41a6-a62f-bb0f8dac634d None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:24.067635 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:24.084005 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87579b2-e92d-41bc-be3b-456b52216dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:24.084786 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87579b2-e92d-41bc-be3b-456b52216dae None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:24.085072 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87579b2-e92d-41bc-be3b-456b52216dae None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:24.085380 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87579b2-e92d-41bc-be3b-456b52216dae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:24.095213 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87579b2-e92d-41bc-be3b-456b52216dae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:25:24.103390 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-d87579b2-e92d-41bc-be3b-456b52216dae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:25:24.103390 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:24.103390 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:24.103390 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:24.103390 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:24.103390 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:24.103390 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:24.103390 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:24.103390 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:24.103390 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:24.103390 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:24.103390 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:24.103390 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:25:24.103390 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:25:24.103390 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:25:24.103390 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:25:24.104575 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:25:24.104575 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:25:24.104575 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:25:24.104575 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:25:24.104575 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:24.104575 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:24.104575 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:24.104575 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:24.104575 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:24.104575 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:24.104575 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:24.104575 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:24.104575 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:24.104575 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:24.104575 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:24.104575 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:24.106013 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:24.106013 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:24.106013 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:24.106013 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:24.106013 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:25:24.106013 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:25:24.106013 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:25:24.106013 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:25:24.106013 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:25:24.106013 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:25:24.106013 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:25:24.106013 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:25:24.106013 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 625/1276] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Jul 1 19:25:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:24.110734 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9047e8-6450-497c-9c4a-cd4e3dada922 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:24.189682 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:24.208497 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9047e8-6450-497c-9c4a-cd4e3dada922 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:24.241739 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5763990f-5049-4224-8e4c-c8bb938e7729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:24.242401 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5763990f-5049-4224-8e4c-c8bb938e7729 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:24.242687 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5763990f-5049-4224-8e4c-c8bb938e7729 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:24.243544 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5763990f-5049-4224-8e4c-c8bb938e7729 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:24.244282 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5763990f-5049-4224-8e4c-c8bb938e7729 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:24.244589 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5763990f-5049-4224-8e4c-c8bb938e7729 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:24.245961 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5763990f-5049-4224-8e4c-c8bb938e7729 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:24.253818 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 652/1277] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Jul 1 19:25:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:24.259432 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87579b2-e92d-41bc-be3b-456b52216dae None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:24.361043 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87579b2-e92d-41bc-be3b-456b52216dae None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:24.393730 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f48aaa-b3e3-4da6-9b87-667e7df4f57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:24.394506 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f48aaa-b3e3-4da6-9b87-667e7df4f57e None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:24.394790 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f48aaa-b3e3-4da6-9b87-667e7df4f57e None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:24.395068 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f48aaa-b3e3-4da6-9b87-667e7df4f57e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:24.405843 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f48aaa-b3e3-4da6-9b87-667e7df4f57e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:24.407288 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f48aaa-b3e3-4da6-9b87-667e7df4f57e None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:24.424328 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-e0f48aaa-b3e3-4da6-9b87-667e7df4f57e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:24.424328 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:24.424328 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:24.424328 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:24.424328 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:24.424328 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:24.424328 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:24.424328 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:24.424328 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:24.424328 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:24.424328 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:24.424328 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:24.424328 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:25:24.424328 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:25:24.424328 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:25:24.425571 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:25:24.425571 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:24.425571 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:24.425571 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:24.425571 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:24.425571 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:24.425571 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:24.425571 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:24.425571 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:24.425571 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:24.425571 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:24.425571 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:24.425571 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:24.425571 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:24.425571 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:24.425571 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:24.425571 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:24.426669 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:25:24.426669 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:25:24.426669 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:24.426669 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:25:24.426669 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 626/1278] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:25:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:24.431708 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5763990f-5049-4224-8e4c-c8bb938e7729 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:24.529311 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5763990f-5049-4224-8e4c-c8bb938e7729 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:24.561932 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5eadff-a1c3-4462-97bb-cc19e2981750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:24.562582 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5eadff-a1c3-4462-97bb-cc19e2981750 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:24.562870 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5eadff-a1c3-4462-97bb-cc19e2981750 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:24.563148 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5eadff-a1c3-4462-97bb-cc19e2981750 None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:24.563860 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5eadff-a1c3-4462-97bb-cc19e2981750 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:24.564171 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5eadff-a1c3-4462-97bb-cc19e2981750 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:24.565550 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5eadff-a1c3-4462-97bb-cc19e2981750 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:24.576867 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 653/1279] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Jul 1 19:25:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:24.582625 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f48aaa-b3e3-4da6-9b87-667e7df4f57e None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:24.613282 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:24.683830 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f48aaa-b3e3-4da6-9b87-667e7df4f57e None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:24.716361 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd481e40-4fea-48c4-965b-d9aefa8d5e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:24.717143 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd481e40-4fea-48c4-965b-d9aefa8d5e8a None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:24.717459 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd481e40-4fea-48c4-965b-d9aefa8d5e8a None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:24.717739 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd481e40-4fea-48c4-965b-d9aefa8d5e8a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:24.725003 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd481e40-4fea-48c4-965b-d9aefa8d5e8a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:24.726498 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd481e40-4fea-48c4-965b-d9aefa8d5e8a None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:24.742242 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-cd481e40-4fea-48c4-965b-d9aefa8d5e8a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 01 19:25:24.742242 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:24.742242 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:24.742242 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:24.742242 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:24.742242 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:24.742242 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:24.742242 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:24.742242 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:24.742242 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:24.742242 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:24.742242 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:24.742242 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 19:25:24.742242 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 19:25:24.742242 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 19:25:24.742242 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 19:25:24.743422 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:24.743422 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:24.743422 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 19:25:24.743422 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:25:24.743422 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 19:25:24.743422 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:25:24.743422 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:24.743422 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:24.743422 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:24.743422 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:24.743422 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:24.743422 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:24.743422 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:24.743422 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:24.743422 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:24.743422 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:24.743422 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:24.743422 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:24.744673 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:24.744673 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:24.744673 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 19:25:24.744673 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 19:25:24.744673 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 19:25:24.744673 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 19:25:24.744673 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 19:25:24.744673 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 19:25:24.744673 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 01 19:25:24.744673 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:25:24.744673 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 627/1280] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:25:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:24.749711 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5eadff-a1c3-4462-97bb-cc19e2981750 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:24.753486 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:24.851201 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5eadff-a1c3-4462-97bb-cc19e2981750 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:24.884574 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e027ca-c98e-446f-9c19-c6501e436032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:24.885255 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e027ca-c98e-446f-9c19-c6501e436032 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:24.885545 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e027ca-c98e-446f-9c19-c6501e436032 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:24.885832 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e027ca-c98e-446f-9c19-c6501e436032 None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:24.886666 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e027ca-c98e-446f-9c19-c6501e436032 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:24.886979 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e027ca-c98e-446f-9c19-c6501e436032 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:24.888494 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e027ca-c98e-446f-9c19-c6501e436032 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:24.905748 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 654/1281] 10.222.0.26 () {56 vars in 1143 bytes} [Fri Jul 1 19:25:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:24.911385 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd481e40-4fea-48c4-965b-d9aefa8d5e8a None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:24.997918 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:25.007357 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd481e40-4fea-48c4-965b-d9aefa8d5e8a None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:25.040946 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b218c-7c8b-4e49-a36c-7a6fe026858e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:25.041610 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b218c-7c8b-4e49-a36c-7a6fe026858e None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:25.041897 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b218c-7c8b-4e49-a36c-7a6fe026858e None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:25.042170 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b218c-7c8b-4e49-a36c-7a6fe026858e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:25.106779 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574b218c-7c8b-4e49-a36c-7a6fe026858e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:25.108154 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574b218c-7c8b-4e49-a36c-7a6fe026858e None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:25.192451 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:25.203018 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 628/1282] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Jul 1 19:25:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 01 19:25:25.208772 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e027ca-c98e-446f-9c19-c6501e436032 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:25.269334 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:25.310299 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e027ca-c98e-446f-9c19-c6501e436032 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:25.343106 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4891c749-46e6-4afd-9080-86807c91ecc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:25.343877 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891c749-46e6-4afd-9080-86807c91ecc0 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:25.344158 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891c749-46e6-4afd-9080-86807c91ecc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:25.344429 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891c749-46e6-4afd-9080-86807c91ecc0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:25.354350 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4891c749-46e6-4afd-9080-86807c91ecc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:25.355769 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4891c749-46e6-4afd-9080-86807c91ecc0 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:25.373019 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-4891c749-46e6-4afd-9080-86807c91ecc0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:25.373019 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:25.373019 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:25.373019 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:25.373019 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:25.373019 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:25.373019 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:25.373019 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:25.373019 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:25.373019 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:25.373019 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:25.373019 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:25.373019 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:25:25.373019 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:25:25.373019 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:25:25.374127 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:25:25.374127 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:25.374127 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:25.374127 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:25.374127 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:25.374127 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:25.374127 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:25.374127 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:25.374127 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:25.374127 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:25.374127 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:25.374127 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:25.374127 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:25.374127 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:25.374127 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:25.374127 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:25.374127 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:25.375310 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:25:25.375310 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:25:25.375310 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:25.375310 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:25:25.375310 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 655/1283] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:25:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:25.379899 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b218c-7c8b-4e49-a36c-7a6fe026858e None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:25.475483 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b218c-7c8b-4e49-a36c-7a6fe026858e None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:25.509027 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7b2cb9-377d-41c3-b457-6eb60aa53b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:25.509698 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b2cb9-377d-41c3-b457-6eb60aa53b6c None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:25.509983 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b2cb9-377d-41c3-b457-6eb60aa53b6c None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:25.510261 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b2cb9-377d-41c3-b457-6eb60aa53b6c None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:25.510970 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7b2cb9-377d-41c3-b457-6eb60aa53b6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:25.511276 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7b2cb9-377d-41c3-b457-6eb60aa53b6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:25.512633 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7b2cb9-377d-41c3-b457-6eb60aa53b6c None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:25.524161 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 629/1284] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Jul 1 19:25:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:25.529786 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4891c749-46e6-4afd-9080-86807c91ecc0 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:25.629903 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4891c749-46e6-4afd-9080-86807c91ecc0 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:25.643716 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:25.663381 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f1544b-9cb6-490f-be84-deaa26711ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:25.664163 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f1544b-9cb6-490f-be84-deaa26711ac8 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:25.664441 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f1544b-9cb6-490f-be84-deaa26711ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:25.665202 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f1544b-9cb6-490f-be84-deaa26711ac8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:25.671673 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f1544b-9cb6-490f-be84-deaa26711ac8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:25.673087 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f1544b-9cb6-490f-be84-deaa26711ac8 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:25.687247 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-a8f1544b-9cb6-490f-be84-deaa26711ac8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:25:25.687247 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:25.687247 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:25.687247 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:25.687247 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:25.687247 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:25.687247 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:25.687247 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:25.687247 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:25.687247 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:25.687247 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:25.687247 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:25.687247 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 19:25:25.687247 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 19:25:25.687247 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 19:25:25.688330 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 19:25:25.688330 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:25.688330 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:25.688330 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:25.688330 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:25.688330 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:25.688330 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:25.688330 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:25.688330 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:25.688330 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:25.688330 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:25.688330 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:25.688330 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:25.688330 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:25.688330 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:25.688330 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:25.688330 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:25.689569 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 19:25:25.689569 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 19:25:25.689569 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 19:25:25.689569 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 19:25:25.689569 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 19:25:25.689569 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 19:25:25.689569 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:25:25.689569 dv-cinder-844601-7-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 01 19:25:25.689569 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 656/1285] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Jul 1 19:25:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:25.694221 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7b2cb9-377d-41c3-b457-6eb60aa53b6c None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:25.749636 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:25.798227 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7b2cb9-377d-41c3-b457-6eb60aa53b6c None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:25.831307 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044a04e9-6bb2-4317-b7bb-f051427174b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:25.831947 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044a04e9-6bb2-4317-b7bb-f051427174b4 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:25.832230 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044a04e9-6bb2-4317-b7bb-f051427174b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:25.832504 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044a04e9-6bb2-4317-b7bb-f051427174b4 None admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:25.833295 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044a04e9-6bb2-4317-b7bb-f051427174b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:25.833607 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044a04e9-6bb2-4317-b7bb-f051427174b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:25.835030 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044a04e9-6bb2-4317-b7bb-f051427174b4 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:25.846606 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 630/1286] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Jul 1 19:25:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:25.853170 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f1544b-9cb6-490f-be84-deaa26711ac8 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:25.951790 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f1544b-9cb6-490f-be84-deaa26711ac8 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:25.985318 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f9264d-5b86-47b0-8943-53443baa79fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:25.985965 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9264d-5b86-47b0-8943-53443baa79fb None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:25.986254 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9264d-5b86-47b0-8943-53443baa79fb None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:25.986535 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9264d-5b86-47b0-8943-53443baa79fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:25.987362 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f9264d-5b86-47b0-8943-53443baa79fb None admin] RBAC: Adding query filter params (role.id=6cb03785fb184ef587509b3174622f69, scope.project.id=69c523a41f4048cfb7df553b6feb6310, user.id=941e65d95bcd4e66a6489280520c12de) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:25.987678 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f9264d-5b86-47b0-8943-53443baa79fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:25.989090 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f9264d-5b86-47b0-8943-53443baa79fb None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:25.994924 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 657/1287] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Jul 1 19:25:25 2022] GET /identity/v3/role_assignments?user.id=941e65d95bcd4e66a6489280520c12de&scope.project.id=69c523a41f4048cfb7df553b6feb6310&role.id=6cb03785fb184ef587509b3174622f69 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:28.048275 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c042fcd-ad94-44c3-af43-218d74157569 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:28.048799 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c042fcd-ad94-44c3-af43-218d74157569 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:28.048799 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c042fcd-ad94-44c3-af43-218d74157569 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:28.050410 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 631/1288] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:25:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:25:28.055565 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c1cf9-b0ca-49ce-80c9-5822407ae6a8 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:28.055970 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c1cf9-b0ca-49ce-80c9-5822407ae6a8 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:28.056125 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c1cf9-b0ca-49ce-80c9-5822407ae6a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:28.073086 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-7e1c1cf9-b0ca-49ce-80c9-5822407ae6a8 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:25:28.074294 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-7e1c1cf9-b0ca-49ce-80c9-5822407ae6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:25:28.103546 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:28.140835 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 658/1289] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:25:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:25:28.164293 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c042fcd-ad94-44c3-af43-218d74157569 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:28.263316 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c042fcd-ad94-44c3-af43-218d74157569 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:28.273888 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:28.307639 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb85e91a-2f87-4e30-9467-66d0fbe32443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:28.308600 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb85e91a-2f87-4e30-9467-66d0fbe32443 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:28.308950 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb85e91a-2f87-4e30-9467-66d0fbe32443 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:28.309349 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb85e91a-2f87-4e30-9467-66d0fbe32443 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:28.310236 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb85e91a-2f87-4e30-9467-66d0fbe32443 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:28.312141 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb85e91a-2f87-4e30-9467-66d0fbe32443 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:28.328553 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-cb85e91a-2f87-4e30-9467-66d0fbe32443 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 01 19:25:28.328553 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:28.328553 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 19:25:28.328553 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 19:25:28.328553 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 19:25:28.328553 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 19:25:28.328553 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 19:25:28.328553 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:25:28.328553 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 01 19:25:28.328553 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:25:28.328553 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 19:25:28.328553 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:25:28.328553 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:28.328553 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:28.328553 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:28.328553 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:28.328553 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:28.329686 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:28.329686 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:28.329686 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:28.329686 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:28.329686 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:28.329686 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:28.329686 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 19:25:28.329686 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 19:25:28.329686 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 19:25:28.329686 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 19:25:28.329686 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:28.329686 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:28.329686 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:28.329686 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:28.329686 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:28.329686 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:28.330554 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:28.330554 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:28.330554 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:28.330554 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:28.330554 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:28.330554 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:28.330554 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:28.330554 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:28.330554 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:28.330554 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:28.330554 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 19:25:28.330554 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:25:28.330554 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 01 19:25:28.330554 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:25:28.330554 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 632/1290] 10.222.0.26 () {56 vars in 1117 bytes} [Fri Jul 1 19:25:28 2022] GET /identity/v3/services/placement => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:28.337413 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c1cf9-b0ca-49ce-80c9-5822407ae6a8 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:28.438131 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c1cf9-b0ca-49ce-80c9-5822407ae6a8 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:28.471706 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51856a5-a253-401e-b918-8b53063dfc92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:28.472362 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51856a5-a253-401e-b918-8b53063dfc92 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:28.472644 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51856a5-a253-401e-b918-8b53063dfc92 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:28.472919 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51856a5-a253-401e-b918-8b53063dfc92 None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:28.473651 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51856a5-a253-401e-b918-8b53063dfc92 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:28.473958 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51856a5-a253-401e-b918-8b53063dfc92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:28.475320 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51856a5-a253-401e-b918-8b53063dfc92 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:28.480266 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 659/1291] 10.222.0.26 () {56 vars in 1116 bytes} [Fri Jul 1 19:25:28 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:25:28.486224 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb85e91a-2f87-4e30-9467-66d0fbe32443 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:28.583129 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb85e91a-2f87-4e30-9467-66d0fbe32443 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:28.616050 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2859f398-38e7-4cd5-9124-2b3a7c0ab9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:28.616688 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2859f398-38e7-4cd5-9124-2b3a7c0ab9fa None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:28.616970 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2859f398-38e7-4cd5-9124-2b3a7c0ab9fa None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:28.617267 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2859f398-38e7-4cd5-9124-2b3a7c0ab9fa None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:28.618478 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2859f398-38e7-4cd5-9124-2b3a7c0ab9fa None admin] RBAC: Adding query filter params (type=placement) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:28.618782 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2859f398-38e7-4cd5-9124-2b3a7c0ab9fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:28.620145 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2859f398-38e7-4cd5-9124-2b3a7c0ab9fa None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:28.624693 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 633/1292] 10.222.0.26 () {56 vars in 1116 bytes} [Fri Jul 1 19:25:28 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:30.613382 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca05575-438f-434f-9720-7829f193330e None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:30.613948 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca05575-438f-434f-9720-7829f193330e None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:30.613948 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca05575-438f-434f-9720-7829f193330e None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:30.615365 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 660/1293] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:25:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:25:30.620364 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b19721-507e-45b5-aa47-1ab2c686e48e None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:30.620800 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b19721-507e-45b5-aa47-1ab2c686e48e None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:30.620936 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b19721-507e-45b5-aa47-1ab2c686e48e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:30.637955 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-e5b19721-507e-45b5-aa47-1ab2c686e48e None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:25:30.639125 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-e5b19721-507e-45b5-aa47-1ab2c686e48e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:25:30.668345 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:30.704913 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 634/1294] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:25:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:25:30.728001 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca05575-438f-434f-9720-7829f193330e None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:30.759699 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:30.830157 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca05575-438f-434f-9720-7829f193330e None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:30.863589 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977331a1-791b-4bbc-9cbc-c2a0c3e4e417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:30.864181 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977331a1-791b-4bbc-9cbc-c2a0c3e4e417 None admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:30.864469 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977331a1-791b-4bbc-9cbc-c2a0c3e4e417 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:30.864757 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977331a1-791b-4bbc-9cbc-c2a0c3e4e417 None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:30.865524 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977331a1-791b-4bbc-9cbc-c2a0c3e4e417 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:30.866889 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977331a1-791b-4bbc-9cbc-c2a0c3e4e417 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:30.881165 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 661/1295] 10.222.0.26 () {60 vars in 1141 bytes} [Fri Jul 1 19:25:30 2022] POST /identity/v3/services => generated 246 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:25:32.904626 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e56a9-de4c-4ff4-b5f6-d47e49bb29c1 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:32.905159 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e56a9-de4c-4ff4-b5f6-d47e49bb29c1 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:32.905159 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e56a9-de4c-4ff4-b5f6-d47e49bb29c1 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:32.906488 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 635/1296] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:25:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:25:32.911528 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36bcf4f-df22-485e-8692-fb06c0033137 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:32.911912 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36bcf4f-df22-485e-8692-fb06c0033137 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:32.912094 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36bcf4f-df22-485e-8692-fb06c0033137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:32.929055 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-f36bcf4f-df22-485e-8692-fb06c0033137 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:25:32.930383 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-f36bcf4f-df22-485e-8692-fb06c0033137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:25:33.001738 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 662/1297] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:25:32 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:25:33.025642 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401e56a9-de4c-4ff4-b5f6-d47e49bb29c1 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:33.125091 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401e56a9-de4c-4ff4-b5f6-d47e49bb29c1 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:33.158397 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7a213b-bcc2-4d95-85f6-89a3ae44cfd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:33.159110 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a213b-bcc2-4d95-85f6-89a3ae44cfd1 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:33.159394 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a213b-bcc2-4d95-85f6-89a3ae44cfd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:33.159668 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a213b-bcc2-4d95-85f6-89a3ae44cfd1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:33.160312 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7a213b-bcc2-4d95-85f6-89a3ae44cfd1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:33.161708 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7a213b-bcc2-4d95-85f6-89a3ae44cfd1 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:33.173138 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-6b7a213b-bcc2-4d95-85f6-89a3ae44cfd1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 01 19:25:33.173138 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:33.173138 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 19:25:33.173138 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 19:25:33.173138 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 19:25:33.173138 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 19:25:33.173138 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 19:25:33.173138 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:25:33.173138 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 01 19:25:33.173138 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:25:33.173138 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 19:25:33.173138 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:25:33.173138 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:33.173138 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:33.173138 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:33.173138 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:33.173138 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:33.174569 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:33.174569 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:33.174569 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:33.174569 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:33.174569 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:33.174569 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:33.174569 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 19:25:33.174569 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 19:25:33.174569 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 19:25:33.174569 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 19:25:33.174569 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:33.174569 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:33.174569 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:33.174569 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:33.174569 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:33.174569 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:33.175814 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:33.175814 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:33.175814 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:33.175814 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:33.175814 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:33.175814 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:33.175814 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:33.175814 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:33.175814 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:33.175814 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:33.175814 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 19:25:33.175814 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:25:33.175814 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 01 19:25:33.175814 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:25:33.175814 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 636/1298] 10.222.0.26 () {56 vars in 1117 bytes} [Fri Jul 1 19:25:33 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:33.181121 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36bcf4f-df22-485e-8692-fb06c0033137 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:33.199729 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:33.281289 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36bcf4f-df22-485e-8692-fb06c0033137 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:33.324329 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0125cf5-bdfd-4424-951b-0833f9b664ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:33.325312 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0125cf5-bdfd-4424-951b-0833f9b664ed None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:33.325682 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0125cf5-bdfd-4424-951b-0833f9b664ed None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:33.326135 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0125cf5-bdfd-4424-951b-0833f9b664ed None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:33.327074 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0125cf5-bdfd-4424-951b-0833f9b664ed None admin] RBAC: Adding query filter params (name=placement) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:33.327451 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0125cf5-bdfd-4424-951b-0833f9b664ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:33.329228 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0125cf5-bdfd-4424-951b-0833f9b664ed None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:33.335321 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 663/1299] 10.222.0.26 () {56 vars in 1116 bytes} [Fri Jul 1 19:25:33 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:33.341755 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7a213b-bcc2-4d95-85f6-89a3ae44cfd1 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:33.373946 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:33.441611 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7a213b-bcc2-4d95-85f6-89a3ae44cfd1 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:33.474627 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475633fc-7b1f-4d59-86fd-53eefd8482c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:33.475320 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475633fc-7b1f-4d59-86fd-53eefd8482c0 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:33.475565 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475633fc-7b1f-4d59-86fd-53eefd8482c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:33.475844 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475633fc-7b1f-4d59-86fd-53eefd8482c0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:33.476633 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475633fc-7b1f-4d59-86fd-53eefd8482c0 None admin] RBAC: Adding query filter params (interface=public, service_id=0c7043f8c9a94b74a2761ce78c08d002, region_id=RegionOne) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:33.477490 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475633fc-7b1f-4d59-86fd-53eefd8482c0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:33.478865 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475633fc-7b1f-4d59-86fd-53eefd8482c0 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:33.483930 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 637/1300] 10.222.0.26 () {56 vars in 1251 bytes} [Fri Jul 1 19:25:33 2022] GET /identity/v3/endpoints?service_id=0c7043f8c9a94b74a2761ce78c08d002&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:33.489616 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0125cf5-bdfd-4424-951b-0833f9b664ed None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:33.570896 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:33.590263 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0125cf5-bdfd-4424-951b-0833f9b664ed None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:33.623849 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f22c17-2dc9-49d6-96b7-c1bb429df3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:33.624515 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f22c17-2dc9-49d6-96b7-c1bb429df3f6 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:33.624806 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f22c17-2dc9-49d6-96b7-c1bb429df3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:33.625077 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f22c17-2dc9-49d6-96b7-c1bb429df3f6 None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:33.625794 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f22c17-2dc9-49d6-96b7-c1bb429df3f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:33.627159 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f22c17-2dc9-49d6-96b7-c1bb429df3f6 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:33.634796 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 664/1301] 10.222.0.26 () {56 vars in 1087 bytes} [Fri Jul 1 19:25:33 2022] GET /identity/v3/services => generated 2191 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:25:35.666934 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98becd0c-fb9e-42bd-a050-e550a80acbe7 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:35.667467 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98becd0c-fb9e-42bd-a050-e550a80acbe7 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:35.667563 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98becd0c-fb9e-42bd-a050-e550a80acbe7 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:35.668874 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 638/1302] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:25:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:25:35.674676 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c0c2b-bd60-4d4a-8531-605622cbb7b3 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:35.675086 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c0c2b-bd60-4d4a-8531-605622cbb7b3 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:35.675235 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c0c2b-bd60-4d4a-8531-605622cbb7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:35.692655 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-401c0c2b-bd60-4d4a-8531-605622cbb7b3 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:25:35.693856 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-401c0c2b-bd60-4d4a-8531-605622cbb7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:25:35.760052 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 665/1303] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:25:35 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:25:35.782779 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98becd0c-fb9e-42bd-a050-e550a80acbe7 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:35.878937 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:35.885995 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98becd0c-fb9e-42bd-a050-e550a80acbe7 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:35.919104 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ad083f-adb5-499b-90e0-a7a9f37111b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:35.919801 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad083f-adb5-499b-90e0-a7a9f37111b8 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:35.920088 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad083f-adb5-499b-90e0-a7a9f37111b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:35.920365 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad083f-adb5-499b-90e0-a7a9f37111b8 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:35.921016 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ad083f-adb5-499b-90e0-a7a9f37111b8 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:35.922433 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ad083f-adb5-499b-90e0-a7a9f37111b8 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:35.934955 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-78ad083f-adb5-499b-90e0-a7a9f37111b8 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 01 19:25:35.934955 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:35.934955 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 19:25:35.934955 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 19:25:35.934955 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 19:25:35.934955 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 19:25:35.934955 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 19:25:35.934955 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:25:35.934955 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 01 19:25:35.934955 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:25:35.934955 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 19:25:35.934955 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:25:35.934955 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:35.934955 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:35.934955 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:35.934955 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:35.934955 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:35.936145 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:35.936145 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:35.936145 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:35.936145 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:35.936145 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:35.936145 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:35.936145 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 19:25:35.936145 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 19:25:35.936145 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 19:25:35.936145 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 19:25:35.936145 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:35.936145 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:35.936145 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:35.936145 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:35.936145 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:35.936145 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:35.937005 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:35.937005 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:35.937005 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:35.937005 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:35.937005 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:35.937005 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:35.937005 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:35.937005 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:35.937005 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:35.937005 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:35.937005 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 19:25:35.937005 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:25:35.937005 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 01 19:25:35.937005 dv-cinder-844601-7-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 01 19:25:35.937005 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 639/1304] 10.222.0.26 () {56 vars in 1117 bytes} [Fri Jul 1 19:25:35 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:35.942180 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401c0c2b-bd60-4d4a-8531-605622cbb7b3 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:36.016742 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:36.039808 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401c0c2b-bd60-4d4a-8531-605622cbb7b3 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:36.072948 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e0626-ed97-4ed3-bf99-00422ddb3df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:36.073637 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e0626-ed97-4ed3-bf99-00422ddb3df0 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:36.073927 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e0626-ed97-4ed3-bf99-00422ddb3df0 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:36.074208 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e0626-ed97-4ed3-bf99-00422ddb3df0 None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:36.075070 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2e0626-ed97-4ed3-bf99-00422ddb3df0 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:36.075393 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2e0626-ed97-4ed3-bf99-00422ddb3df0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:36.076761 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2e0626-ed97-4ed3-bf99-00422ddb3df0 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:36.081861 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 666/1305] 10.222.0.26 () {56 vars in 1116 bytes} [Fri Jul 1 19:25:35 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:36.087540 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ad083f-adb5-499b-90e0-a7a9f37111b8 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:36.185849 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ad083f-adb5-499b-90e0-a7a9f37111b8 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:36.218511 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb16deb-edde-428c-898c-5ec2375a12df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:36.219151 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb16deb-edde-428c-898c-5ec2375a12df None admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:36.219441 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb16deb-edde-428c-898c-5ec2375a12df None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:36.219721 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb16deb-edde-428c-898c-5ec2375a12df None admin] PATH_INFO: `/v3/endpoints` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:36.220460 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb16deb-edde-428c-898c-5ec2375a12df None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:36.221864 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb16deb-edde-428c-898c-5ec2375a12df None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:36.240542 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 640/1306] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Jul 1 19:25:36 2022] POST /identity/v3/endpoints => generated 331 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:25:46.078968 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=30 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:46.236340 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:39.339387 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac942c4-9122-4657-b5c6-20942d2441c3 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:39.339923 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac942c4-9122-4657-b5c6-20942d2441c3 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:39.339923 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac942c4-9122-4657-b5c6-20942d2441c3 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:39.341907 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 667/1307] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:26:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:26:39.347504 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae0ec9-db5e-4af3-aded-16618f259439 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:39.348011 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae0ec9-db5e-4af3-aded-16618f259439 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:39.348107 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae0ec9-db5e-4af3-aded-16618f259439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:39.430844 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-47ae0ec9-db5e-4af3-aded-16618f259439 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:26:39.432078 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-47ae0ec9-db5e-4af3-aded-16618f259439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:26:39.633046 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 641/1308] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:26:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:26:39.703180 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d76d2-4fe3-44d4-b1b3-612ee11520ab None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:39.703476 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d76d2-4fe3-44d4-b1b3-612ee11520ab None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:39.703767 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d76d2-4fe3-44d4-b1b3-612ee11520ab None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:39.705158 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 668/1309] 10.222.0.26 () {54 vars in 964 bytes} [Fri Jul 1 19:26:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:26:39.711309 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e455728-3dd2-439b-a925-c48d7172c36e None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:39.711621 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e455728-3dd2-439b-a925-c48d7172c36e None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:39.711881 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e455728-3dd2-439b-a925-c48d7172c36e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:39.870465 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-2e455728-3dd2-439b-a925-c48d7172c36e None None] MFA Rules not processed for user `4557d17438a249ee8f75927449a1a059`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:26:39.872089 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-2e455728-3dd2-439b-a925-c48d7172c36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:26:39.899077 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:40.002447 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 642/1310] 10.222.0.26 () {58 vars in 1061 bytes} [Fri Jul 1 19:26:39 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:26:40.011139 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8d76d2-4fe3-44d4-b1b3-612ee11520ab None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:40.013168 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-1b8d76d2-4fe3-44d4-b1b3-612ee11520ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:26:40.142341 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8d76d2-4fe3-44d4-b1b3-612ee11520ab None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:40.228369 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e6ee64-363a-403c-8950-d11d2dcddcca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:40.229071 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e6ee64-363a-403c-8950-d11d2dcddcca service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:40.229385 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e6ee64-363a-403c-8950-d11d2dcddcca service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:40.229666 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e6ee64-363a-403c-8950-d11d2dcddcca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:40.231426 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-06e6ee64-363a-403c-8950-d11d2dcddcca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:26:40.300647 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:40.366148 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e6ee64-363a-403c-8950-d11d2dcddcca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:40.367811 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e6ee64-363a-403c-8950-d11d2dcddcca service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:40.389218 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 669/1311] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:26:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 19:26:42.764861 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb8075-66d7-47d1-940b-7a242da49f2a None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:42.765424 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb8075-66d7-47d1-940b-7a242da49f2a None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:42.765424 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb8075-66d7-47d1-940b-7a242da49f2a None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:42.766908 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 643/1312] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:26:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:26:42.772319 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050dcfe-e71b-4b71-b297-7a42cf8d60b2 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:42.772802 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050dcfe-e71b-4b71-b297-7a42cf8d60b2 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:42.772922 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050dcfe-e71b-4b71-b297-7a42cf8d60b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:42.856156 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-d050dcfe-e71b-4b71-b297-7a42cf8d60b2 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:26:42.857388 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-d050dcfe-e71b-4b71-b297-7a42cf8d60b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:26:42.962175 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 670/1313] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:26:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:26:43.016907 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aa2019-332e-419c-b11b-7df51fa8b2cf None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:43.017207 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aa2019-332e-419c-b11b-7df51fa8b2cf None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:43.017533 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aa2019-332e-419c-b11b-7df51fa8b2cf None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:43.018920 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 644/1314] 10.222.0.26 () {54 vars in 964 bytes} [Fri Jul 1 19:26:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:26:43.025511 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c0a77d-8cbf-45ff-858d-79113eae2f11 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:43.025831 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c0a77d-8cbf-45ff-858d-79113eae2f11 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:43.026208 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c0a77d-8cbf-45ff-858d-79113eae2f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:43.036993 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:43.102525 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-a8c0a77d-8cbf-45ff-858d-79113eae2f11 None None] MFA Rules not processed for user `4557d17438a249ee8f75927449a1a059`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:26:43.103709 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-a8c0a77d-8cbf-45ff-858d-79113eae2f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:26:43.178306 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 671/1315] 10.222.0.26 () {58 vars in 1061 bytes} [Fri Jul 1 19:26:43 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:26:43.188459 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aa2019-332e-419c-b11b-7df51fa8b2cf None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:43.190062 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-21aa2019-332e-419c-b11b-7df51fa8b2cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:26:43.298753 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aa2019-332e-419c-b11b-7df51fa8b2cf None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:43.370832 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:43.373805 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d82a8c-1ddb-4112-bace-9a47730c4f21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:43.374723 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d82a8c-1ddb-4112-bace-9a47730c4f21 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:43.375059 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d82a8c-1ddb-4112-bace-9a47730c4f21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:43.375477 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d82a8c-1ddb-4112-bace-9a47730c4f21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:43.377356 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-50d82a8c-1ddb-4112-bace-9a47730c4f21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:26:43.485887 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d82a8c-1ddb-4112-bace-9a47730c4f21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:43.487330 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d82a8c-1ddb-4112-bace-9a47730c4f21 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:43.504774 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 645/1316] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:26:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:26:46.080939 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa9167-3d5b-43f7-bb47-92e5c348b28e None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:46.081491 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa9167-3d5b-43f7-bb47-92e5c348b28e None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:46.081491 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa9167-3d5b-43f7-bb47-92e5c348b28e None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:46.082847 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 672/1317] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:26:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:26:46.088315 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c3efa0-7a4d-49b3-9e34-a9eea14d6f79 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:46.088732 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c3efa0-7a4d-49b3-9e34-a9eea14d6f79 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:46.088885 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c3efa0-7a4d-49b3-9e34-a9eea14d6f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:46.153577 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-b8c3efa0-7a4d-49b3-9e34-a9eea14d6f79 None None] MFA Rules not processed for user `076da96929604363947a23159f348388`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:26:46.154778 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-b8c3efa0-7a4d-49b3-9e34-a9eea14d6f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:26:46.206977 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:46.251990 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 646/1318] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:26:46 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:26:46.292187 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fa9167-3d5b-43f7-bb47-92e5c348b28e None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:46.293786 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-e2fa9167-3d5b-43f7-bb47-92e5c348b28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:26:46.396435 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fa9167-3d5b-43f7-bb47-92e5c348b28e None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:46.399796 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:46.471304 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25104388-5a8c-4054-ae56-9cc20ec9613a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:46.471954 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25104388-5a8c-4054-ae56-9cc20ec9613a service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:46.472242 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25104388-5a8c-4054-ae56-9cc20ec9613a service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:46.472526 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25104388-5a8c-4054-ae56-9cc20ec9613a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:46.474230 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-25104388-5a8c-4054-ae56-9cc20ec9613a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:26:46.581002 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25104388-5a8c-4054-ae56-9cc20ec9613a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:46.582460 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25104388-5a8c-4054-ae56-9cc20ec9613a service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:46.614045 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 673/1319] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:26:46 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:26:49.187005 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ecedf-ca43-4c72-a0d2-3200b715a075 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:49.187573 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ecedf-ca43-4c72-a0d2-3200b715a075 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:49.187573 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ecedf-ca43-4c72-a0d2-3200b715a075 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:49.188945 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 647/1320] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:26:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 19:26:49.193942 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f1e4f-d9fa-4faa-bc9a-45998dcc915f None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:49.194350 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f1e4f-d9fa-4faa-bc9a-45998dcc915f None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:49.194507 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f1e4f-d9fa-4faa-bc9a-45998dcc915f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:49.234075 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:49.258676 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-ed3f1e4f-d9fa-4faa-bc9a-45998dcc915f None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:26:49.259943 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-ed3f1e4f-d9fa-4faa-bc9a-45998dcc915f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:26:49.357697 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 674/1321] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:26:49 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:26:49.395730 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0ecedf-ca43-4c72-a0d2-3200b715a075 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:49.397779 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-0a0ecedf-ca43-4c72-a0d2-3200b715a075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:26:49.502130 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0ecedf-ca43-4c72-a0d2-3200b715a075 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:49.574972 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58715d38-8e3e-41ff-8439-62cbb83e563b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:49.575610 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58715d38-8e3e-41ff-8439-62cbb83e563b service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:49.575891 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58715d38-8e3e-41ff-8439-62cbb83e563b service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:49.576170 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58715d38-8e3e-41ff-8439-62cbb83e563b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:49.577843 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-58715d38-8e3e-41ff-8439-62cbb83e563b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:26:49.586323 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:49.687798 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58715d38-8e3e-41ff-8439-62cbb83e563b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:49.689247 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58715d38-8e3e-41ff-8439-62cbb83e563b service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:49.707467 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 648/1322] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:26:49 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:26:52.450999 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b575284a-541f-4b99-85b2-933b3de0dfe4 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:52.451616 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b575284a-541f-4b99-85b2-933b3de0dfe4 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:52.451616 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b575284a-541f-4b99-85b2-933b3de0dfe4 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:52.452947 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 675/1323] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:26:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:26:52.458180 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da0230-2621-4231-b1a8-4599afbb640f None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:52.458646 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da0230-2621-4231-b1a8-4599afbb640f None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:52.458749 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da0230-2621-4231-b1a8-4599afbb640f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:52.525371 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-48da0230-2621-4231-b1a8-4599afbb640f None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:26:52.526563 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-48da0230-2621-4231-b1a8-4599afbb640f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:26:52.589433 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:52.636975 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 649/1324] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:26:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:26:52.673698 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b575284a-541f-4b99-85b2-933b3de0dfe4 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:52.675310 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-b575284a-541f-4b99-85b2-933b3de0dfe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:26:52.793420 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b575284a-541f-4b99-85b2-933b3de0dfe4 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:52.807611 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:52.889439 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe1ec18-fb55-4dfe-8654-c46aef7bfb27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:52.890135 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1ec18-fb55-4dfe-8654-c46aef7bfb27 service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:52.890423 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1ec18-fb55-4dfe-8654-c46aef7bfb27 service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:52.890799 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1ec18-fb55-4dfe-8654-c46aef7bfb27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:52.893211 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-8fe1ec18-fb55-4dfe-8654-c46aef7bfb27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:26:53.015763 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe1ec18-fb55-4dfe-8654-c46aef7bfb27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:53.017074 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe1ec18-fb55-4dfe-8654-c46aef7bfb27 service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:53.038015 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 676/1325] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:26:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:26:55.153165 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b28c7-8301-43c1-be33-3dbedd05b0b5 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:55.153708 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b28c7-8301-43c1-be33-3dbedd05b0b5 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:55.153708 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b28c7-8301-43c1-be33-3dbedd05b0b5 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:55.155122 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 650/1326] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:26:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:26:55.160630 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb31e2-ada0-4819-9b49-5227789967cf None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:55.161076 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb31e2-ada0-4819-9b49-5227789967cf None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:55.161176 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb31e2-ada0-4819-9b49-5227789967cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:55.207569 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:55.226564 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-99cb31e2-ada0-4819-9b49-5227789967cf None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:26:55.227794 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-99cb31e2-ada0-4819-9b49-5227789967cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:26:55.325964 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 677/1327] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:26:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:26:55.362143 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70b28c7-8301-43c1-be33-3dbedd05b0b5 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:55.363675 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-a70b28c7-8301-43c1-be33-3dbedd05b0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:26:55.472696 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70b28c7-8301-43c1-be33-3dbedd05b0b5 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:55.552094 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7357c082-f969-44c8-98e1-74010ac47f3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:55.552751 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357c082-f969-44c8-98e1-74010ac47f3d service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:55.553037 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357c082-f969-44c8-98e1-74010ac47f3d service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:55.553347 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357c082-f969-44c8-98e1-74010ac47f3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:55.555076 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-7357c082-f969-44c8-98e1-74010ac47f3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:26:55.572190 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:55.668700 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7357c082-f969-44c8-98e1-74010ac47f3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:55.670369 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7357c082-f969-44c8-98e1-74010ac47f3d service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:55.688904 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 651/1328] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:26:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:26:57.798648 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c0744-4310-4aa3-9b87-20709fefbff2 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:57.799212 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c0744-4310-4aa3-9b87-20709fefbff2 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:57.799212 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c0744-4310-4aa3-9b87-20709fefbff2 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:57.800587 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 678/1329] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:26:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:26:57.805950 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffff216-32da-4b76-8a80-b147323d2504 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:57.806518 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffff216-32da-4b76-8a80-b147323d2504 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:57.806518 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffff216-32da-4b76-8a80-b147323d2504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:57.874675 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-bffff216-32da-4b76-8a80-b147323d2504 None None] MFA Rules not processed for user `076da96929604363947a23159f348388`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:26:57.875916 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-bffff216-32da-4b76-8a80-b147323d2504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:26:57.946002 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:57.979165 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 652/1330] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:26:57 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:26:58.015997 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c0744-4310-4aa3-9b87-20709fefbff2 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:58.017579 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-053c0744-4310-4aa3-9b87-20709fefbff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:26:58.121215 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c0744-4310-4aa3-9b87-20709fefbff2 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:58.143958 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:58.199214 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52248f99-af14-49b0-96c7-71be680f1308 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:58.199861 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52248f99-af14-49b0-96c7-71be680f1308 service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:58.200149 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52248f99-af14-49b0-96c7-71be680f1308 service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:58.200429 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52248f99-af14-49b0-96c7-71be680f1308 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:58.202114 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-52248f99-af14-49b0-96c7-71be680f1308 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:26:58.322498 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52248f99-af14-49b0-96c7-71be680f1308 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:58.324180 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52248f99-af14-49b0-96c7-71be680f1308 service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:58.344939 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 679/1331] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:26:58 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:27:00.648684 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ab7f3-62d4-489f-99a5-323f3f43df90 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:00.649163 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ab7f3-62d4-489f-99a5-323f3f43df90 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:00.649313 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ab7f3-62d4-489f-99a5-323f3f43df90 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:00.650658 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 653/1332] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:27:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:27:00.655863 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ca58ac-c6f2-4cb9-9f17-cde87d9b55da None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:00.656283 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ca58ac-c6f2-4cb9-9f17-cde87d9b55da None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:00.656424 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ca58ac-c6f2-4cb9-9f17-cde87d9b55da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:00.718159 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:27:00.720759 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-86ca58ac-c6f2-4cb9-9f17-cde87d9b55da None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:27:00.722598 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-86ca58ac-c6f2-4cb9-9f17-cde87d9b55da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:27:00.820257 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 680/1333] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:27:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:27:00.857127 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5ab7f3-62d4-489f-99a5-323f3f43df90 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:27:00.858686 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-1c5ab7f3-62d4-489f-99a5-323f3f43df90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:27:00.961430 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5ab7f3-62d4-489f-99a5-323f3f43df90 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:27:01.035865 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff263c79-acf6-46f9-9f66-4c934b015773 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:27:01.036515 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff263c79-acf6-46f9-9f66-4c934b015773 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:01.036801 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff263c79-acf6-46f9-9f66-4c934b015773 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:01.037133 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff263c79-acf6-46f9-9f66-4c934b015773 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:01.038822 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-ff263c79-acf6-46f9-9f66-4c934b015773 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:27:01.065528 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:27:01.148221 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff263c79-acf6-46f9-9f66-4c934b015773 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:27:01.149732 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff263c79-acf6-46f9-9f66-4c934b015773 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:27:01.167871 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 654/1334] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:27:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:27:03.239669 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37037eb1-3631-4f1a-923f-78f8557e83ad None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:03.240287 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37037eb1-3631-4f1a-923f-78f8557e83ad None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:03.240287 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37037eb1-3631-4f1a-923f-78f8557e83ad None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:03.241689 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 681/1335] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:27:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:27:03.247664 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fbaff5-6d8d-433b-81ac-07c4e81d3fa9 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:03.248183 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fbaff5-6d8d-433b-81ac-07c4e81d3fa9 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:03.248291 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fbaff5-6d8d-433b-81ac-07c4e81d3fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:03.318469 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-63fbaff5-6d8d-433b-81ac-07c4e81d3fa9 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:27:03.319683 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-63fbaff5-6d8d-433b-81ac-07c4e81d3fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:27:03.395855 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:27:03.419389 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 655/1336] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:27:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:27:03.460216 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37037eb1-3631-4f1a-923f-78f8557e83ad None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:27:03.461864 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-37037eb1-3631-4f1a-923f-78f8557e83ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:27:03.569197 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37037eb1-3631-4f1a-923f-78f8557e83ad None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:27:03.598635 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:27:03.647547 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81af3faa-9924-4a18-99f4-eeec264bca3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:27:03.648219 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af3faa-9924-4a18-99f4-eeec264bca3a service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:03.648508 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af3faa-9924-4a18-99f4-eeec264bca3a service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:03.648789 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af3faa-9924-4a18-99f4-eeec264bca3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:03.650756 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-81af3faa-9924-4a18-99f4-eeec264bca3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:27:03.777498 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81af3faa-9924-4a18-99f4-eeec264bca3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:27:03.778988 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81af3faa-9924-4a18-99f4-eeec264bca3a service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:27:03.800505 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 682/1337] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:27:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:27:06.486168 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed24d24-15a3-4351-b9b6-19d59af3187e None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:06.486689 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed24d24-15a3-4351-b9b6-19d59af3187e None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:06.486689 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed24d24-15a3-4351-b9b6-19d59af3187e None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:06.488020 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 656/1338] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:27:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:27:06.494031 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc52cad-2863-4086-93db-0da45ca83020 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:06.494443 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc52cad-2863-4086-93db-0da45ca83020 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:06.494602 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc52cad-2863-4086-93db-0da45ca83020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:06.559309 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-4fc52cad-2863-4086-93db-0da45ca83020 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:27:06.560535 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-4fc52cad-2863-4086-93db-0da45ca83020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:27:06.569754 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:27:06.659739 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 683/1339] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:27:06 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:27:06.696639 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed24d24-15a3-4351-b9b6-19d59af3187e None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:27:06.698199 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-3ed24d24-15a3-4351-b9b6-19d59af3187e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:27:06.800079 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed24d24-15a3-4351-b9b6-19d59af3187e None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:27:06.885143 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7a45b2-836e-4fc3-81e1-947ba1dba9e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:27:06.885812 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a45b2-836e-4fc3-81e1-947ba1dba9e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:06.886098 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a45b2-836e-4fc3-81e1-947ba1dba9e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:06.886377 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a45b2-836e-4fc3-81e1-947ba1dba9e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:06.888017 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-6f7a45b2-836e-4fc3-81e1-947ba1dba9e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:27:06.923294 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:27:06.996447 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7a45b2-836e-4fc3-81e1-947ba1dba9e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:27:06.997917 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7a45b2-836e-4fc3-81e1-947ba1dba9e7 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:27:07.015418 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 657/1340] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:27:06 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:27:11.107247 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272aed5c-cec9-4d99-9395-17a04e3c11a4 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:11.107818 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272aed5c-cec9-4d99-9395-17a04e3c11a4 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:11.107818 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272aed5c-cec9-4d99-9395-17a04e3c11a4 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:11.109489 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 684/1341] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:27:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:27:11.114462 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8d51d4-1843-4850-9ef1-64b570946264 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:11.114878 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8d51d4-1843-4850-9ef1-64b570946264 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:11.115056 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8d51d4-1843-4850-9ef1-64b570946264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:11.186425 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-9f8d51d4-1843-4850-9ef1-64b570946264 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:27:11.187621 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-9f8d51d4-1843-4850-9ef1-64b570946264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:27:11.283224 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:27:11.297719 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 658/1342] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:27:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:27:11.336686 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272aed5c-cec9-4d99-9395-17a04e3c11a4 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:27:11.339006 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-272aed5c-cec9-4d99-9395-17a04e3c11a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:27:11.436067 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272aed5c-cec9-4d99-9395-17a04e3c11a4 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:27:11.439811 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d938ecc2-3f20-4616-8130-b9669f3d09e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:27:11.440492 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d938ecc2-3f20-4616-8130-b9669f3d09e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:11.440775 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d938ecc2-3f20-4616-8130-b9669f3d09e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:11.441059 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d938ecc2-3f20-4616-8130-b9669f3d09e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:11.451404 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d938ecc2-3f20-4616-8130-b9669f3d09e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:27:11.452903 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d938ecc2-3f20-4616-8130-b9669f3d09e3 service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:27:11.464683 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 685/1343] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:27:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:27:14.115093 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55820bde-7596-4474-8d31-7b7c209277a6 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:14.115628 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55820bde-7596-4474-8d31-7b7c209277a6 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:14.115628 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55820bde-7596-4474-8d31-7b7c209277a6 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:14.117168 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 659/1344] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:27:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:27:14.122219 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4862f8-7d39-4a5a-b7ca-a1a751e0c739 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:14.122623 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4862f8-7d39-4a5a-b7ca-a1a751e0c739 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:14.122924 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4862f8-7d39-4a5a-b7ca-a1a751e0c739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:14.150552 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-6d4862f8-7d39-4a5a-b7ca-a1a751e0c739 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:27:14.151727 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-6d4862f8-7d39-4a5a-b7ca-a1a751e0c739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:27:14.179695 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:27:14.232909 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 686/1345] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:27:14 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:27:14.270704 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55820bde-7596-4474-8d31-7b7c209277a6 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:27:14.282311 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55820bde-7596-4474-8d31-7b7c209277a6 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:27:14.285874 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2808f72d-a6cf-4014-b84c-10429ac34e52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:27:14.286636 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2808f72d-a6cf-4014-b84c-10429ac34e52 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:14.287426 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2808f72d-a6cf-4014-b84c-10429ac34e52 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:14.287705 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2808f72d-a6cf-4014-b84c-10429ac34e52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:14.298670 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2808f72d-a6cf-4014-b84c-10429ac34e52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:27:14.300221 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2808f72d-a6cf-4014-b84c-10429ac34e52 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:27:14.311444 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 660/1346] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:27:14 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:27:18.309785 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d72d7a1-9f66-4f86-8d60-f1acc7399882 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:18.310334 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d72d7a1-9f66-4f86-8d60-f1acc7399882 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:18.310334 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d72d7a1-9f66-4f86-8d60-f1acc7399882 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:18.311749 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 687/1347] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:27:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:27:18.316942 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f872cd-d95a-4121-a561-b1ec4da9d120 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:18.317380 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f872cd-d95a-4121-a561-b1ec4da9d120 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:18.317528 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f872cd-d95a-4121-a561-b1ec4da9d120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:18.334607 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-d5f872cd-d95a-4121-a561-b1ec4da9d120 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:27:18.335786 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-d5f872cd-d95a-4121-a561-b1ec4da9d120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:27:18.343704 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 661/1348] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:27:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:27:18.381696 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d72d7a1-9f66-4f86-8d60-f1acc7399882 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:27:18.392089 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d72d7a1-9f66-4f86-8d60-f1acc7399882 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:27:18.395619 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea171139-c510-41d6-8039-3ee13984a383 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:27:18.396280 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea171139-c510-41d6-8039-3ee13984a383 service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:18.396564 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea171139-c510-41d6-8039-3ee13984a383 service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:18.396839 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea171139-c510-41d6-8039-3ee13984a383 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:18.405682 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea171139-c510-41d6-8039-3ee13984a383 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:27:18.407111 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea171139-c510-41d6-8039-3ee13984a383 service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:27:18.417259 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 688/1349] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:27:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:27:23.428187 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a550b8-6d1a-4ec7-b5f0-2fc562a72c6b None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:23.428730 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a550b8-6d1a-4ec7-b5f0-2fc562a72c6b None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:23.428730 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a550b8-6d1a-4ec7-b5f0-2fc562a72c6b None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:23.430274 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 662/1350] 10.222.0.26 () {54 vars in 921 bytes} [Fri Jul 1 19:27:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:27:23.437147 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3f0aa-beba-454d-8fca-6329b030afaa None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:23.437994 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3f0aa-beba-454d-8fca-6329b030afaa None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:23.438418 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3f0aa-beba-454d-8fca-6329b030afaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:23.540110 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-61e3f0aa-beba-454d-8fca-6329b030afaa None None] MFA Rules not processed for user `941e65d95bcd4e66a6489280520c12de`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:27:23.541445 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-61e3f0aa-beba-454d-8fca-6329b030afaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:27:23.624002 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 689/1351] 10.222.0.26 () {58 vars in 1018 bytes} [Fri Jul 1 19:27:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:27:27.799200 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5599bfc-f786-4e3e-9947-d7b1f1b0f89e None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:27.800214 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5599bfc-f786-4e3e-9947-d7b1f1b0f89e None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:27.800745 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5599bfc-f786-4e3e-9947-d7b1f1b0f89e None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:27.803151 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 663/1352] 10.222.0.26 () {54 vars in 921 bytes} [Fri Jul 1 19:27:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:27:27.808760 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa64627d-34a2-45b6-9523-c6e815a75fba None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:27.809288 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa64627d-34a2-45b6-9523-c6e815a75fba None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:27.809390 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa64627d-34a2-45b6-9523-c6e815a75fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:27.830598 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-aa64627d-34a2-45b6-9523-c6e815a75fba None None] MFA Rules not processed for user `941e65d95bcd4e66a6489280520c12de`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:27:27.832047 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-aa64627d-34a2-45b6-9523-c6e815a75fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:27:27.841400 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 690/1353] 10.222.0.26 () {58 vars in 1018 bytes} [Fri Jul 1 19:27:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:27:28.329975 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=13 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:27:29.239667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e13f99-22aa-4f11-a170-fcd9bfcc45de None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:29.240334 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e13f99-22aa-4f11-a170-fcd9bfcc45de None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:29.240334 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e13f99-22aa-4f11-a170-fcd9bfcc45de None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:29.241621 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 664/1354] 10.222.0.26 () {54 vars in 921 bytes} [Fri Jul 1 19:27:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:27:29.246551 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee55e40-df2d-4118-9a27-f87f732ca2c1 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:29.246991 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee55e40-df2d-4118-9a27-f87f732ca2c1 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:29.247250 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee55e40-df2d-4118-9a27-f87f732ca2c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:29.265838 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-dee55e40-df2d-4118-9a27-f87f732ca2c1 None None] MFA Rules not processed for user `941e65d95bcd4e66a6489280520c12de`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:27:29.267007 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-dee55e40-df2d-4118-9a27-f87f732ca2c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:27:29.276056 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 691/1355] 10.222.0.26 () {58 vars in 1018 bytes} [Fri Jul 1 19:27:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:27:32.943493 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea42f1-c81e-40d3-914b-79c392cdf755 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:32.944019 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea42f1-c81e-40d3-914b-79c392cdf755 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:32.944019 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea42f1-c81e-40d3-914b-79c392cdf755 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:32.946425 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 665/1356] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:27:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:27:32.951085 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1818ec1a-4804-45c9-90b9-7953a8f31cd7 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:32.951535 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1818ec1a-4804-45c9-90b9-7953a8f31cd7 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:32.951630 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1818ec1a-4804-45c9-90b9-7953a8f31cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:32.971689 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-1818ec1a-4804-45c9-90b9-7953a8f31cd7 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:27:32.972869 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-1818ec1a-4804-45c9-90b9-7953a8f31cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:27:32.982267 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 692/1357] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:27:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:27:33.037759 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17ac6e-bf35-4360-9e7a-3ff68bb0cfae None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:33.038360 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17ac6e-bf35-4360-9e7a-3ff68bb0cfae None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:33.038850 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17ac6e-bf35-4360-9e7a-3ff68bb0cfae None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:33.040648 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 666/1358] 10.222.0.26 () {54 vars in 961 bytes} [Fri Jul 1 19:27:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:27:33.050452 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13460deb-8372-4587-ad1d-d329c8923205 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:33.051016 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13460deb-8372-4587-ad1d-d329c8923205 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:33.051678 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13460deb-8372-4587-ad1d-d329c8923205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:33.102968 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:27:33.111585 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-13460deb-8372-4587-ad1d-d329c8923205 None None] MFA Rules not processed for user `13fd76fc7dd1410b9cde5adbaa6cb2e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:27:33.112896 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-13460deb-8372-4587-ad1d-d329c8923205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:27:33.199645 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 693/1359] 10.222.0.26 () {58 vars in 1058 bytes} [Fri Jul 1 19:27:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:27:33.209003 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc17ac6e-bf35-4360-9e7a-3ff68bb0cfae None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:27:33.224318 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc17ac6e-bf35-4360-9e7a-3ff68bb0cfae None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:27:33.229824 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87510c45-3618-4199-a566-a9541f4c55fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13fd76fc7dd1410b9cde5adbaa6cb2e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:27:33.230464 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87510c45-3618-4199-a566-a9541f4c55fe service nova] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:33.230747 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87510c45-3618-4199-a566-a9541f4c55fe service nova] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:33.231019 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87510c45-3618-4199-a566-a9541f4c55fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:33.239392 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87510c45-3618-4199-a566-a9541f4c55fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:27:33.241011 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87510c45-3618-4199-a566-a9541f4c55fe service nova] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:27:33.250557 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 667/1360] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:27:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:27:35.476541 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35553da1-ee09-456d-bdb8-3aab6282533a None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:35.477481 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35553da1-ee09-456d-bdb8-3aab6282533a None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:35.477894 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35553da1-ee09-456d-bdb8-3aab6282533a None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:35.479488 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 694/1361] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:27:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:27:35.484830 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5273bf82-e04f-4ee1-b24e-5fdaf1df99f0 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:35.485383 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5273bf82-e04f-4ee1-b24e-5fdaf1df99f0 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:35.485483 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5273bf82-e04f-4ee1-b24e-5fdaf1df99f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:35.504111 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-5273bf82-e04f-4ee1-b24e-5fdaf1df99f0 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:27:35.505599 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-5273bf82-e04f-4ee1-b24e-5fdaf1df99f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:27:35.513755 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 668/1362] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:27:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:27:35.559297 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35553da1-ee09-456d-bdb8-3aab6282533a None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:27:35.574620 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35553da1-ee09-456d-bdb8-3aab6282533a None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:27:35.580161 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cce9cd-c6ab-4727-88f4-636b4719b4a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13fd76fc7dd1410b9cde5adbaa6cb2e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:27:35.580909 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cce9cd-c6ab-4727-88f4-636b4719b4a0 service nova] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:35.581333 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cce9cd-c6ab-4727-88f4-636b4719b4a0 service nova] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:35.581743 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cce9cd-c6ab-4727-88f4-636b4719b4a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:35.590560 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cce9cd-c6ab-4727-88f4-636b4719b4a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:27:35.592265 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cce9cd-c6ab-4727-88f4-636b4719b4a0 service nova] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:27:35.602776 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 695/1363] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:27:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:27:37.951316 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed9f01-24eb-4cac-887a-72a22c72e56f None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:37.951827 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed9f01-24eb-4cac-887a-72a22c72e56f None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:37.951940 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed9f01-24eb-4cac-887a-72a22c72e56f None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:37.953616 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 669/1364] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:27:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:27:37.959359 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e7869e-c091-4412-ae26-f8ffa98e4a0b None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:37.959794 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e7869e-c091-4412-ae26-f8ffa98e4a0b None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:37.959931 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e7869e-c091-4412-ae26-f8ffa98e4a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:37.979545 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-58e7869e-c091-4412-ae26-f8ffa98e4a0b None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:27:37.980727 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-58e7869e-c091-4412-ae26-f8ffa98e4a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:27:37.990943 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 696/1365] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:27:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:27:38.037201 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c6585-18bc-41a3-8eb2-5c67cfc3e172 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:38.037542 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c6585-18bc-41a3-8eb2-5c67cfc3e172 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:38.038089 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c6585-18bc-41a3-8eb2-5c67cfc3e172 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:38.040060 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 670/1366] 10.222.0.26 () {54 vars in 961 bytes} [Fri Jul 1 19:27:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:27:38.049401 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3385039-ef80-4f52-bea0-5f11c0970dd5 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:38.049697 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3385039-ef80-4f52-bea0-5f11c0970dd5 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:38.050003 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3385039-ef80-4f52-bea0-5f11c0970dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:38.072630 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-b3385039-ef80-4f52-bea0-5f11c0970dd5 None None] MFA Rules not processed for user `13fd76fc7dd1410b9cde5adbaa6cb2e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:27:38.073271 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-b3385039-ef80-4f52-bea0-5f11c0970dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:27:38.093226 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 697/1367] 10.222.0.26 () {58 vars in 1058 bytes} [Fri Jul 1 19:27:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:27:38.101439 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0c6585-18bc-41a3-8eb2-5c67cfc3e172 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:27:38.116658 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0c6585-18bc-41a3-8eb2-5c67cfc3e172 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:27:38.122349 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a68c77-5164-47bb-b944-6a801775d0d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13fd76fc7dd1410b9cde5adbaa6cb2e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:27:38.122977 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a68c77-5164-47bb-b944-6a801775d0d8 service nova] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:38.123259 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a68c77-5164-47bb-b944-6a801775d0d8 service nova] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:38.123532 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a68c77-5164-47bb-b944-6a801775d0d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:38.133055 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a68c77-5164-47bb-b944-6a801775d0d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:27:38.134822 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a68c77-5164-47bb-b944-6a801775d0d8 service nova] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:27:38.144098 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 671/1368] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:27:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 19:27:40.255348 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda8316-a49c-436b-bb6f-23263ed4084b None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:40.255873 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda8316-a49c-436b-bb6f-23263ed4084b None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:40.255873 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda8316-a49c-436b-bb6f-23263ed4084b None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:40.257604 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 698/1369] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:27:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:27:40.262576 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc8c0e-78b1-4bf6-8b2f-0c0f2d2f7be8 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:40.262987 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc8c0e-78b1-4bf6-8b2f-0c0f2d2f7be8 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:40.263163 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc8c0e-78b1-4bf6-8b2f-0c0f2d2f7be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:40.281148 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-3cbc8c0e-78b1-4bf6-8b2f-0c0f2d2f7be8 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:27:40.282562 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-3cbc8c0e-78b1-4bf6-8b2f-0c0f2d2f7be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:27:40.292040 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 672/1370] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:27:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:27:40.337452 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fda8316-a49c-436b-bb6f-23263ed4084b None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:27:40.352484 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fda8316-a49c-436b-bb6f-23263ed4084b None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:27:40.358250 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427f77b8-7309-44c1-a32e-3a23967a6f5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13fd76fc7dd1410b9cde5adbaa6cb2e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:27:40.358933 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f77b8-7309-44c1-a32e-3a23967a6f5a service nova] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:40.359225 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f77b8-7309-44c1-a32e-3a23967a6f5a service nova] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:40.359512 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f77b8-7309-44c1-a32e-3a23967a6f5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:40.369594 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427f77b8-7309-44c1-a32e-3a23967a6f5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:27:40.371229 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427f77b8-7309-44c1-a32e-3a23967a6f5a service nova] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:27:40.383437 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 699/1371] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:27:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:27:41.116707 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8b78e-df47-4ebf-9046-ad7e7e21cc7d None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:41.117164 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8b78e-df47-4ebf-9046-ad7e7e21cc7d None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:41.117663 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8b78e-df47-4ebf-9046-ad7e7e21cc7d None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:41.119059 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 673/1372] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:27:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 19:27:41.124289 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2843773a-1f23-4d91-8abe-f898eecda411 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:41.124592 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2843773a-1f23-4d91-8abe-f898eecda411 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:41.124882 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2843773a-1f23-4d91-8abe-f898eecda411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:41.143460 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-2843773a-1f23-4d91-8abe-f898eecda411 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:27:41.144659 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-2843773a-1f23-4d91-8abe-f898eecda411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:27:41.153085 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 700/1373] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:27:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:27:41.519865 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5badaf-2d63-4153-9358-7660d1981c8c None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:41.519865 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5badaf-2d63-4153-9358-7660d1981c8c None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:41.523942 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5badaf-2d63-4153-9358-7660d1981c8c None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:41.525618 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 674/1374] 10.222.0.26 () {54 vars in 963 bytes} [Fri Jul 1 19:27:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:27:41.530530 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2724999-c769-43df-87b4-7f0f8a2fcdef None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:41.531072 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2724999-c769-43df-87b4-7f0f8a2fcdef None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:41.531339 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2724999-c769-43df-87b4-7f0f8a2fcdef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:41.584157 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-c2724999-c769-43df-87b4-7f0f8a2fcdef None None] MFA Rules not processed for user `9a3ed285ee4c4d04abf7daf0aeb9fb7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:27:41.585395 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-c2724999-c769-43df-87b4-7f0f8a2fcdef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:27:41.659200 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 701/1375] 10.222.0.26 () {58 vars in 1060 bytes} [Fri Jul 1 19:27:41 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:27:41.668488 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5badaf-2d63-4153-9358-7660d1981c8c None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:27:41.681645 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5badaf-2d63-4153-9358-7660d1981c8c None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:27:41.685535 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c674f4b9-8f42-4453-b8c8-896e3359378f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a3ed285ee4c4d04abf7daf0aeb9fb7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:27:41.686178 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c674f4b9-8f42-4453-b8c8-896e3359378f service cinder] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:41.686466 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c674f4b9-8f42-4453-b8c8-896e3359378f service cinder] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:41.686747 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c674f4b9-8f42-4453-b8c8-896e3359378f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:41.696755 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c674f4b9-8f42-4453-b8c8-896e3359378f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:27:41.698330 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c674f4b9-8f42-4453-b8c8-896e3359378f service cinder] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:27:41.708948 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 675/1376] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:27:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:27:42.465813 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0ef3c-ac89-4862-8eb3-8ec185014b11 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:42.465813 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0ef3c-ac89-4862-8eb3-8ec185014b11 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:42.467433 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0ef3c-ac89-4862-8eb3-8ec185014b11 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:42.469976 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 702/1377] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:27:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:27:42.474959 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47e280-7437-4aa6-b5e8-047afd7e1c17 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:42.475236 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47e280-7437-4aa6-b5e8-047afd7e1c17 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:42.475517 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47e280-7437-4aa6-b5e8-047afd7e1c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:42.494015 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-eb47e280-7437-4aa6-b5e8-047afd7e1c17 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:27:42.495226 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-eb47e280-7437-4aa6-b5e8-047afd7e1c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:27:42.503500 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 676/1378] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:27:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:27:42.549338 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb0ef3c-ac89-4862-8eb3-8ec185014b11 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:27:42.568232 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb0ef3c-ac89-4862-8eb3-8ec185014b11 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:27:42.574009 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5bedc6-7ddb-46ae-b19e-6b9488d8eb9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13fd76fc7dd1410b9cde5adbaa6cb2e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:27:42.574658 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5bedc6-7ddb-46ae-b19e-6b9488d8eb9f service nova] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:42.574950 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5bedc6-7ddb-46ae-b19e-6b9488d8eb9f service nova] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:42.575237 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5bedc6-7ddb-46ae-b19e-6b9488d8eb9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:42.583773 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5bedc6-7ddb-46ae-b19e-6b9488d8eb9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:27:42.585381 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5bedc6-7ddb-46ae-b19e-6b9488d8eb9f service nova] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:27:42.589274 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:27:42.596270 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 703/1379] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:27:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:27:44.684810 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e7414-1809-4bf0-946f-da33e5b2ec1d None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:44.685713 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e7414-1809-4bf0-946f-da33e5b2ec1d None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:44.686164 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e7414-1809-4bf0-946f-da33e5b2ec1d None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:44.691977 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 677/1380] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:27:44 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:27:44.693685 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63316ba-b41d-40df-93ef-51046c7f63b3 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:44.694460 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63316ba-b41d-40df-93ef-51046c7f63b3 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:44.694747 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63316ba-b41d-40df-93ef-51046c7f63b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:44.721940 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-e63316ba-b41d-40df-93ef-51046c7f63b3 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:27:44.723145 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-e63316ba-b41d-40df-93ef-51046c7f63b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:27:44.737557 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 704/1381] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:27:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:27:44.788469 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4e7414-1809-4bf0-946f-da33e5b2ec1d None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:27:44.804106 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4e7414-1809-4bf0-946f-da33e5b2ec1d None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:27:44.810676 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71d958f-d831-4e16-8e27-120dcf2db6f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13fd76fc7dd1410b9cde5adbaa6cb2e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:27:44.811314 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d958f-d831-4e16-8e27-120dcf2db6f3 service nova] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:44.811601 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d958f-d831-4e16-8e27-120dcf2db6f3 service nova] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:44.811880 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d958f-d831-4e16-8e27-120dcf2db6f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:44.820962 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71d958f-d831-4e16-8e27-120dcf2db6f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:27:44.822602 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71d958f-d831-4e16-8e27-120dcf2db6f3 service nova] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:27:44.832270 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 678/1382] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:27:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:27:46.905106 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f985e06-7f07-429a-a4d4-d56fdc9f0987 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:46.905668 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f985e06-7f07-429a-a4d4-d56fdc9f0987 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:46.905769 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f985e06-7f07-429a-a4d4-d56fdc9f0987 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:46.907220 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 705/1383] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:27:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:27:46.912909 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a07c6f-e17f-4110-97b0-671fa696df36 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:46.913352 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a07c6f-e17f-4110-97b0-671fa696df36 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:46.913543 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a07c6f-e17f-4110-97b0-671fa696df36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:46.932241 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-99a07c6f-e17f-4110-97b0-671fa696df36 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:27:46.933455 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-99a07c6f-e17f-4110-97b0-671fa696df36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:27:46.941721 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 679/1384] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:27:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:27:46.984395 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f985e06-7f07-429a-a4d4-d56fdc9f0987 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:27:46.999471 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f985e06-7f07-429a-a4d4-d56fdc9f0987 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:27:47.005004 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70dcddb-b01f-4521-a5c2-60c3af979582 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13fd76fc7dd1410b9cde5adbaa6cb2e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:27:47.005672 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70dcddb-b01f-4521-a5c2-60c3af979582 service nova] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:47.005960 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70dcddb-b01f-4521-a5c2-60c3af979582 service nova] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:47.006244 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70dcddb-b01f-4521-a5c2-60c3af979582 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:47.014807 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70dcddb-b01f-4521-a5c2-60c3af979582 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:27:47.016385 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70dcddb-b01f-4521-a5c2-60c3af979582 service nova] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:27:47.026904 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 706/1385] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:27:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 19:27:49.072471 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6deabb6-8ae3-4335-b3e6-a8deaae6ba96 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:49.072471 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6deabb6-8ae3-4335-b3e6-a8deaae6ba96 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:49.073980 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6deabb6-8ae3-4335-b3e6-a8deaae6ba96 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:49.079371 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a9068c-fbc2-4356-bf17-d826b601bab2 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:49.080062 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a9068c-fbc2-4356-bf17-d826b601bab2 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:49.080062 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a9068c-fbc2-4356-bf17-d826b601bab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:49.081882 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 680/1386] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:27:49 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:27:49.104008 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-a1a9068c-fbc2-4356-bf17-d826b601bab2 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:27:49.105655 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-a1a9068c-fbc2-4356-bf17-d826b601bab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:27:49.141569 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 707/1387] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:27:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:27:49.168501 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6deabb6-8ae3-4335-b3e6-a8deaae6ba96 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:27:49.185637 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6deabb6-8ae3-4335-b3e6-a8deaae6ba96 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:27:49.192608 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f86a5-d12f-4210-aa51-d2dbf77846c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13fd76fc7dd1410b9cde5adbaa6cb2e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:27:49.193349 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f86a5-d12f-4210-aa51-d2dbf77846c9 service nova] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:49.193595 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f86a5-d12f-4210-aa51-d2dbf77846c9 service nova] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:49.193872 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f86a5-d12f-4210-aa51-d2dbf77846c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:49.202685 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618f86a5-d12f-4210-aa51-d2dbf77846c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:27:49.204272 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618f86a5-d12f-4210-aa51-d2dbf77846c9 service nova] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:27:49.214932 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 681/1388] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:27:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:27:51.327492 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0512602-abe4-4db2-b770-94923cab1822 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:51.328070 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0512602-abe4-4db2-b770-94923cab1822 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:51.328070 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0512602-abe4-4db2-b770-94923cab1822 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:51.329521 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 708/1389] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:27:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:27:51.335498 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e740c-a0c5-40cf-8b27-3b68a16c763f None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:51.335898 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e740c-a0c5-40cf-8b27-3b68a16c763f None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:51.336069 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e740c-a0c5-40cf-8b27-3b68a16c763f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:51.354702 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-d02e740c-a0c5-40cf-8b27-3b68a16c763f None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:27:51.355909 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-d02e740c-a0c5-40cf-8b27-3b68a16c763f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:27:51.363694 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 682/1390] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:27:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:27:51.408656 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0512602-abe4-4db2-b770-94923cab1822 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:27:51.423576 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0512602-abe4-4db2-b770-94923cab1822 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:27:51.429097 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9837e85a-9cde-4750-bef3-eaa8b5b8d8ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13fd76fc7dd1410b9cde5adbaa6cb2e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:27:51.429820 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837e85a-9cde-4750-bef3-eaa8b5b8d8ee service nova] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:51.430110 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837e85a-9cde-4750-bef3-eaa8b5b8d8ee service nova] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:51.430393 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837e85a-9cde-4750-bef3-eaa8b5b8d8ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:51.439175 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9837e85a-9cde-4750-bef3-eaa8b5b8d8ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:27:51.440835 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9837e85a-9cde-4750-bef3-eaa8b5b8d8ee service nova] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:27:51.451359 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 709/1391] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:27:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:27:53.600090 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc10316f-854f-4860-942f-85a16d6ca1fa None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:53.600678 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc10316f-854f-4860-942f-85a16d6ca1fa None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:53.601060 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc10316f-854f-4860-942f-85a16d6ca1fa None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:53.602969 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 683/1392] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:27:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:27:53.608239 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4abdc3c-0c5e-4d54-831e-3739b3a7dd79 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:53.608857 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4abdc3c-0c5e-4d54-831e-3739b3a7dd79 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:53.608857 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4abdc3c-0c5e-4d54-831e-3739b3a7dd79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:53.632364 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-c4abdc3c-0c5e-4d54-831e-3739b3a7dd79 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:27:53.634152 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-c4abdc3c-0c5e-4d54-831e-3739b3a7dd79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:27:53.644900 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 710/1393] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:27:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:27:53.690210 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc10316f-854f-4860-942f-85a16d6ca1fa None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:27:53.709765 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc10316f-854f-4860-942f-85a16d6ca1fa None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:27:53.718402 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdae75e-e9ae-4cab-826a-f674528afdd5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13fd76fc7dd1410b9cde5adbaa6cb2e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:27:53.719426 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdae75e-e9ae-4cab-826a-f674528afdd5 service nova] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:53.719838 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdae75e-e9ae-4cab-826a-f674528afdd5 service nova] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:53.720341 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdae75e-e9ae-4cab-826a-f674528afdd5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:53.731568 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdae75e-e9ae-4cab-826a-f674528afdd5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:27:53.733711 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdae75e-e9ae-4cab-826a-f674528afdd5 service nova] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:27:53.743996 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 684/1394] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:27:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:27:56.064960 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2118dc-9ea1-482d-9a00-5fefad34a86c None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:56.065622 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2118dc-9ea1-482d-9a00-5fefad34a86c None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:56.065622 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2118dc-9ea1-482d-9a00-5fefad34a86c None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:56.067000 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 711/1395] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:27:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:27:56.072545 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaac8be-a14d-4c5f-b486-5d880cae848d None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:56.072996 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaac8be-a14d-4c5f-b486-5d880cae848d None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:56.073368 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaac8be-a14d-4c5f-b486-5d880cae848d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:56.091284 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-8eaac8be-a14d-4c5f-b486-5d880cae848d None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:27:56.092501 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-8eaac8be-a14d-4c5f-b486-5d880cae848d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:27:56.101688 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 685/1396] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:27:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:27:56.145360 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2118dc-9ea1-482d-9a00-5fefad34a86c None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:27:56.159415 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2118dc-9ea1-482d-9a00-5fefad34a86c None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:27:56.166906 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe3109d-0a31-43e8-8375-b6c09189b11f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13fd76fc7dd1410b9cde5adbaa6cb2e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:27:56.167541 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe3109d-0a31-43e8-8375-b6c09189b11f service nova] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:56.167832 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe3109d-0a31-43e8-8375-b6c09189b11f service nova] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:56.168107 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe3109d-0a31-43e8-8375-b6c09189b11f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:56.176935 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe3109d-0a31-43e8-8375-b6c09189b11f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:27:56.178565 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe3109d-0a31-43e8-8375-b6c09189b11f service nova] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:27:56.188059 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 712/1397] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:27:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:27:57.210757 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da5b85-68fd-4e36-9d99-c215e40c31a3 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:57.211331 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da5b85-68fd-4e36-9d99-c215e40c31a3 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:57.211331 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da5b85-68fd-4e36-9d99-c215e40c31a3 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:57.212688 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 686/1398] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:27:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:27:57.217930 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e7a9e-c0c8-4613-a367-af98506f82ac None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:57.218351 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e7a9e-c0c8-4613-a367-af98506f82ac None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:57.218502 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e7a9e-c0c8-4613-a367-af98506f82ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:57.245347 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-0a4e7a9e-c0c8-4613-a367-af98506f82ac None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:27:57.246541 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-0a4e7a9e-c0c8-4613-a367-af98506f82ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:27:57.254858 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 713/1399] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:27:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:27:57.311157 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16874a1c-967e-4f96-a655-6ca3aaf20c69 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:57.311470 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16874a1c-967e-4f96-a655-6ca3aaf20c69 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:57.311732 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16874a1c-967e-4f96-a655-6ca3aaf20c69 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:57.313097 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 687/1400] 10.222.0.26 () {54 vars in 962 bytes} [Fri Jul 1 19:27:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:27:57.318140 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ca3de8-b8a4-4456-a9c6-ea23abc5bca1 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:57.318496 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ca3de8-b8a4-4456-a9c6-ea23abc5bca1 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:57.318784 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ca3de8-b8a4-4456-a9c6-ea23abc5bca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:57.370014 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-81ca3de8-b8a4-4456-a9c6-ea23abc5bca1 None None] MFA Rules not processed for user `5bbcb2463f9c46ddaaa247e4876aca48`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:27:57.371234 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-81ca3de8-b8a4-4456-a9c6-ea23abc5bca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:27:57.432018 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 714/1401] 10.222.0.26 () {58 vars in 1059 bytes} [Fri Jul 1 19:27:57 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:27:57.439468 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16874a1c-967e-4f96-a655-6ca3aaf20c69 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:27:57.450180 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16874a1c-967e-4f96-a655-6ca3aaf20c69 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:27:57.453634 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efade3b-ab31-4848-8c58-4cf6d5690754 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bbcb2463f9c46ddaaa247e4876aca48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:27:57.454262 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efade3b-ab31-4848-8c58-4cf6d5690754 service glance] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:57.454547 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efade3b-ab31-4848-8c58-4cf6d5690754 service glance] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:57.454825 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efade3b-ab31-4848-8c58-4cf6d5690754 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:57.464348 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efade3b-ab31-4848-8c58-4cf6d5690754 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:27:57.465747 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efade3b-ab31-4848-8c58-4cf6d5690754 service glance] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:27:57.475618 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 688/1402] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:27:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:27:58.231113 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7ca24-ca92-4620-8465-6a190dacfa31 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:58.231607 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7ca24-ca92-4620-8465-6a190dacfa31 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:58.231704 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7ca24-ca92-4620-8465-6a190dacfa31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:58.278930 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-30a7ca24-ca92-4620-8465-6a190dacfa31 None None] MFA Rules not processed for user `0834256bdfbc48ffbc5af6d6760ecdd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:27:58.280216 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-30a7ca24-ca92-4620-8465-6a190dacfa31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:27:58.307369 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa47da62-444b-4864-b5fb-d18ff7dc816c None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:58.307924 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa47da62-444b-4864-b5fb-d18ff7dc816c None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:58.307924 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa47da62-444b-4864-b5fb-d18ff7dc816c None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:58.309330 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 689/1403] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:27:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:27:58.314124 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1fbab2-b863-460e-b5d8-f8f991093be2 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:58.314415 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1fbab2-b863-460e-b5d8-f8f991093be2 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:58.314699 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1fbab2-b863-460e-b5d8-f8f991093be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:58.322235 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:27:58.333117 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-da1fbab2-b863-460e-b5d8-f8f991093be2 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:27:58.334346 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-da1fbab2-b863-460e-b5d8-f8f991093be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:27:58.342358 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 690/1404] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:27:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:27:58.348030 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 715/1405] 10.222.0.26 () {58 vars in 1009 bytes} [Fri Jul 1 19:27:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:27:58.387280 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1fbab2-b863-460e-b5d8-f8f991093be2 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:27:58.388565 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed16763-d51f-418c-8a14-cff130c68e3b None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:58.388862 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed16763-d51f-418c-8a14-cff130c68e3b None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:58.389150 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed16763-d51f-418c-8a14-cff130c68e3b None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:58.390565 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 716/1406] 10.222.0.26 () {54 vars in 942 bytes} [Fri Jul 1 19:27:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 19:27:58.395024 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=64 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:27:58.397749 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d8c49-1c1c-4557-bdf7-1e9a568fce94 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:58.397946 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d8c49-1c1c-4557-bdf7-1e9a568fce94 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:58.398232 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d8c49-1c1c-4557-bdf7-1e9a568fce94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:58.402355 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1fbab2-b863-460e-b5d8-f8f991093be2 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:27:58.408020 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7f905e-88f7-4fad-bc98-3d79d3087525 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13fd76fc7dd1410b9cde5adbaa6cb2e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:27:58.408639 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f905e-88f7-4fad-bc98-3d79d3087525 service nova] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:58.408924 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f905e-88f7-4fad-bc98-3d79d3087525 service nova] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:58.409226 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f905e-88f7-4fad-bc98-3d79d3087525 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:58.418308 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7f905e-88f7-4fad-bc98-3d79d3087525 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:27:58.419934 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7f905e-88f7-4fad-bc98-3d79d3087525 service nova] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:27:58.430062 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 691/1407] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:27:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:27:58.451717 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-343d8c49-1c1c-4557-bdf7-1e9a568fce94 None None] MFA Rules not processed for user `e958c5b03a9346d59c32675c5271bf3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:27:58.452957 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-343d8c49-1c1c-4557-bdf7-1e9a568fce94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:27:58.532607 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 717/1408] 10.222.0.26 () {58 vars in 1039 bytes} [Fri Jul 1 19:27:58 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:27:58.542480 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7f905e-88f7-4fad-bc98-3d79d3087525 service nova] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:27:58.555054 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7f905e-88f7-4fad-bc98-3d79d3087525 service nova] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:27:58.560347 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff2be0e-6599-4e4f-9b02-9b58c1bd9593 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e958c5b03a9346d59c32675c5271bf3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:27:58.561012 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2be0e-6599-4e4f-9b02-9b58c1bd9593 service swift] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:58.561332 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2be0e-6599-4e4f-9b02-9b58c1bd9593 service swift] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:58.561616 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2be0e-6599-4e4f-9b02-9b58c1bd9593 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:58.570882 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff2be0e-6599-4e4f-9b02-9b58c1bd9593 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:27:58.572520 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff2be0e-6599-4e4f-9b02-9b58c1bd9593 service swift] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:27:58.582296 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 692/1409] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Jul 1 19:27:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 01 19:28:08.529334 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=53 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:28:08.578022 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=11 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:28:20.562757 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21832085-e5dc-4324-bf3f-c49008a3068a None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:20.563349 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21832085-e5dc-4324-bf3f-c49008a3068a None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:20.563349 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21832085-e5dc-4324-bf3f-c49008a3068a None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:20.564765 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 718/1410] 10.222.0.26 () {54 vars in 918 bytes} [Fri Jul 1 19:28:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:28:20.570343 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471bc592-9bee-479a-946d-464ab1f060f5 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:20.570797 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471bc592-9bee-479a-946d-464ab1f060f5 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:20.570906 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471bc592-9bee-479a-946d-464ab1f060f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:20.589041 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-471bc592-9bee-479a-946d-464ab1f060f5 None None] MFA Rules not processed for user `941e65d95bcd4e66a6489280520c12de`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:28:20.590258 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-471bc592-9bee-479a-946d-464ab1f060f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:28:20.598707 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 693/1411] 10.222.0.26 () {58 vars in 1015 bytes} [Fri Jul 1 19:28:20 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:28:20.612526 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c5c42-45ee-45ea-b2c9-31e35944e88a None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:20.612816 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c5c42-45ee-45ea-b2c9-31e35944e88a None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:20.613095 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c5c42-45ee-45ea-b2c9-31e35944e88a None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:20.614477 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 719/1412] 10.222.0.26 () {54 vars in 918 bytes} [Fri Jul 1 19:28:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:28:20.618827 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91bbdd7-c5f7-40a4-a2a5-968f3b95f747 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:20.619121 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91bbdd7-c5f7-40a4-a2a5-968f3b95f747 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:20.619402 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91bbdd7-c5f7-40a4-a2a5-968f3b95f747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:20.637810 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-b91bbdd7-c5f7-40a4-a2a5-968f3b95f747 None None] MFA Rules not processed for user `13fd76fc7dd1410b9cde5adbaa6cb2e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:28:20.638990 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-b91bbdd7-c5f7-40a4-a2a5-968f3b95f747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:28:20.648685 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 694/1413] 10.222.0.26 () {58 vars in 1015 bytes} [Fri Jul 1 19:28:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:28:23.131177 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0142ae-e23d-4b78-b333-cf5686292315 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:23.131710 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0142ae-e23d-4b78-b333-cf5686292315 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:23.131833 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0142ae-e23d-4b78-b333-cf5686292315 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:23.133113 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 720/1414] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 1 19:28:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:28:23.138502 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed8f0b-9d4c-4454-a247-6057145cb1c8 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:23.138917 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed8f0b-9d4c-4454-a247-6057145cb1c8 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:23.139100 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed8f0b-9d4c-4454-a247-6057145cb1c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:23.156575 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-99ed8f0b-9d4c-4454-a247-6057145cb1c8 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:28:23.157799 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-99ed8f0b-9d4c-4454-a247-6057145cb1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:28:23.165561 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 695/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 1 19:28:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:28:23.209771 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0142ae-e23d-4b78-b333-cf5686292315 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:23.224089 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0142ae-e23d-4b78-b333-cf5686292315 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:23.229460 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7005690-9790-46d5-9199-f76e57bb4e82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13fd76fc7dd1410b9cde5adbaa6cb2e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:23.230098 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7005690-9790-46d5-9199-f76e57bb4e82 service nova] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:23.230383 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7005690-9790-46d5-9199-f76e57bb4e82 service nova] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:23.230661 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7005690-9790-46d5-9199-f76e57bb4e82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:23.239189 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7005690-9790-46d5-9199-f76e57bb4e82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:23.240758 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7005690-9790-46d5-9199-f76e57bb4e82 service nova] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:23.250023 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 721/1416] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:28:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:28:24.156683 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c377e04e-f02b-4834-bb5f-d23bd22f48ab None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:24.157286 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c377e04e-f02b-4834-bb5f-d23bd22f48ab None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:24.157286 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c377e04e-f02b-4834-bb5f-d23bd22f48ab None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:24.158667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 696/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 1 19:28:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:28:24.163610 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28912f5b-bb9a-42f0-8d71-9e57ca9d0c20 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:24.164142 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28912f5b-bb9a-42f0-8d71-9e57ca9d0c20 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:24.164263 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28912f5b-bb9a-42f0-8d71-9e57ca9d0c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:24.182052 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-28912f5b-bb9a-42f0-8d71-9e57ca9d0c20 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:28:24.183243 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-28912f5b-bb9a-42f0-8d71-9e57ca9d0c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:28:24.191446 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 722/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 1 19:28:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:28:24.343095 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c377e04e-f02b-4834-bb5f-d23bd22f48ab None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:24.357635 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c377e04e-f02b-4834-bb5f-d23bd22f48ab None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:24.363019 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cda005-efff-4f6f-bb5f-162cc0a43fcf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13fd76fc7dd1410b9cde5adbaa6cb2e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:24.363655 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cda005-efff-4f6f-bb5f-162cc0a43fcf service nova] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:24.363946 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cda005-efff-4f6f-bb5f-162cc0a43fcf service nova] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:24.364223 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cda005-efff-4f6f-bb5f-162cc0a43fcf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:24.372483 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cda005-efff-4f6f-bb5f-162cc0a43fcf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:24.374154 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cda005-efff-4f6f-bb5f-162cc0a43fcf service nova] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:24.384144 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 697/1419] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:28:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:28:25.266415 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a8643a-5278-4406-94c5-d5c7cf29858f None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:25.266987 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a8643a-5278-4406-94c5-d5c7cf29858f None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:25.266987 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a8643a-5278-4406-94c5-d5c7cf29858f None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:25.268394 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 723/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 1 19:28:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:28:25.273927 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1760ad-7d39-4461-88bb-d1348e311263 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:25.274367 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1760ad-7d39-4461-88bb-d1348e311263 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:25.274486 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1760ad-7d39-4461-88bb-d1348e311263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:25.293435 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-3c1760ad-7d39-4461-88bb-d1348e311263 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:28:25.294663 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-3c1760ad-7d39-4461-88bb-d1348e311263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:28:25.302922 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 698/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 1 19:28:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:28:25.451421 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a8643a-5278-4406-94c5-d5c7cf29858f None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:25.466264 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a8643a-5278-4406-94c5-d5c7cf29858f None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:25.471611 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c355c9-6bc1-4398-a324-8045e5f7e661 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13fd76fc7dd1410b9cde5adbaa6cb2e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:25.472833 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c355c9-6bc1-4398-a324-8045e5f7e661 service nova] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:25.473123 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c355c9-6bc1-4398-a324-8045e5f7e661 service nova] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:25.473443 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c355c9-6bc1-4398-a324-8045e5f7e661 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:25.481631 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c355c9-6bc1-4398-a324-8045e5f7e661 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:25.483199 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c355c9-6bc1-4398-a324-8045e5f7e661 service nova] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:25.492583 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 724/1422] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:28:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:28:26.350953 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2272c1d9-780f-4808-b8b1-c2c60783e78c None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:26.351504 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2272c1d9-780f-4808-b8b1-c2c60783e78c None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:26.351623 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2272c1d9-780f-4808-b8b1-c2c60783e78c None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:26.352946 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 699/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 1 19:28:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:28:26.357782 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0591bb-f9a6-4159-9348-5e04a0a386d7 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:26.358233 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0591bb-f9a6-4159-9348-5e04a0a386d7 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:26.358343 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0591bb-f9a6-4159-9348-5e04a0a386d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:26.376510 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-0f0591bb-f9a6-4159-9348-5e04a0a386d7 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:28:26.377727 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-0f0591bb-f9a6-4159-9348-5e04a0a386d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:28:26.385519 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 725/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 1 19:28:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:28:26.536558 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2272c1d9-780f-4808-b8b1-c2c60783e78c None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:26.551413 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2272c1d9-780f-4808-b8b1-c2c60783e78c None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:26.556882 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33818b94-5ccb-47a4-aa54-6a34f5ed28b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13fd76fc7dd1410b9cde5adbaa6cb2e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:26.557546 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33818b94-5ccb-47a4-aa54-6a34f5ed28b0 service nova] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:26.557833 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33818b94-5ccb-47a4-aa54-6a34f5ed28b0 service nova] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:26.558113 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33818b94-5ccb-47a4-aa54-6a34f5ed28b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:26.566230 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33818b94-5ccb-47a4-aa54-6a34f5ed28b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:26.567815 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33818b94-5ccb-47a4-aa54-6a34f5ed28b0 service nova] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:26.576977 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 700/1425] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:28:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:28:27.442154 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c2580-feee-4d4a-83ad-03093f678150 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:27.442697 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c2580-feee-4d4a-83ad-03093f678150 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:27.442697 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c2580-feee-4d4a-83ad-03093f678150 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:27.444213 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 726/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 1 19:28:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:28:27.449041 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef83db-7fa4-4061-95fd-9877822c2995 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:27.449633 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef83db-7fa4-4061-95fd-9877822c2995 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:27.449633 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef83db-7fa4-4061-95fd-9877822c2995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:27.467779 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-76ef83db-7fa4-4061-95fd-9877822c2995 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:28:27.468951 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-76ef83db-7fa4-4061-95fd-9877822c2995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:28:27.477144 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 701/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 1 19:28:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:28:27.630331 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89c2580-feee-4d4a-83ad-03093f678150 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:27.644681 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89c2580-feee-4d4a-83ad-03093f678150 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:27.650172 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa832b7-fc73-4d19-8213-dc7dc66c46fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13fd76fc7dd1410b9cde5adbaa6cb2e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:27.650813 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa832b7-fc73-4d19-8213-dc7dc66c46fe service nova] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:27.651103 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa832b7-fc73-4d19-8213-dc7dc66c46fe service nova] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:27.651386 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa832b7-fc73-4d19-8213-dc7dc66c46fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:27.659623 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa832b7-fc73-4d19-8213-dc7dc66c46fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:27.661311 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa832b7-fc73-4d19-8213-dc7dc66c46fe service nova] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:27.671123 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 727/1428] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:28:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:28:28.470380 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb1e251-8307-478f-9eb8-56db4e03c24a None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:28.470930 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb1e251-8307-478f-9eb8-56db4e03c24a None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:28.470930 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb1e251-8307-478f-9eb8-56db4e03c24a None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:28.472949 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 702/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 1 19:28:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:28:28.478092 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040ba20-8835-4b3c-becb-5eff65b33a85 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:28.478513 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040ba20-8835-4b3c-becb-5eff65b33a85 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:28.478662 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040ba20-8835-4b3c-becb-5eff65b33a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:28.497375 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-8040ba20-8835-4b3c-becb-5eff65b33a85 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:28:28.498572 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-8040ba20-8835-4b3c-becb-5eff65b33a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:28:28.506425 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 728/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 1 19:28:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:28:28.657328 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb1e251-8307-478f-9eb8-56db4e03c24a None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:28.672126 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb1e251-8307-478f-9eb8-56db4e03c24a None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:28.677584 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd4087f-2b2a-4dea-a5c3-aec2ba53c31e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13fd76fc7dd1410b9cde5adbaa6cb2e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:28.678220 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd4087f-2b2a-4dea-a5c3-aec2ba53c31e service nova] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:28.678507 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd4087f-2b2a-4dea-a5c3-aec2ba53c31e service nova] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:28.678786 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd4087f-2b2a-4dea-a5c3-aec2ba53c31e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:28.686767 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd4087f-2b2a-4dea-a5c3-aec2ba53c31e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:28.688370 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd4087f-2b2a-4dea-a5c3-aec2ba53c31e service nova] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:28.698328 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 703/1431] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:28:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:28:29.497826 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c62a8-c8a8-4607-b725-5aeb78845b13 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:29.498362 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c62a8-c8a8-4607-b725-5aeb78845b13 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:29.498362 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c62a8-c8a8-4607-b725-5aeb78845b13 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:29.499723 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 729/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 1 19:28:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:28:29.504497 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df39641-4dcf-4845-a07e-0864fe45c97d None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:29.504945 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df39641-4dcf-4845-a07e-0864fe45c97d None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:29.505046 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df39641-4dcf-4845-a07e-0864fe45c97d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:29.523899 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-5df39641-4dcf-4845-a07e-0864fe45c97d None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:28:29.525089 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-5df39641-4dcf-4845-a07e-0864fe45c97d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:28:29.532825 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 704/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 1 19:28:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:28:29.685775 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c62a8-c8a8-4607-b725-5aeb78845b13 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:29.700076 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c62a8-c8a8-4607-b725-5aeb78845b13 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:29.705494 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bc736c-6a0f-47ae-b4de-fe4c957b35fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13fd76fc7dd1410b9cde5adbaa6cb2e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:29.706625 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc736c-6a0f-47ae-b4de-fe4c957b35fd service nova] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:29.706909 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc736c-6a0f-47ae-b4de-fe4c957b35fd service nova] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:29.707188 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc736c-6a0f-47ae-b4de-fe4c957b35fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:29.715288 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bc736c-6a0f-47ae-b4de-fe4c957b35fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:29.716867 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bc736c-6a0f-47ae-b4de-fe4c957b35fd service nova] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:29.726957 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 730/1434] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:28:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:28:30.542984 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b7e2b-67a4-4c9f-9d4c-49f740962e1b None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:30.543563 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b7e2b-67a4-4c9f-9d4c-49f740962e1b None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:30.543563 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b7e2b-67a4-4c9f-9d4c-49f740962e1b None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:30.544937 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 705/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 1 19:28:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:28:30.550829 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71802cc6-acd2-4f04-b39d-95db329779ca None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:30.551249 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71802cc6-acd2-4f04-b39d-95db329779ca None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:30.551450 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71802cc6-acd2-4f04-b39d-95db329779ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:30.569529 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-71802cc6-acd2-4f04-b39d-95db329779ca None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:28:30.570718 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-71802cc6-acd2-4f04-b39d-95db329779ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:28:30.578453 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 731/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 1 19:28:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:28:30.729812 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6b7e2b-67a4-4c9f-9d4c-49f740962e1b None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:30.744378 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6b7e2b-67a4-4c9f-9d4c-49f740962e1b None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:30.749751 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63741d21-0c24-4221-9091-16bd4338a189 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13fd76fc7dd1410b9cde5adbaa6cb2e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:30.750387 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63741d21-0c24-4221-9091-16bd4338a189 service nova] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:30.750676 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63741d21-0c24-4221-9091-16bd4338a189 service nova] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:30.750953 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63741d21-0c24-4221-9091-16bd4338a189 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:30.759914 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63741d21-0c24-4221-9091-16bd4338a189 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:30.761535 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63741d21-0c24-4221-9091-16bd4338a189 service nova] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:30.770860 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 706/1437] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:28:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:28:31.569337 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d50d0ed-9980-4467-bad8-60c26794ddc4 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:31.569886 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d50d0ed-9980-4467-bad8-60c26794ddc4 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:31.569886 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d50d0ed-9980-4467-bad8-60c26794ddc4 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:31.571347 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 732/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 1 19:28:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:28:31.576246 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc61c5-4718-44d1-be4a-4331e51f0dce None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:31.576678 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc61c5-4718-44d1-be4a-4331e51f0dce None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:31.576790 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc61c5-4718-44d1-be4a-4331e51f0dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:31.594921 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-7ffc61c5-4718-44d1-be4a-4331e51f0dce None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:28:31.596110 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-7ffc61c5-4718-44d1-be4a-4331e51f0dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:28:31.604601 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 707/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 1 19:28:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:28:31.752231 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d50d0ed-9980-4467-bad8-60c26794ddc4 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:31.766919 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d50d0ed-9980-4467-bad8-60c26794ddc4 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:31.773144 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21acc9f8-c6aa-41e6-b46d-62b048397822 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13fd76fc7dd1410b9cde5adbaa6cb2e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:31.773818 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21acc9f8-c6aa-41e6-b46d-62b048397822 service nova] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:31.774106 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21acc9f8-c6aa-41e6-b46d-62b048397822 service nova] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:31.774389 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21acc9f8-c6aa-41e6-b46d-62b048397822 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:31.782635 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21acc9f8-c6aa-41e6-b46d-62b048397822 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:31.784239 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21acc9f8-c6aa-41e6-b46d-62b048397822 service nova] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:31.793676 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 733/1440] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:28:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:28:33.719362 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6def2f-529b-4a6b-863e-739e671663ab None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:33.719959 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6def2f-529b-4a6b-863e-739e671663ab None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:33.719959 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6def2f-529b-4a6b-863e-739e671663ab None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:33.721328 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 708/1441] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 1 19:28:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:28:33.726498 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a067bb4-2e6c-469e-8ad9-92cbaeb55dd0 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:33.726929 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a067bb4-2e6c-469e-8ad9-92cbaeb55dd0 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:33.727066 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a067bb4-2e6c-469e-8ad9-92cbaeb55dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:33.746373 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-5a067bb4-2e6c-469e-8ad9-92cbaeb55dd0 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:28:33.747614 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-5a067bb4-2e6c-469e-8ad9-92cbaeb55dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:28:33.756303 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 734/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 1 19:28:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:28:33.794464 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6def2f-529b-4a6b-863e-739e671663ab None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:33.797734 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-5f6def2f-529b-4a6b-863e-739e671663ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:28:33.811904 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6def2f-529b-4a6b-863e-739e671663ab None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:33.816217 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c043f4-c5de-4d2d-9290-7ed11c78e6bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:33.816872 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c043f4-c5de-4d2d-9290-7ed11c78e6bc service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:33.817148 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c043f4-c5de-4d2d-9290-7ed11c78e6bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:33.817440 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c043f4-c5de-4d2d-9290-7ed11c78e6bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:33.826981 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c043f4-c5de-4d2d-9290-7ed11c78e6bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:33.828436 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c043f4-c5de-4d2d-9290-7ed11c78e6bc service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:33.839172 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 709/1443] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:28:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:28:36.091679 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace7732-7792-4a50-a4d5-d1a4fd2ef662 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:36.092219 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace7732-7792-4a50-a4d5-d1a4fd2ef662 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:36.092219 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace7732-7792-4a50-a4d5-d1a4fd2ef662 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:36.093637 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 735/1444] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 1 19:28:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:28:36.100227 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f284f-7af2-46a0-b269-96862b933aef None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:36.100741 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f284f-7af2-46a0-b269-96862b933aef None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:36.100848 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f284f-7af2-46a0-b269-96862b933aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:36.118540 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-9d6f284f-7af2-46a0-b269-96862b933aef None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:28:36.119743 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-9d6f284f-7af2-46a0-b269-96862b933aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:28:36.127511 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 710/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 1 19:28:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:28:36.166972 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ace7732-7792-4a50-a4d5-d1a4fd2ef662 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:36.177937 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ace7732-7792-4a50-a4d5-d1a4fd2ef662 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:36.181543 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904389c0-98eb-41dc-82bd-1ecbd4be59ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:36.182185 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904389c0-98eb-41dc-82bd-1ecbd4be59ea service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:36.182469 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904389c0-98eb-41dc-82bd-1ecbd4be59ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:36.182747 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904389c0-98eb-41dc-82bd-1ecbd4be59ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:36.192781 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904389c0-98eb-41dc-82bd-1ecbd4be59ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:36.194247 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904389c0-98eb-41dc-82bd-1ecbd4be59ea service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:36.205693 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 736/1446] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:28:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:28:38.584139 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127253be-2763-448b-8f7f-ce244658cc7e None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:38.584738 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127253be-2763-448b-8f7f-ce244658cc7e None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:38.584738 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127253be-2763-448b-8f7f-ce244658cc7e None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:38.586172 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 711/1447] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 1 19:28:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:28:38.591509 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f52b6e-e637-46a3-85dc-e9da603dcbe8 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:38.591948 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f52b6e-e637-46a3-85dc-e9da603dcbe8 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:38.592062 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f52b6e-e637-46a3-85dc-e9da603dcbe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:38.610394 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-e1f52b6e-e637-46a3-85dc-e9da603dcbe8 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:28:38.611571 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-e1f52b6e-e637-46a3-85dc-e9da603dcbe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:28:38.620802 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 737/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 1 19:28:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:28:38.658808 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127253be-2763-448b-8f7f-ce244658cc7e None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:38.669952 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127253be-2763-448b-8f7f-ce244658cc7e None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:38.673653 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b0e74b-d3e5-41a4-a1c6-63cb230832d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:38.674286 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b0e74b-d3e5-41a4-a1c6-63cb230832d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:38.674565 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b0e74b-d3e5-41a4-a1c6-63cb230832d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:38.675421 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b0e74b-d3e5-41a4-a1c6-63cb230832d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:38.684903 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b0e74b-d3e5-41a4-a1c6-63cb230832d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:38.686387 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b0e74b-d3e5-41a4-a1c6-63cb230832d9 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:38.695947 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 712/1449] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:28:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:28:40.849448 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e4e0f-c430-4777-a319-b68f96928b2a None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:40.849993 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e4e0f-c430-4777-a319-b68f96928b2a None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:40.849993 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e4e0f-c430-4777-a319-b68f96928b2a None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:40.851371 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 738/1450] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 1 19:28:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:28:40.856944 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad2896f-8583-425b-8c4c-0cf20f5d607c None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:40.857418 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad2896f-8583-425b-8c4c-0cf20f5d607c None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:40.857524 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad2896f-8583-425b-8c4c-0cf20f5d607c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:40.875234 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-fad2896f-8583-425b-8c4c-0cf20f5d607c None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:28:40.876439 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-fad2896f-8583-425b-8c4c-0cf20f5d607c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:28:40.884927 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 713/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 1 19:28:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:28:40.925373 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0e4e0f-c430-4777-a319-b68f96928b2a None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:40.942796 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0e4e0f-c430-4777-a319-b68f96928b2a None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:40.948466 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440669e8-8525-4208-aac7-6a6f802951bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:40.949506 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440669e8-8525-4208-aac7-6a6f802951bd service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:40.949991 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440669e8-8525-4208-aac7-6a6f802951bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:40.950486 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440669e8-8525-4208-aac7-6a6f802951bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:40.966472 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440669e8-8525-4208-aac7-6a6f802951bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:40.969107 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440669e8-8525-4208-aac7-6a6f802951bd service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:40.985317 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 739/1452] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:28:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:28:43.251340 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd8562-194d-4f8c-ac4d-59a1e795b8c3 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:43.251893 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd8562-194d-4f8c-ac4d-59a1e795b8c3 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:43.251893 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd8562-194d-4f8c-ac4d-59a1e795b8c3 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:43.253873 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 714/1453] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 1 19:28:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:28:43.260876 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463ebac-6509-49aa-a909-b8a1af1f2db2 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:43.261310 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463ebac-6509-49aa-a909-b8a1af1f2db2 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:43.261472 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463ebac-6509-49aa-a909-b8a1af1f2db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:43.278745 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-2463ebac-6509-49aa-a909-b8a1af1f2db2 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:28:43.279953 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-2463ebac-6509-49aa-a909-b8a1af1f2db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:28:43.287842 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 740/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 1 19:28:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:28:43.326740 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd8562-194d-4f8c-ac4d-59a1e795b8c3 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:43.339263 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd8562-194d-4f8c-ac4d-59a1e795b8c3 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:43.342911 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43dc61f-4c77-4906-aec1-8d1338c9a826 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:43.343548 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43dc61f-4c77-4906-aec1-8d1338c9a826 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:43.343832 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43dc61f-4c77-4906-aec1-8d1338c9a826 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:43.344108 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43dc61f-4c77-4906-aec1-8d1338c9a826 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:43.353495 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43dc61f-4c77-4906-aec1-8d1338c9a826 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:43.354942 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43dc61f-4c77-4906-aec1-8d1338c9a826 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:43.364972 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 715/1455] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:28:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:28:45.494953 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e0327b-b208-44c7-a8ef-4009e99416fa None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:45.495519 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e0327b-b208-44c7-a8ef-4009e99416fa None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:45.495519 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e0327b-b208-44c7-a8ef-4009e99416fa None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:45.496964 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 741/1456] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 1 19:28:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:28:45.502405 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed9663-7ec8-4ec2-8bdc-803c45b0af85 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:45.502864 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed9663-7ec8-4ec2-8bdc-803c45b0af85 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:45.503020 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed9663-7ec8-4ec2-8bdc-803c45b0af85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:45.524582 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-beed9663-7ec8-4ec2-8bdc-803c45b0af85 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:28:45.525830 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-beed9663-7ec8-4ec2-8bdc-803c45b0af85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:28:45.533568 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 716/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 1 19:28:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:28:45.572666 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e0327b-b208-44c7-a8ef-4009e99416fa None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:45.584088 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e0327b-b208-44c7-a8ef-4009e99416fa None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:45.587784 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237ff535-02ef-49aa-89e5-251297b5159e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:45.588450 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237ff535-02ef-49aa-89e5-251297b5159e service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:45.588710 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237ff535-02ef-49aa-89e5-251297b5159e service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:45.588984 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237ff535-02ef-49aa-89e5-251297b5159e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:45.598845 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237ff535-02ef-49aa-89e5-251297b5159e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:45.600311 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237ff535-02ef-49aa-89e5-251297b5159e service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:45.610094 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 742/1458] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:28:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:28:47.720875 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76447aa-a6ef-42ca-993b-ff03b84864ec None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:47.721488 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76447aa-a6ef-42ca-993b-ff03b84864ec None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:47.721606 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76447aa-a6ef-42ca-993b-ff03b84864ec None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:47.722897 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 717/1459] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 1 19:28:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:28:47.728549 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88386822-517a-448c-bd00-db08ec49edfc None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:47.729060 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88386822-517a-448c-bd00-db08ec49edfc None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:47.729162 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88386822-517a-448c-bd00-db08ec49edfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:47.747704 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-88386822-517a-448c-bd00-db08ec49edfc None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:28:47.748910 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-88386822-517a-448c-bd00-db08ec49edfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:28:47.757413 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 743/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 1 19:28:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:28:47.794658 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76447aa-a6ef-42ca-993b-ff03b84864ec None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:47.806606 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76447aa-a6ef-42ca-993b-ff03b84864ec None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:47.810333 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b1a690-7b3d-4ea4-abf6-5a77003ceb2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:47.810976 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b1a690-7b3d-4ea4-abf6-5a77003ceb2f service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:47.811261 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b1a690-7b3d-4ea4-abf6-5a77003ceb2f service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:47.811541 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b1a690-7b3d-4ea4-abf6-5a77003ceb2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:47.821797 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b1a690-7b3d-4ea4-abf6-5a77003ceb2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:47.823344 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b1a690-7b3d-4ea4-abf6-5a77003ceb2f service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:47.833201 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 718/1461] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:28:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:28:49.903828 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb0c31d-2a44-4ec3-9ab6-2ad96579ec74 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:49.904375 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb0c31d-2a44-4ec3-9ab6-2ad96579ec74 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:49.904375 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb0c31d-2a44-4ec3-9ab6-2ad96579ec74 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:49.905791 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 744/1462] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 1 19:28:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:28:49.911728 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47550b73-ec39-42d2-8c9a-c32d458b6f31 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:49.912153 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47550b73-ec39-42d2-8c9a-c32d458b6f31 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:49.912398 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47550b73-ec39-42d2-8c9a-c32d458b6f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:49.918376 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=79 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:28:49.932050 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-47550b73-ec39-42d2-8c9a-c32d458b6f31 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:28:49.933273 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-47550b73-ec39-42d2-8c9a-c32d458b6f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:28:49.948619 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 719/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 1 19:28:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:28:49.986263 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb0c31d-2a44-4ec3-9ab6-2ad96579ec74 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:49.991704 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=73 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:28:49.997943 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb0c31d-2a44-4ec3-9ab6-2ad96579ec74 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:50.001489 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ed11f-cabd-4696-a0f9-3a3fc2918ff7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:50.002139 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ed11f-cabd-4696-a0f9-3a3fc2918ff7 service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:50.002430 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ed11f-cabd-4696-a0f9-3a3fc2918ff7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:50.002788 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ed11f-cabd-4696-a0f9-3a3fc2918ff7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:50.012427 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8ed11f-cabd-4696-a0f9-3a3fc2918ff7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:50.013882 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8ed11f-cabd-4696-a0f9-3a3fc2918ff7 service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:50.023787 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 745/1464] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:28:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:28:52.088857 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fdfe9e-434a-4224-a44b-6cbf96c0f68b None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:52.089460 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fdfe9e-434a-4224-a44b-6cbf96c0f68b None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:52.089460 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fdfe9e-434a-4224-a44b-6cbf96c0f68b None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:52.090755 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 720/1465] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 1 19:28:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:28:52.096355 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0df9e-66ef-4ae8-b240-f655921ca93d None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:52.096858 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0df9e-66ef-4ae8-b240-f655921ca93d None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:52.096973 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0df9e-66ef-4ae8-b240-f655921ca93d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:52.115099 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-fcd0df9e-66ef-4ae8-b240-f655921ca93d None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:28:52.116316 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-fcd0df9e-66ef-4ae8-b240-f655921ca93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:28:52.124418 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 746/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 1 19:28:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:28:52.161626 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fdfe9e-434a-4224-a44b-6cbf96c0f68b None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:52.176549 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fdfe9e-434a-4224-a44b-6cbf96c0f68b None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:52.180352 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debb838c-8fb4-4425-a3db-2db63a7f01c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:52.180990 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debb838c-8fb4-4425-a3db-2db63a7f01c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:52.181294 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debb838c-8fb4-4425-a3db-2db63a7f01c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:52.181702 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debb838c-8fb4-4425-a3db-2db63a7f01c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:52.192210 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debb838c-8fb4-4425-a3db-2db63a7f01c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:52.193715 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debb838c-8fb4-4425-a3db-2db63a7f01c4 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:52.207153 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 721/1467] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:28:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 19:28:54.312141 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d0e13-dbd8-42e8-bef6-849a4b259ffc None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:54.312695 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d0e13-dbd8-42e8-bef6-849a4b259ffc None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:54.312695 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d0e13-dbd8-42e8-bef6-849a4b259ffc None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:54.314105 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 747/1468] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 1 19:28:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:28:54.320079 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed21ea2-533a-44fe-9ebb-bece852e28f1 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:54.320603 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed21ea2-533a-44fe-9ebb-bece852e28f1 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:54.320603 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed21ea2-533a-44fe-9ebb-bece852e28f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:54.339242 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-8ed21ea2-533a-44fe-9ebb-bece852e28f1 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:28:54.340439 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-8ed21ea2-533a-44fe-9ebb-bece852e28f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:28:54.348629 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 722/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 1 19:28:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:28:54.385380 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42d0e13-dbd8-42e8-bef6-849a4b259ffc None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:54.396969 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42d0e13-dbd8-42e8-bef6-849a4b259ffc None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:54.400670 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4070c069-6488-4bd0-8176-7f4275072884 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:54.401348 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070c069-6488-4bd0-8176-7f4275072884 service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:54.401641 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070c069-6488-4bd0-8176-7f4275072884 service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:54.401922 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070c069-6488-4bd0-8176-7f4275072884 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:54.411364 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4070c069-6488-4bd0-8176-7f4275072884 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:54.412805 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4070c069-6488-4bd0-8176-7f4275072884 service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:54.422835 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 748/1470] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:28:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:29:04.333992 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=11 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:29:04.418235 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=14 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:29:14.487763 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177cf235-1350-47f0-a23c-af5d7a8eac55 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:29:14.488400 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177cf235-1350-47f0-a23c-af5d7a8eac55 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:29:14.488400 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177cf235-1350-47f0-a23c-af5d7a8eac55 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:29:14.489794 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 723/1471] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:29:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:29:14.495406 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a277af-bca4-4313-b53f-ea56dfea0d2d None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:29:14.495859 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a277af-bca4-4313-b53f-ea56dfea0d2d None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:29:14.496007 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a277af-bca4-4313-b53f-ea56dfea0d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:29:14.513814 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-21a277af-bca4-4313-b53f-ea56dfea0d2d None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:29:14.515010 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-21a277af-bca4-4313-b53f-ea56dfea0d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:29:14.523354 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 749/1472] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:29:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:29:14.578911 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1168c-4051-47a9-952b-cc456f7ee239 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:29:14.579207 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1168c-4051-47a9-952b-cc456f7ee239 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:29:14.579489 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1168c-4051-47a9-952b-cc456f7ee239 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:29:14.581581 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 724/1473] 10.222.0.26 () {54 vars in 962 bytes} [Fri Jul 1 19:29:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:29:14.586492 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c15a9a3-9ef9-48af-aaf5-cdc7868d1b0f None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:29:14.586789 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c15a9a3-9ef9-48af-aaf5-cdc7868d1b0f None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:29:14.587076 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c15a9a3-9ef9-48af-aaf5-cdc7868d1b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:29:14.604858 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-6c15a9a3-9ef9-48af-aaf5-cdc7868d1b0f None None] MFA Rules not processed for user `5bbcb2463f9c46ddaaa247e4876aca48`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:29:14.606096 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-6c15a9a3-9ef9-48af-aaf5-cdc7868d1b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:29:14.612654 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 750/1474] 10.222.0.26 () {58 vars in 1059 bytes} [Fri Jul 1 19:29:14 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:29:14.619880 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c1168c-4051-47a9-952b-cc456f7ee239 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:29:14.631082 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c1168c-4051-47a9-952b-cc456f7ee239 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:29:14.634586 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec1f197-6b0b-4ea3-8871-7cb01db03690 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bbcb2463f9c46ddaaa247e4876aca48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:29:14.635217 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1f197-6b0b-4ea3-8871-7cb01db03690 service glance] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:29:14.635500 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1f197-6b0b-4ea3-8871-7cb01db03690 service glance] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:29:14.635775 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1f197-6b0b-4ea3-8871-7cb01db03690 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:29:14.645538 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec1f197-6b0b-4ea3-8871-7cb01db03690 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:29:14.646991 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec1f197-6b0b-4ea3-8871-7cb01db03690 service glance] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:29:14.658792 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 725/1475] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:29:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:29:16.784041 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad22c72-f699-4576-a60d-b476f7b244f7 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:29:16.784621 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad22c72-f699-4576-a60d-b476f7b244f7 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:29:16.784621 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad22c72-f699-4576-a60d-b476f7b244f7 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:29:16.786079 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 751/1476] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:29:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:29:16.791146 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75fae6-4404-4fb3-8660-8bab51b7e5c9 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:29:16.791610 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75fae6-4404-4fb3-8660-8bab51b7e5c9 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:29:16.791721 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75fae6-4404-4fb3-8660-8bab51b7e5c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:29:16.810101 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-0e75fae6-4404-4fb3-8660-8bab51b7e5c9 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:29:16.811300 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-0e75fae6-4404-4fb3-8660-8bab51b7e5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:29:16.819097 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 726/1477] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:29:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:29:16.842230 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad22c72-f699-4576-a60d-b476f7b244f7 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:29:16.854964 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad22c72-f699-4576-a60d-b476f7b244f7 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:29:16.859303 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6c33ed-7fdc-4a01-b314-de77f3c5c132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:29:16.859939 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6c33ed-7fdc-4a01-b314-de77f3c5c132 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:29:16.860221 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6c33ed-7fdc-4a01-b314-de77f3c5c132 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:29:16.860495 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6c33ed-7fdc-4a01-b314-de77f3c5c132 admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:29:16.861222 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6c33ed-7fdc-4a01-b314-de77f3c5c132 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:29:16.863659 dv-cinder-844601-7-smb devstack@keystone.service[80246]: WARNING py.warnings [None req-ba6c33ed-7fdc-4a01-b314-de77f3c5c132 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 01 19:29:16.863659 dv-cinder-844601-7-smb devstack@keystone.service[80246]: warnings.warn(msg) Jul 01 19:29:16.863659 dv-cinder-844601-7-smb devstack@keystone.service[80246]: Jul 01 19:29:16.864797 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6c33ed-7fdc-4a01-b314-de77f3c5c132 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:29:16.883568 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 752/1478] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Jul 1 19:29:16 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:29:18.922055 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df841ca2-7edc-4803-a95f-1595010911a6 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:29:18.922592 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df841ca2-7edc-4803-a95f-1595010911a6 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:29:18.922592 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df841ca2-7edc-4803-a95f-1595010911a6 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:29:18.923893 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 727/1479] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:29:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:29:18.929197 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1021fdc9-ba1a-4d34-abe0-534d93c5a901 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:29:18.929676 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1021fdc9-ba1a-4d34-abe0-534d93c5a901 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:29:18.929776 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1021fdc9-ba1a-4d34-abe0-534d93c5a901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:29:18.948070 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-1021fdc9-ba1a-4d34-abe0-534d93c5a901 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:29:18.949317 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-1021fdc9-ba1a-4d34-abe0-534d93c5a901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:29:18.957710 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 753/1480] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:29:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:29:18.999760 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df841ca2-7edc-4803-a95f-1595010911a6 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:29:19.013949 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df841ca2-7edc-4803-a95f-1595010911a6 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:29:19.019801 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1174dd-6269-4bdd-ba3a-102e32880c7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13fd76fc7dd1410b9cde5adbaa6cb2e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:29:19.020425 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1174dd-6269-4bdd-ba3a-102e32880c7a service nova] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:29:19.020709 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1174dd-6269-4bdd-ba3a-102e32880c7a service nova] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:29:19.020986 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1174dd-6269-4bdd-ba3a-102e32880c7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:29:19.028816 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1174dd-6269-4bdd-ba3a-102e32880c7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:29:19.030427 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1174dd-6269-4bdd-ba3a-102e32880c7a service nova] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:29:19.040879 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 728/1481] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:29:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:29:21.253659 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c12a7b-6762-4f7b-ad0b-abb8948644a1 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:29:21.254233 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c12a7b-6762-4f7b-ad0b-abb8948644a1 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:29:21.254233 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c12a7b-6762-4f7b-ad0b-abb8948644a1 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:29:21.255699 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 754/1482] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:29:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:29:21.261067 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae92c7-7512-475b-9ba0-6eb7a3903dd1 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:29:21.261551 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae92c7-7512-475b-9ba0-6eb7a3903dd1 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:29:21.261677 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae92c7-7512-475b-9ba0-6eb7a3903dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:29:21.279512 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-03ae92c7-7512-475b-9ba0-6eb7a3903dd1 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:29:21.280779 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-03ae92c7-7512-475b-9ba0-6eb7a3903dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:29:21.288464 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 729/1483] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:29:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:29:21.324754 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c12a7b-6762-4f7b-ad0b-abb8948644a1 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:29:21.341087 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c12a7b-6762-4f7b-ad0b-abb8948644a1 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:29:21.345035 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e191d34d-a1af-40dd-9afa-5f510157bd7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:29:21.345712 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e191d34d-a1af-40dd-9afa-5f510157bd7e service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:29:21.346019 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e191d34d-a1af-40dd-9afa-5f510157bd7e service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:29:21.346304 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e191d34d-a1af-40dd-9afa-5f510157bd7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:29:21.355994 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e191d34d-a1af-40dd-9afa-5f510157bd7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:29:21.357466 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e191d34d-a1af-40dd-9afa-5f510157bd7e service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:29:21.366984 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 755/1484] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:29:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:29:23.479865 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a017f-d7a4-4f0c-a6d4-b802b0a4069c None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:29:23.480420 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a017f-d7a4-4f0c-a6d4-b802b0a4069c None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:29:23.480420 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a017f-d7a4-4f0c-a6d4-b802b0a4069c None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:29:23.481857 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 730/1485] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:29:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:29:23.487778 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c090256-2579-4438-bb2f-aade638f6118 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:29:23.488225 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c090256-2579-4438-bb2f-aade638f6118 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:29:23.488332 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c090256-2579-4438-bb2f-aade638f6118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:29:23.505936 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-1c090256-2579-4438-bb2f-aade638f6118 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:29:23.507170 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-1c090256-2579-4438-bb2f-aade638f6118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:29:23.515153 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 756/1486] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:29:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:29:23.553540 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a017f-d7a4-4f0c-a6d4-b802b0a4069c None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:29:23.563888 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a017f-d7a4-4f0c-a6d4-b802b0a4069c None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:29:23.567301 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea8f3f5-fd4f-464d-b2f5-1807f6da9aaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:29:23.567923 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea8f3f5-fd4f-464d-b2f5-1807f6da9aaa service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:29:23.568213 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea8f3f5-fd4f-464d-b2f5-1807f6da9aaa service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:29:23.568488 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea8f3f5-fd4f-464d-b2f5-1807f6da9aaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:29:23.577080 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea8f3f5-fd4f-464d-b2f5-1807f6da9aaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:29:23.578548 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea8f3f5-fd4f-464d-b2f5-1807f6da9aaa service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:29:23.588129 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 731/1487] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:29:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 19:29:25.803280 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b457b53-2ec5-4531-b8fc-ddb6749b2471 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:29:25.803891 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b457b53-2ec5-4531-b8fc-ddb6749b2471 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:29:25.803891 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b457b53-2ec5-4531-b8fc-ddb6749b2471 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:29:25.805076 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 757/1488] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:29:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:29:25.810294 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37bc52-2d20-4147-a274-f8f273ce07c4 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:29:25.810723 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37bc52-2d20-4147-a274-f8f273ce07c4 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:29:25.810852 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37bc52-2d20-4147-a274-f8f273ce07c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:29:25.828971 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-de37bc52-2d20-4147-a274-f8f273ce07c4 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:29:25.830194 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-de37bc52-2d20-4147-a274-f8f273ce07c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:29:25.838549 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 732/1489] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:29:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:29:25.879036 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b457b53-2ec5-4531-b8fc-ddb6749b2471 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:29:25.890333 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b457b53-2ec5-4531-b8fc-ddb6749b2471 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:29:25.894591 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469b8b29-4d4a-4787-b0d2-7cddeffbb04b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:29:25.895239 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b8b29-4d4a-4787-b0d2-7cddeffbb04b service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:29:25.895526 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b8b29-4d4a-4787-b0d2-7cddeffbb04b service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:29:25.895807 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b8b29-4d4a-4787-b0d2-7cddeffbb04b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:29:25.905560 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469b8b29-4d4a-4787-b0d2-7cddeffbb04b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:29:25.906998 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469b8b29-4d4a-4787-b0d2-7cddeffbb04b service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:29:25.916715 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 758/1490] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:29:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:29:28.139307 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1ece17-4294-47e0-88c9-ceca863f5409 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:29:28.139894 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1ece17-4294-47e0-88c9-ceca863f5409 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:29:28.139894 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1ece17-4294-47e0-88c9-ceca863f5409 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:29:28.141245 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 733/1491] 10.222.0.26 () {54 vars in 926 bytes} [Fri Jul 1 19:29:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:29:28.146762 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6bb75c-6fc5-4876-8ca4-2008e3d93d84 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:29:28.147243 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6bb75c-6fc5-4876-8ca4-2008e3d93d84 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:29:28.147444 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6bb75c-6fc5-4876-8ca4-2008e3d93d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:29:28.166950 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-0e6bb75c-6fc5-4876-8ca4-2008e3d93d84 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:29:28.168174 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-0e6bb75c-6fc5-4876-8ca4-2008e3d93d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:29:28.177069 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 759/1492] 10.222.0.26 () {58 vars in 1023 bytes} [Fri Jul 1 19:29:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:29:28.216846 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1ece17-4294-47e0-88c9-ceca863f5409 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:29:28.228816 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1ece17-4294-47e0-88c9-ceca863f5409 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:29:28.232408 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e08b74-e118-4b03-80d3-00488632b825 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:29:28.233073 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e08b74-e118-4b03-80d3-00488632b825 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:29:28.233396 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e08b74-e118-4b03-80d3-00488632b825 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:29:28.233673 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e08b74-e118-4b03-80d3-00488632b825 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:29:28.242796 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e08b74-e118-4b03-80d3-00488632b825 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:29:28.244226 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e08b74-e118-4b03-80d3-00488632b825 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:29:28.253631 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 734/1493] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:29:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:29:38.160458 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=33 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:29:38.249549 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=33 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:30:54.979617 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f073343-195c-47cf-8785-3e5608fd0764 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:30:54.980236 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f073343-195c-47cf-8785-3e5608fd0764 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:30:54.980236 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f073343-195c-47cf-8785-3e5608fd0764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:30:54.998976 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-9f073343-195c-47cf-8785-3e5608fd0764 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:30:55.000177 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-9f073343-195c-47cf-8785-3e5608fd0764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:30:55.008200 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 760/1494] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:30:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:30:55.016320 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaea631-f929-4a61-b2a3-8cdbc9bb501a None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:30:55.016845 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaea631-f929-4a61-b2a3-8cdbc9bb501a None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:30:55.016955 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaea631-f929-4a61-b2a3-8cdbc9bb501a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:30:55.040602 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-4eaea631-f929-4a61-b2a3-8cdbc9bb501a None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:30:55.042693 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-4eaea631-f929-4a61-b2a3-8cdbc9bb501a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:30:55.056556 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 735/1495] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:30:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:30:55.061218 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f073343-195c-47cf-8785-3e5608fd0764 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:30:55.071135 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f073343-195c-47cf-8785-3e5608fd0764 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:30:55.075905 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4625d15-2ee3-4ea9-8bf6-342aadf43369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:30:55.076561 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4625d15-2ee3-4ea9-8bf6-342aadf43369 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:30:55.076846 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4625d15-2ee3-4ea9-8bf6-342aadf43369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:30:55.077124 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4625d15-2ee3-4ea9-8bf6-342aadf43369 admin admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:30:55.077888 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4625d15-2ee3-4ea9-8bf6-342aadf43369 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:30:55.078200 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4625d15-2ee3-4ea9-8bf6-342aadf43369 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:30:55.079248 dv-cinder-844601-7-smb devstack@keystone.service[80246]: WARNING py.warnings [None req-f4625d15-2ee3-4ea9-8bf6-342aadf43369 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 19:30:55.079248 dv-cinder-844601-7-smb devstack@keystone.service[80246]: warnings.warn(msg) Jul 01 19:30:55.079248 dv-cinder-844601-7-smb devstack@keystone.service[80246]: Jul 01 19:30:55.080114 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4625d15-2ee3-4ea9-8bf6-342aadf43369 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:30:55.092328 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 761/1496] 10.222.0.26 () {58 vars in 1152 bytes} [Fri Jul 1 19:30:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:30:55.101180 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaea631-f929-4a61-b2a3-8cdbc9bb501a None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:30:55.111649 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaea631-f929-4a61-b2a3-8cdbc9bb501a None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:30:55.117491 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaf5376-6ced-4893-9cb8-5afa901e0a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:30:55.118158 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf5376-6ced-4893-9cb8-5afa901e0a4d admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:30:55.118445 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf5376-6ced-4893-9cb8-5afa901e0a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:30:55.118725 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf5376-6ced-4893-9cb8-5afa901e0a4d admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:30:55.119437 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaf5376-6ced-4893-9cb8-5afa901e0a4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:30:55.121261 dv-cinder-844601-7-smb devstack@keystone.service[80247]: WARNING py.warnings [None req-ddaf5376-6ced-4893-9cb8-5afa901e0a4d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 01 19:30:55.121261 dv-cinder-844601-7-smb devstack@keystone.service[80247]: warnings.warn(msg) Jul 01 19:30:55.121261 dv-cinder-844601-7-smb devstack@keystone.service[80247]: Jul 01 19:30:55.122461 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaf5376-6ced-4893-9cb8-5afa901e0a4d admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:30:55.161154 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 736/1497] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:30:55 2022] POST /identity/v3/projects => generated 379 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:30:55.165520 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4625d15-2ee3-4ea9-8bf6-342aadf43369 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:30:55.176442 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4625d15-2ee3-4ea9-8bf6-342aadf43369 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:30:55.251563 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd3725-4d12-4df9-9516-dbd34fa3fdf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:30:55.252173 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd3725-4d12-4df9-9516-dbd34fa3fdf7 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:30:55.252459 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd3725-4d12-4df9-9516-dbd34fa3fdf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:30:55.252745 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd3725-4d12-4df9-9516-dbd34fa3fdf7 admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:30:55.253506 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bd3725-4d12-4df9-9516-dbd34fa3fdf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:30:55.254536 dv-cinder-844601-7-smb devstack@keystone.service[80246]: WARNING py.warnings [None req-87bd3725-4d12-4df9-9516-dbd34fa3fdf7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 01 19:30:55.254536 dv-cinder-844601-7-smb devstack@keystone.service[80246]: warnings.warn(msg) Jul 01 19:30:55.254536 dv-cinder-844601-7-smb devstack@keystone.service[80246]: Jul 01 19:30:55.255811 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bd3725-4d12-4df9-9516-dbd34fa3fdf7 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:30:55.282415 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 762/1498] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:30:55 2022] POST /identity/v3/users => generated 290 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:30:55.286655 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaf5376-6ced-4893-9cb8-5afa901e0a4d admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:30:55.297880 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaf5376-6ced-4893-9cb8-5afa901e0a4d admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:30:55.302404 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e2225-3cfa-4067-96e0-618ba1c6bf84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:30:55.303073 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e2225-3cfa-4067-96e0-618ba1c6bf84 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:30:55.303361 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e2225-3cfa-4067-96e0-618ba1c6bf84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:30:55.303644 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e2225-3cfa-4067-96e0-618ba1c6bf84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:30:55.304516 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345e2225-3cfa-4067-96e0-618ba1c6bf84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:30:55.305588 dv-cinder-844601-7-smb devstack@keystone.service[80247]: WARNING py.warnings [None req-345e2225-3cfa-4067-96e0-618ba1c6bf84 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 19:30:55.305588 dv-cinder-844601-7-smb devstack@keystone.service[80247]: warnings.warn(msg) Jul 01 19:30:55.305588 dv-cinder-844601-7-smb devstack@keystone.service[80247]: Jul 01 19:30:55.306534 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345e2225-3cfa-4067-96e0-618ba1c6bf84 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:30:55.320754 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 737/1499] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:30:55.329645 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd3725-4d12-4df9-9516-dbd34fa3fdf7 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:30:55.336701 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd3725-4d12-4df9-9516-dbd34fa3fdf7 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:30:55.341456 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a8b8bc-8376-4f28-b128-02fba1600160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:30:55.342127 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a8b8bc-8376-4f28-b128-02fba1600160 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:30:55.342421 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a8b8bc-8376-4f28-b128-02fba1600160 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:30:55.342701 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a8b8bc-8376-4f28-b128-02fba1600160 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:30:55.343430 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a8b8bc-8376-4f28-b128-02fba1600160 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:30:55.345056 dv-cinder-844601-7-smb devstack@keystone.service[80246]: WARNING py.warnings [None req-a9a8b8bc-8376-4f28-b128-02fba1600160 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 19:30:55.345056 dv-cinder-844601-7-smb devstack@keystone.service[80246]: warnings.warn(msg) Jul 01 19:30:55.345056 dv-cinder-844601-7-smb devstack@keystone.service[80246]: Jul 01 19:30:55.345979 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a8b8bc-8376-4f28-b128-02fba1600160 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:30:55.361048 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 763/1500] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:30:55.365564 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e2225-3cfa-4067-96e0-618ba1c6bf84 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:30:55.375756 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e2225-3cfa-4067-96e0-618ba1c6bf84 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:30:55.380363 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8697cf12-b533-4bf2-b9ec-73a49b7f5ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:30:55.381267 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8697cf12-b533-4bf2-b9ec-73a49b7f5ebc admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:30:55.381560 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8697cf12-b533-4bf2-b9ec-73a49b7f5ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:30:55.381840 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8697cf12-b533-4bf2-b9ec-73a49b7f5ebc admin admin] PATH_INFO: `/v3/projects/e2e21d57300242a6b66a1a5744d52723/users/6b2d051971ce458a8e7432738190072c/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:30:55.397800 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8697cf12-b533-4bf2-b9ec-73a49b7f5ebc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2e21d57300242a6b66a1a5744d52723, user_id=6b2d051971ce458a8e7432738190072c, role_id=4cbf6ec846eb4b7c8cc52e9bfd6f076f)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:30:55.400239 dv-cinder-844601-7-smb devstack@keystone.service[80247]: WARNING py.warnings [None req-8697cf12-b533-4bf2-b9ec-73a49b7f5ebc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 01 19:30:55.400239 dv-cinder-844601-7-smb devstack@keystone.service[80247]: warnings.warn(msg) Jul 01 19:30:55.400239 dv-cinder-844601-7-smb devstack@keystone.service[80247]: Jul 01 19:30:55.402236 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8697cf12-b533-4bf2-b9ec-73a49b7f5ebc admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:30:55.418212 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 738/1501] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:30:55 2022] PUT /identity/v3/projects/e2e21d57300242a6b66a1a5744d52723/users/6b2d051971ce458a8e7432738190072c/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:30:55.430899 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbebd28-74ca-48d5-be90-3b3c22bc0fd0 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:30:55.431183 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbebd28-74ca-48d5-be90-3b3c22bc0fd0 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:30:55.431459 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbebd28-74ca-48d5-be90-3b3c22bc0fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:30:55.461334 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-1fbebd28-74ca-48d5-be90-3b3c22bc0fd0 None None] MFA Rules not processed for user `6b2d051971ce458a8e7432738190072c`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:30:55.462550 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-1fbebd28-74ca-48d5-be90-3b3c22bc0fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:30:55.530627 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 764/1502] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:30:55 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:30:55.544227 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a1949-75d6-4bc0-b142-e39e8bc3810d None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:30:55.544519 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a1949-75d6-4bc0-b142-e39e8bc3810d None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:30:55.544799 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a1949-75d6-4bc0-b142-e39e8bc3810d None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:30:55.546442 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 739/1503] 10.222.0.26 () {54 vars in 963 bytes} [Fri Jul 1 19:30:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:30:55.551546 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f93046-58ed-49bc-abfe-d05e637719f5 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:30:55.551837 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f93046-58ed-49bc-abfe-d05e637719f5 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:30:55.552122 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f93046-58ed-49bc-abfe-d05e637719f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:30:55.570251 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-12f93046-58ed-49bc-abfe-d05e637719f5 None None] MFA Rules not processed for user `9a3ed285ee4c4d04abf7daf0aeb9fb7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:30:55.571470 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-12f93046-58ed-49bc-abfe-d05e637719f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:30:55.632762 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:30:55.644316 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 765/1504] 10.222.0.26 () {58 vars in 1060 bytes} [Fri Jul 1 19:30:55 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:30:55.652142 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59a1949-75d6-4bc0-b142-e39e8bc3810d None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:30:55.668054 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59a1949-75d6-4bc0-b142-e39e8bc3810d None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:30:55.672627 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69421e46-b1e1-49c7-b3f8-382d874a779c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a3ed285ee4c4d04abf7daf0aeb9fb7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:30:55.673299 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69421e46-b1e1-49c7-b3f8-382d874a779c service cinder] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:30:55.673587 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69421e46-b1e1-49c7-b3f8-382d874a779c service cinder] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:30:55.673876 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69421e46-b1e1-49c7-b3f8-382d874a779c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:30:55.682792 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69421e46-b1e1-49c7-b3f8-382d874a779c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:30:55.684240 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69421e46-b1e1-49c7-b3f8-382d874a779c service cinder] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:30:55.693980 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 740/1505] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:30:55 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:30:55.736791 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe5b271-2045-4a47-a0c8-e099cc14a4f3 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:30:55.737080 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe5b271-2045-4a47-a0c8-e099cc14a4f3 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:30:55.737393 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe5b271-2045-4a47-a0c8-e099cc14a4f3 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:30:55.738685 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 766/1506] 10.222.0.26 () {52 vars in 829 bytes} [Fri Jul 1 19:30:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:30:55.742917 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69421e46-b1e1-49c7-b3f8-382d874a779c service cinder] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:30:55.815823 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69421e46-b1e1-49c7-b3f8-382d874a779c service cinder] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:30:55.820637 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c578bef5-a8f3-4e01-8096-2ce7c88a20fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:30:55.821554 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c578bef5-a8f3-4e01-8096-2ce7c88a20fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:30:55.821845 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c578bef5-a8f3-4e01-8096-2ce7c88a20fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:30:55.822125 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c578bef5-a8f3-4e01-8096-2ce7c88a20fb admin admin] PATH_INFO: `/v3/users/6b2d051971ce458a8e7432738190072c` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:30:55.823346 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c578bef5-a8f3-4e01-8096-2ce7c88a20fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b2d051971ce458a8e7432738190072c)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:30:55.824371 dv-cinder-844601-7-smb devstack@keystone.service[80247]: WARNING py.warnings [None req-c578bef5-a8f3-4e01-8096-2ce7c88a20fb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 01 19:30:55.824371 dv-cinder-844601-7-smb devstack@keystone.service[80247]: warnings.warn(msg) Jul 01 19:30:55.824371 dv-cinder-844601-7-smb devstack@keystone.service[80247]: Jul 01 19:30:55.825617 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c578bef5-a8f3-4e01-8096-2ce7c88a20fb admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:30:55.894062 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-c578bef5-a8f3-4e01-8096-2ce7c88a20fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b2d051971ce458a8e7432738190072c'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:30:55.894844 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-c578bef5-a8f3-4e01-8096-2ce7c88a20fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b2d051971ce458a8e7432738190072c'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:30:55.907768 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-c578bef5-a8f3-4e01-8096-2ce7c88a20fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b2d051971ce458a8e7432738190072c'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:30:55.918559 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-c578bef5-a8f3-4e01-8096-2ce7c88a20fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b2d051971ce458a8e7432738190072c'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:30:55.919211 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-c578bef5-a8f3-4e01-8096-2ce7c88a20fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b2d051971ce458a8e7432738190072c'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:30:55.936404 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:30:55.945764 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 741/1507] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:30:55 2022] DELETE /identity/v3/users/6b2d051971ce458a8e7432738190072c => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:30:55.950519 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb5567-ff9d-49c7-bfd5-1e48cb13e0a8 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:30:55.950840 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb5567-ff9d-49c7-bfd5-1e48cb13e0a8 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:30:55.951131 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb5567-ff9d-49c7-bfd5-1e48cb13e0a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:30:55.970132 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-b0cb5567-ff9d-49c7-bfd5-1e48cb13e0a8 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:30:55.971373 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-b0cb5567-ff9d-49c7-bfd5-1e48cb13e0a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:30:56.032283 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 767/1508] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:30:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:30:56.042011 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c578bef5-a8f3-4e01-8096-2ce7c88a20fb admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:30:56.043513 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-c578bef5-a8f3-4e01-8096-2ce7c88a20fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:30:56.103408 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c578bef5-a8f3-4e01-8096-2ce7c88a20fb admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:30:56.107058 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee53664-090a-4ac2-9030-60957beea72e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:30:56.107712 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee53664-090a-4ac2-9030-60957beea72e service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:30:56.107998 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee53664-090a-4ac2-9030-60957beea72e service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:30:56.108276 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee53664-090a-4ac2-9030-60957beea72e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:30:56.118360 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee53664-090a-4ac2-9030-60957beea72e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:30:56.120034 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee53664-090a-4ac2-9030-60957beea72e service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:30:56.130196 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 742/1509] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:30:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:30:56.487869 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cb5567-ff9d-49c7-bfd5-1e48cb13e0a8 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:30:56.489412 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-b0cb5567-ff9d-49c7-bfd5-1e48cb13e0a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:30:56.504267 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cb5567-ff9d-49c7-bfd5-1e48cb13e0a8 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:30:56.509863 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd372702-85d1-464e-8ecc-e4e7ffeeefff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:30:56.510078 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd372702-85d1-464e-8ecc-e4e7ffeeefff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:30:56.510363 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd372702-85d1-464e-8ecc-e4e7ffeeefff admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:30:56.510653 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd372702-85d1-464e-8ecc-e4e7ffeeefff admin admin] PATH_INFO: `/v3/projects/e2e21d57300242a6b66a1a5744d52723` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:30:56.511913 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd372702-85d1-464e-8ecc-e4e7ffeeefff admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2e21d57300242a6b66a1a5744d52723)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:30:56.512935 dv-cinder-844601-7-smb devstack@keystone.service[80246]: WARNING py.warnings [None req-fd372702-85d1-464e-8ecc-e4e7ffeeefff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 01 19:30:56.512935 dv-cinder-844601-7-smb devstack@keystone.service[80246]: warnings.warn(msg) Jul 01 19:30:56.512935 dv-cinder-844601-7-smb devstack@keystone.service[80246]: Jul 01 19:30:56.514428 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd372702-85d1-464e-8ecc-e4e7ffeeefff admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:30:56.587410 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-fd372702-85d1-464e-8ecc-e4e7ffeeefff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2e21d57300242a6b66a1a5744d52723', 'request_id': 'req-fd372702-85d1-464e-8ecc-e4e7ffeeefff'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:30:56.604103 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-fd372702-85d1-464e-8ecc-e4e7ffeeefff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2e21d57300242a6b66a1a5744d52723', 'request_id': 'req-fd372702-85d1-464e-8ecc-e4e7ffeeefff'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:30:56.611653 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-fd372702-85d1-464e-8ecc-e4e7ffeeefff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2e21d57300242a6b66a1a5744d52723', 'request_id': 'req-fd372702-85d1-464e-8ecc-e4e7ffeeefff'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:30:56.631676 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-fd372702-85d1-464e-8ecc-e4e7ffeeefff admin admin] The token cache is being invalidate because project e2e21d57300242a6b66a1a5744d52723 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:30:56.632152 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-fd372702-85d1-464e-8ecc-e4e7ffeeefff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:30:56.633179 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-fd372702-85d1-464e-8ecc-e4e7ffeeefff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:30:56.634928 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 768/1510] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:30:56 2022] DELETE /identity/v3/projects/e2e21d57300242a6b66a1a5744d52723 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 19:31:06.125822 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:31:06.626406 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:32:44.905895 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8613a4-2141-4e9e-82de-dbf08be590bb None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:32:44.906515 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8613a4-2141-4e9e-82de-dbf08be590bb None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:32:44.906515 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8613a4-2141-4e9e-82de-dbf08be590bb None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:32:44.907888 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 743/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 1 19:32:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:32:44.913008 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468bf1f-b2d8-402a-8713-150902b17514 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:32:44.913487 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468bf1f-b2d8-402a-8713-150902b17514 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:32:44.913597 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468bf1f-b2d8-402a-8713-150902b17514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:32:44.932416 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-8468bf1f-b2d8-402a-8713-150902b17514 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:32:44.933661 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-8468bf1f-b2d8-402a-8713-150902b17514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:32:44.991833 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 769/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 1 19:32:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:32:45.148491 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8613a4-2141-4e9e-82de-dbf08be590bb None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:32:45.150229 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-0d8613a4-2141-4e9e-82de-dbf08be590bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:32:45.223545 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8613a4-2141-4e9e-82de-dbf08be590bb None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:32:45.228942 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3d8f36-c3ae-4e2d-89aa-b718ea73f5d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13fd76fc7dd1410b9cde5adbaa6cb2e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:32:45.229614 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d8f36-c3ae-4e2d-89aa-b718ea73f5d7 service nova] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:32:45.229902 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d8f36-c3ae-4e2d-89aa-b718ea73f5d7 service nova] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:32:45.230180 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d8f36-c3ae-4e2d-89aa-b718ea73f5d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:32:45.238348 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3d8f36-c3ae-4e2d-89aa-b718ea73f5d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:32:45.239949 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3d8f36-c3ae-4e2d-89aa-b718ea73f5d7 service nova] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:32:45.249716 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 744/1513] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:32:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:32:46.085330 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b48f6-806c-4a6c-bafc-85b1dc5c7907 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:32:46.085906 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b48f6-806c-4a6c-bafc-85b1dc5c7907 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:32:46.085906 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b48f6-806c-4a6c-bafc-85b1dc5c7907 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:32:46.087256 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 770/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 1 19:32:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:32:46.091976 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769f488-90f8-48c1-9889-6f66279fd1c6 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:32:46.092396 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769f488-90f8-48c1-9889-6f66279fd1c6 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:32:46.092542 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769f488-90f8-48c1-9889-6f66279fd1c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:32:46.111045 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-8769f488-90f8-48c1-9889-6f66279fd1c6 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:32:46.112262 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-8769f488-90f8-48c1-9889-6f66279fd1c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:32:46.120238 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 745/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 1 19:32:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:32:46.274900 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b48f6-806c-4a6c-bafc-85b1dc5c7907 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:32:46.289442 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b48f6-806c-4a6c-bafc-85b1dc5c7907 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:32:46.295900 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235abf48-55db-4e74-9e8a-66cef47fd6b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13fd76fc7dd1410b9cde5adbaa6cb2e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:32:46.296562 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235abf48-55db-4e74-9e8a-66cef47fd6b3 service nova] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:32:46.296850 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235abf48-55db-4e74-9e8a-66cef47fd6b3 service nova] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:32:46.297127 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235abf48-55db-4e74-9e8a-66cef47fd6b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:32:46.305622 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235abf48-55db-4e74-9e8a-66cef47fd6b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:32:46.307220 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235abf48-55db-4e74-9e8a-66cef47fd6b3 service nova] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:32:46.317991 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 771/1516] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:32:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:32:46.772225 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27eb040-968c-48c7-a72a-12205b9326e5 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:32:46.772513 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27eb040-968c-48c7-a72a-12205b9326e5 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:32:46.772796 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27eb040-968c-48c7-a72a-12205b9326e5 None None] PATH_INFO: `/v3` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:32:46.774173 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 746/1517] 10.222.0.55 () {54 vars in 925 bytes} [Fri Jul 1 19:32:46 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:32:46.796111 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581f317-c601-4306-b653-aed252733c69 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:32:46.796409 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581f317-c601-4306-b653-aed252733c69 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:32:46.796693 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581f317-c601-4306-b653-aed252733c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:32:46.815703 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-b581f317-c601-4306-b653-aed252733c69 None None] MFA Rules not processed for user `941e65d95bcd4e66a6489280520c12de`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:32:46.817041 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-b581f317-c601-4306-b653-aed252733c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:32:46.879886 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 772/1518] 10.222.0.55 () {58 vars in 1015 bytes} [Fri Jul 1 19:32:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:32:55.965570 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef35390-312f-4c12-910a-f5e5a6870a7b None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:32:55.966160 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef35390-312f-4c12-910a-f5e5a6870a7b None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:32:55.966160 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef35390-312f-4c12-910a-f5e5a6870a7b None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:32:55.968046 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 747/1519] 10.222.0.26 () {54 vars in 960 bytes} [Fri Jul 1 19:32:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:32:55.973151 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea813bb5-40d3-4c23-91a9-648a4f00b438 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:32:55.973570 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea813bb5-40d3-4c23-91a9-648a4f00b438 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:32:55.973786 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea813bb5-40d3-4c23-91a9-648a4f00b438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:32:55.991355 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-ea813bb5-40d3-4c23-91a9-648a4f00b438 None None] MFA Rules not processed for user `941e65d95bcd4e66a6489280520c12de`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:32:55.992553 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-ea813bb5-40d3-4c23-91a9-648a4f00b438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:32:56.001260 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 773/1520] 10.222.0.26 () {58 vars in 1057 bytes} [Fri Jul 1 19:32:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:32:56.008594 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef35390-312f-4c12-910a-f5e5a6870a7b None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:32:56.022471 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef35390-312f-4c12-910a-f5e5a6870a7b None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:32:56.027423 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce82a2e6-3299-4a1d-b474-04b27b740686 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '941e65d95bcd4e66a6489280520c12de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:32:56.028048 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce82a2e6-3299-4a1d-b474-04b27b740686 service placement] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:32:56.028336 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce82a2e6-3299-4a1d-b474-04b27b740686 service placement] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:32:56.028618 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce82a2e6-3299-4a1d-b474-04b27b740686 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:32:56.037484 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce82a2e6-3299-4a1d-b474-04b27b740686 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:32:56.039088 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce82a2e6-3299-4a1d-b474-04b27b740686 service placement] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:32:56.048848 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 748/1521] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:32:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:32:57.559002 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cbb426-ca85-4ed7-9519-7f057e3a5cd2 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:32:57.559480 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cbb426-ca85-4ed7-9519-7f057e3a5cd2 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:32:57.559590 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cbb426-ca85-4ed7-9519-7f057e3a5cd2 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:32:57.561088 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 774/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 1 19:32:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:32:57.565965 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd64ea9-08f5-4e9c-9908-fb5e5ad2ef48 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:32:57.566412 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd64ea9-08f5-4e9c-9908-fb5e5ad2ef48 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:32:57.566521 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd64ea9-08f5-4e9c-9908-fb5e5ad2ef48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:32:57.586764 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-bbd64ea9-08f5-4e9c-9908-fb5e5ad2ef48 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:32:57.587957 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-bbd64ea9-08f5-4e9c-9908-fb5e5ad2ef48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:32:57.596327 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 749/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 1 19:32:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:32:57.750093 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cbb426-ca85-4ed7-9519-7f057e3a5cd2 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:32:57.765470 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cbb426-ca85-4ed7-9519-7f057e3a5cd2 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:32:57.771135 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebfe7c6-edb8-4eb3-8830-4823545658eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13fd76fc7dd1410b9cde5adbaa6cb2e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:32:57.771772 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebfe7c6-edb8-4eb3-8830-4823545658eb service nova] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:32:57.772062 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebfe7c6-edb8-4eb3-8830-4823545658eb service nova] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:32:57.772346 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebfe7c6-edb8-4eb3-8830-4823545658eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:32:57.781135 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebfe7c6-edb8-4eb3-8830-4823545658eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:32:57.782764 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebfe7c6-edb8-4eb3-8830-4823545658eb service nova] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:32:57.792320 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 775/1524] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:32:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:32:58.600313 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f92ee4-9b1a-408b-8895-ac71475f807f None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:32:58.600912 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f92ee4-9b1a-408b-8895-ac71475f807f None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:32:58.600912 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f92ee4-9b1a-408b-8895-ac71475f807f None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:32:58.602267 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 750/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 1 19:32:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:32:58.606982 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b6a17b-0067-445a-baa6-2bd6b38d7ccd None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:32:58.607392 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b6a17b-0067-445a-baa6-2bd6b38d7ccd None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:32:58.607588 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b6a17b-0067-445a-baa6-2bd6b38d7ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:32:58.626077 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-d6b6a17b-0067-445a-baa6-2bd6b38d7ccd None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:32:58.627264 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-d6b6a17b-0067-445a-baa6-2bd6b38d7ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:32:58.635084 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 776/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 1 19:32:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:32:58.785034 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f92ee4-9b1a-408b-8895-ac71475f807f None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:32:58.800476 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f92ee4-9b1a-408b-8895-ac71475f807f None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:32:58.806043 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2515916-6106-4d7b-b9ac-06a086339899 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13fd76fc7dd1410b9cde5adbaa6cb2e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:32:58.806682 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2515916-6106-4d7b-b9ac-06a086339899 service nova] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:32:58.806967 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2515916-6106-4d7b-b9ac-06a086339899 service nova] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:32:58.807246 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2515916-6106-4d7b-b9ac-06a086339899 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:32:58.815396 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2515916-6106-4d7b-b9ac-06a086339899 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:32:58.817000 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2515916-6106-4d7b-b9ac-06a086339899 service nova] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:32:58.826337 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 751/1527] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:32:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:33:02.705304 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2237a29-9c06-42be-8602-5d3dd77ff741 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:33:02.705923 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2237a29-9c06-42be-8602-5d3dd77ff741 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:33:02.705923 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2237a29-9c06-42be-8602-5d3dd77ff741 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:33:02.707340 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 777/1528] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 1 19:33:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:33:02.712879 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c89e754-5abb-4d8a-9aa9-78cdf9c50aa4 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:33:02.713327 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c89e754-5abb-4d8a-9aa9-78cdf9c50aa4 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:33:02.713481 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c89e754-5abb-4d8a-9aa9-78cdf9c50aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:33:02.731744 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-4c89e754-5abb-4d8a-9aa9-78cdf9c50aa4 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:33:02.732934 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-4c89e754-5abb-4d8a-9aa9-78cdf9c50aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:33:02.742100 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 752/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 1 19:33:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:33:02.779648 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2237a29-9c06-42be-8602-5d3dd77ff741 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:33:02.781981 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-c2237a29-9c06-42be-8602-5d3dd77ff741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:33:02.839037 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2237a29-9c06-42be-8602-5d3dd77ff741 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:33:02.843250 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291694b4-0cf6-421c-ab70-a9a096d3f3eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:33:02.843896 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291694b4-0cf6-421c-ab70-a9a096d3f3eb service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:33:02.844183 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291694b4-0cf6-421c-ab70-a9a096d3f3eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:33:02.844465 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291694b4-0cf6-421c-ab70-a9a096d3f3eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:33:02.853961 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291694b4-0cf6-421c-ab70-a9a096d3f3eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:33:02.855389 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291694b4-0cf6-421c-ab70-a9a096d3f3eb service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:33:02.860300 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:33:02.865850 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 778/1530] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:33:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:33:04.877515 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35833b5-30c0-4aec-887f-3aad51dae4db None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:33:04.878085 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35833b5-30c0-4aec-887f-3aad51dae4db None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:33:04.878085 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35833b5-30c0-4aec-887f-3aad51dae4db None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:33:04.879450 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 753/1531] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 1 19:33:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:33:04.884736 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a6506-683d-495d-bdff-fc475cd93e48 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:33:04.885190 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a6506-683d-495d-bdff-fc475cd93e48 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:33:04.885335 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a6506-683d-495d-bdff-fc475cd93e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:33:04.904116 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-ff1a6506-683d-495d-bdff-fc475cd93e48 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:33:04.905309 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-ff1a6506-683d-495d-bdff-fc475cd93e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:33:04.913283 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 779/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 1 19:33:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:33:04.949943 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35833b5-30c0-4aec-887f-3aad51dae4db None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:33:04.960528 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35833b5-30c0-4aec-887f-3aad51dae4db None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:33:04.963981 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d477c30-309d-40c8-8762-8a6a306102c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:33:04.964604 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d477c30-309d-40c8-8762-8a6a306102c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:33:04.964884 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d477c30-309d-40c8-8762-8a6a306102c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:33:04.965156 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d477c30-309d-40c8-8762-8a6a306102c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:33:04.973869 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d477c30-309d-40c8-8762-8a6a306102c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:33:04.975291 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d477c30-309d-40c8-8762-8a6a306102c6 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:33:04.984879 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 754/1533] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:33:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:33:08.538732 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f45d9a-1949-4ac8-b356-801055894e42 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:33:08.539353 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f45d9a-1949-4ac8-b356-801055894e42 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:33:08.539353 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f45d9a-1949-4ac8-b356-801055894e42 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:33:08.540684 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 780/1534] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 1 19:33:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:33:08.546012 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627c7ff-aa1a-4569-87b1-581dc54c342b None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:33:08.546436 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627c7ff-aa1a-4569-87b1-581dc54c342b None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:33:08.546579 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627c7ff-aa1a-4569-87b1-581dc54c342b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:33:08.552929 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=62 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:33:08.565984 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-8627c7ff-aa1a-4569-87b1-581dc54c342b None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:33:08.567172 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-8627c7ff-aa1a-4569-87b1-581dc54c342b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:33:08.574890 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 755/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 1 19:33:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:33:08.878641 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f45d9a-1949-4ac8-b356-801055894e42 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:33:08.880296 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-10f45d9a-1949-4ac8-b356-801055894e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:33:08.938070 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f45d9a-1949-4ac8-b356-801055894e42 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:33:08.941599 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610277e5-beea-4cf5-8b79-d2388956b944 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a3ed285ee4c4d04abf7daf0aeb9fb7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:33:08.942236 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610277e5-beea-4cf5-8b79-d2388956b944 service cinder] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:33:08.942522 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610277e5-beea-4cf5-8b79-d2388956b944 service cinder] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:33:08.942801 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610277e5-beea-4cf5-8b79-d2388956b944 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:33:08.951639 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610277e5-beea-4cf5-8b79-d2388956b944 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:33:08.953052 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610277e5-beea-4cf5-8b79-d2388956b944 service cinder] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:33:08.962372 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 781/1536] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:33:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:33:10.997626 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ebb4a-f025-4222-8f54-6d3b2598fd2d None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:33:10.998783 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ebb4a-f025-4222-8f54-6d3b2598fd2d None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:33:10.998783 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ebb4a-f025-4222-8f54-6d3b2598fd2d None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:33:11.000097 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 756/1537] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 1 19:33:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:33:11.005390 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab647fa-736f-4644-97c0-8d9dfb45a6e8 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:33:11.005845 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab647fa-736f-4644-97c0-8d9dfb45a6e8 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:33:11.005954 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab647fa-736f-4644-97c0-8d9dfb45a6e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:33:11.023549 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-dab647fa-736f-4644-97c0-8d9dfb45a6e8 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:33:11.024731 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-dab647fa-736f-4644-97c0-8d9dfb45a6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:33:11.032440 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 782/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 1 19:33:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:33:11.342032 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ebb4a-f025-4222-8f54-6d3b2598fd2d None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:33:11.343733 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-406ebb4a-f025-4222-8f54-6d3b2598fd2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:33:11.359157 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ebb4a-f025-4222-8f54-6d3b2598fd2d None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:33:11.362708 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75446bc6-97c0-4c5e-b2d0-7d69200408c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a3ed285ee4c4d04abf7daf0aeb9fb7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:33:11.363366 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75446bc6-97c0-4c5e-b2d0-7d69200408c8 service cinder] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:33:11.363646 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75446bc6-97c0-4c5e-b2d0-7d69200408c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:33:11.363918 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75446bc6-97c0-4c5e-b2d0-7d69200408c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:33:11.379335 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75446bc6-97c0-4c5e-b2d0-7d69200408c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:33:11.382003 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75446bc6-97c0-4c5e-b2d0-7d69200408c8 service cinder] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:33:11.398854 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 757/1539] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:33:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:33:21.018477 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=32 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:33:21.391484 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=8 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:34:43.794490 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bbce90-3da0-48f1-b6d5-661cf6061171 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:43.797303 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bbce90-3da0-48f1-b6d5-661cf6061171 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:43.797303 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bbce90-3da0-48f1-b6d5-661cf6061171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:43.821026 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-a9bbce90-3da0-48f1-b6d5-661cf6061171 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:34:43.822359 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-a9bbce90-3da0-48f1-b6d5-661cf6061171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:34:43.834950 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 783/1540] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:34:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:34:43.844446 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178620cb-fe49-440e-a0b0-7331cc03d273 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:43.845056 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178620cb-fe49-440e-a0b0-7331cc03d273 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:43.845056 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178620cb-fe49-440e-a0b0-7331cc03d273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:43.871810 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-178620cb-fe49-440e-a0b0-7331cc03d273 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:34:43.873159 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-178620cb-fe49-440e-a0b0-7331cc03d273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:34:43.887730 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 758/1541] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:34:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:34:43.892504 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bbce90-3da0-48f1-b6d5-661cf6061171 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:43.903472 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bbce90-3da0-48f1-b6d5-661cf6061171 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:43.913978 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21d8f60-0d2f-44b3-8bd8-71e8c42bc22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:43.914681 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d8f60-0d2f-44b3-8bd8-71e8c42bc22b admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:43.914974 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d8f60-0d2f-44b3-8bd8-71e8c42bc22b admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:43.915257 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d8f60-0d2f-44b3-8bd8-71e8c42bc22b admin admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:43.916035 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21d8f60-0d2f-44b3-8bd8-71e8c42bc22b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:34:43.916353 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21d8f60-0d2f-44b3-8bd8-71e8c42bc22b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:43.918387 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21d8f60-0d2f-44b3-8bd8-71e8c42bc22b admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:43.933908 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 784/1542] 10.222.0.26 () {58 vars in 1152 bytes} [Fri Jul 1 19:34:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:34:43.943347 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178620cb-fe49-440e-a0b0-7331cc03d273 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:43.954321 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178620cb-fe49-440e-a0b0-7331cc03d273 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:43.962101 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fb03e6-a858-4d53-bc3a-09c524b8d22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:43.962781 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb03e6-a858-4d53-bc3a-09c524b8d22a admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:43.963075 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb03e6-a858-4d53-bc3a-09c524b8d22a admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:43.963357 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb03e6-a858-4d53-bc3a-09c524b8d22a admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:43.964070 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fb03e6-a858-4d53-bc3a-09c524b8d22a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:43.966027 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fb03e6-a858-4d53-bc3a-09c524b8d22a admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:44.010486 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 759/1543] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:34:43 2022] POST /identity/v3/projects => generated 379 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:34:44.014487 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21d8f60-0d2f-44b3-8bd8-71e8c42bc22b admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:44.026280 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21d8f60-0d2f-44b3-8bd8-71e8c42bc22b admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:44.116994 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbcc6bc-6df1-42fe-a631-425403058ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:44.117713 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbcc6bc-6df1-42fe-a631-425403058ccc admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:44.118008 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbcc6bc-6df1-42fe-a631-425403058ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:44.118293 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbcc6bc-6df1-42fe-a631-425403058ccc admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:44.119004 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbcc6bc-6df1-42fe-a631-425403058ccc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:44.121189 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbcc6bc-6df1-42fe-a631-425403058ccc admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:44.152090 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 785/1544] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:34:44 2022] POST /identity/v3/users => generated 290 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:34:44.157115 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fb03e6-a858-4d53-bc3a-09c524b8d22a admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:44.175423 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fb03e6-a858-4d53-bc3a-09c524b8d22a admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:44.184221 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06df8d91-e222-4dc2-8c70-918142d0f914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:44.184919 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06df8d91-e222-4dc2-8c70-918142d0f914 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:44.185209 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06df8d91-e222-4dc2-8c70-918142d0f914 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:44.185517 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06df8d91-e222-4dc2-8c70-918142d0f914 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:44.186258 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06df8d91-e222-4dc2-8c70-918142d0f914 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:44.188430 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06df8d91-e222-4dc2-8c70-918142d0f914 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:44.204096 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 760/1545] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:34:44 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:34:44.212081 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbcc6bc-6df1-42fe-a631-425403058ccc admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:44.241379 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbcc6bc-6df1-42fe-a631-425403058ccc admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:44.257054 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abf64a9-7366-402b-881e-984b557f52ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:44.258534 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf64a9-7366-402b-881e-984b557f52ec admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:44.259058 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf64a9-7366-402b-881e-984b557f52ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:44.259571 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf64a9-7366-402b-881e-984b557f52ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:44.260974 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abf64a9-7366-402b-881e-984b557f52ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:44.264123 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abf64a9-7366-402b-881e-984b557f52ec admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:44.289710 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 786/1546] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:34:44 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:34:44.296098 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06df8d91-e222-4dc2-8c70-918142d0f914 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:44.311209 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06df8d91-e222-4dc2-8c70-918142d0f914 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:44.320047 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdc5579-300c-4568-968b-1f4278b3f7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:44.320948 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc5579-300c-4568-968b-1f4278b3f7c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:44.321255 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc5579-300c-4568-968b-1f4278b3f7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:44.321669 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc5579-300c-4568-968b-1f4278b3f7c4 admin admin] PATH_INFO: `/v3/projects/ac9ba42d89ea4bcabeb630bcc12d0d39/users/2db4b840ca744ad6975c4fb3ad5e2351/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:44.346862 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdc5579-300c-4568-968b-1f4278b3f7c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac9ba42d89ea4bcabeb630bcc12d0d39, user_id=2db4b840ca744ad6975c4fb3ad5e2351, role_id=4cbf6ec846eb4b7c8cc52e9bfd6f076f)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:44.350069 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdc5579-300c-4568-968b-1f4278b3f7c4 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:44.386298 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 761/1547] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:34:44 2022] PUT /identity/v3/projects/ac9ba42d89ea4bcabeb630bcc12d0d39/users/2db4b840ca744ad6975c4fb3ad5e2351/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:34:44.391245 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5000a3a1-6dc3-4176-9de4-894638f78d1c None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:44.391780 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5000a3a1-6dc3-4176-9de4-894638f78d1c None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:44.392292 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5000a3a1-6dc3-4176-9de4-894638f78d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:44.409421 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f14c2-6510-443e-8450-a1a39bb7ec09 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:44.409778 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f14c2-6510-443e-8450-a1a39bb7ec09 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:44.410003 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f14c2-6510-443e-8450-a1a39bb7ec09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:44.441154 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-5000a3a1-6dc3-4176-9de4-894638f78d1c None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:34:44.441743 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-0e9f14c2-6510-443e-8450-a1a39bb7ec09 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:34:44.442961 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-0e9f14c2-6510-443e-8450-a1a39bb7ec09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:34:44.443480 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-5000a3a1-6dc3-4176-9de4-894638f78d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:34:44.574986 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 762/1548] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:34:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:34:44.578152 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a6d68-70e8-45d4-ab3e-dc464c445819 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:44.578450 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a6d68-70e8-45d4-ab3e-dc464c445819 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:44.578738 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a6d68-70e8-45d4-ab3e-dc464c445819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:44.613868 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 787/1549] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:34:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:34:44.619547 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e53a4b5-adc4-4b35-a5d6-464bf02923b4 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:44.619547 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e53a4b5-adc4-4b35-a5d6-464bf02923b4 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:44.619547 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e53a4b5-adc4-4b35-a5d6-464bf02923b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:44.619860 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-c97a6d68-70e8-45d4-ab3e-dc464c445819 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:34:44.619860 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-c97a6d68-70e8-45d4-ab3e-dc464c445819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:34:44.642918 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-2e53a4b5-adc4-4b35-a5d6-464bf02923b4 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:34:44.644491 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-2e53a4b5-adc4-4b35-a5d6-464bf02923b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:34:44.644751 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 763/1550] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:34:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:34:44.648103 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c66f44e-8460-4544-92a1-60825a8ac905 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:44.648398 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c66f44e-8460-4544-92a1-60825a8ac905 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:44.648678 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c66f44e-8460-4544-92a1-60825a8ac905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:44.658713 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 788/1551] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:34:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:34:44.659424 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e53a4b5-adc4-4b35-a5d6-464bf02923b4 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:44.674987 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-3c66f44e-8460-4544-92a1-60825a8ac905 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:34:44.676188 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-3c66f44e-8460-4544-92a1-60825a8ac905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:34:44.685291 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 764/1552] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:34:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:34:44.685951 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a18b0b-d291-4acb-8a79-c9cbdb958206 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:44.686257 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a18b0b-d291-4acb-8a79-c9cbdb958206 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:44.686510 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a18b0b-d291-4acb-8a79-c9cbdb958206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:44.706198 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-c0a18b0b-d291-4acb-8a79-c9cbdb958206 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:34:44.707400 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-c0a18b0b-d291-4acb-8a79-c9cbdb958206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:34:44.724923 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 765/1553] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:34:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:34:44.726931 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c86930-8aac-4989-94df-400993f48f72 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:44.727978 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c86930-8aac-4989-94df-400993f48f72 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:44.728869 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c86930-8aac-4989-94df-400993f48f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:44.743646 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e53a4b5-adc4-4b35-a5d6-464bf02923b4 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:44.747231 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d952b-259e-40af-94a3-b51d211c7b2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:44.747882 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d952b-259e-40af-94a3-b51d211c7b2a service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:44.748172 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d952b-259e-40af-94a3-b51d211c7b2a service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:44.749041 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-62c86930-8aac-4989-94df-400993f48f72 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:34:44.749190 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d952b-259e-40af-94a3-b51d211c7b2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:44.750831 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-62c86930-8aac-4989-94df-400993f48f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:34:44.757293 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:34:44.758940 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 766/1554] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:34:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:34:44.760471 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a698a-017a-4b98-98be-3c90e742cce8 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:44.760805 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a698a-017a-4b98-98be-3c90e742cce8 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:44.761079 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a698a-017a-4b98-98be-3c90e742cce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:44.763426 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9d952b-259e-40af-94a3-b51d211c7b2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:44.765435 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9d952b-259e-40af-94a3-b51d211c7b2a service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:44.776078 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 789/1555] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:34:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:34:44.777510 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa72bb91-d752-4858-8afd-aad1af7d6007 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:44.777809 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa72bb91-d752-4858-8afd-aad1af7d6007 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:44.778136 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa72bb91-d752-4858-8afd-aad1af7d6007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:44.779149 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-646a698a-017a-4b98-98be-3c90e742cce8 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:34:44.780356 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-646a698a-017a-4b98-98be-3c90e742cce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:34:44.789391 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 767/1556] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:34:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:34:44.790570 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c259a2-d811-4682-8e47-ae3ec1c9e1e4 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:44.790857 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c259a2-d811-4682-8e47-ae3ec1c9e1e4 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:44.791145 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c259a2-d811-4682-8e47-ae3ec1c9e1e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:44.799454 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-aa72bb91-d752-4858-8afd-aad1af7d6007 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:34:44.800821 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-aa72bb91-d752-4858-8afd-aad1af7d6007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:34:44.809606 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 790/1557] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:34:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:34:44.813220 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b1d551-211c-4acc-bf29-5152c68796ad None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:44.813907 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b1d551-211c-4acc-bf29-5152c68796ad None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:44.814253 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b1d551-211c-4acc-bf29-5152c68796ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:44.815014 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-e5c259a2-d811-4682-8e47-ae3ec1c9e1e4 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:34:44.816554 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-e5c259a2-d811-4682-8e47-ae3ec1c9e1e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:34:44.829307 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 768/1558] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:34:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:34:44.829307 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c039e7-bf10-44ea-8f8b-e887dcf5132d None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:44.829307 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c039e7-bf10-44ea-8f8b-e887dcf5132d None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:44.829307 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c039e7-bf10-44ea-8f8b-e887dcf5132d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:44.837263 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-a8b1d551-211c-4acc-bf29-5152c68796ad None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:34:44.838640 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-a8b1d551-211c-4acc-bf29-5152c68796ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:34:44.846221 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-10c039e7-bf10-44ea-8f8b-e887dcf5132d None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:34:44.847178 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 791/1559] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:34:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:34:44.847466 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-10c039e7-bf10-44ea-8f8b-e887dcf5132d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:34:44.852218 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d71cb-0f72-4f53-a787-533a91ca5651 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:44.852514 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d71cb-0f72-4f53-a787-533a91ca5651 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:44.852799 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d71cb-0f72-4f53-a787-533a91ca5651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:44.856502 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 769/1560] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:34:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:34:44.856502 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c039e7-bf10-44ea-8f8b-e887dcf5132d None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:44.870885 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c039e7-bf10-44ea-8f8b-e887dcf5132d None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:44.877360 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f190d1-652a-4530-8268-cbe4b9f93b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:44.878297 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f190d1-652a-4530-8268-cbe4b9f93b70 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:44.878698 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f190d1-652a-4530-8268-cbe4b9f93b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:44.879051 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f190d1-652a-4530-8268-cbe4b9f93b70 admin admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:44.879846 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f190d1-652a-4530-8268-cbe4b9f93b70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:34:44.880257 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f190d1-652a-4530-8268-cbe4b9f93b70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:44.881368 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-f96d71cb-0f72-4f53-a787-533a91ca5651 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:34:44.881771 dv-cinder-844601-7-smb devstack@keystone.service[80247]: WARNING py.warnings [None req-68f190d1-652a-4530-8268-cbe4b9f93b70 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 19:34:44.881771 dv-cinder-844601-7-smb devstack@keystone.service[80247]: warnings.warn(msg) Jul 01 19:34:44.881771 dv-cinder-844601-7-smb devstack@keystone.service[80247]: Jul 01 19:34:44.882946 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f190d1-652a-4530-8268-cbe4b9f93b70 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:44.883072 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-f96d71cb-0f72-4f53-a787-533a91ca5651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:34:44.899853 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 792/1561] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:34:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:34:44.900038 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 770/1562] 10.222.0.26 () {58 vars in 1152 bytes} [Fri Jul 1 19:34:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:34:44.900162 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96d71cb-0f72-4f53-a787-533a91ca5651 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:44.900271 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f190d1-652a-4530-8268-cbe4b9f93b70 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:44.911880 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f190d1-652a-4530-8268-cbe4b9f93b70 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:44.913802 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96d71cb-0f72-4f53-a787-533a91ca5651 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:44.918008 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904bc5b0-9442-4269-ad78-68d2b78f208a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:44.919019 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904bc5b0-9442-4269-ad78-68d2b78f208a admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:44.919397 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904bc5b0-9442-4269-ad78-68d2b78f208a admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:44.919684 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904bc5b0-9442-4269-ad78-68d2b78f208a admin admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:44.920295 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3076158-755f-4f2b-a54d-ff8e39d404e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:44.920689 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904bc5b0-9442-4269-ad78-68d2b78f208a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:34:44.921057 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904bc5b0-9442-4269-ad78-68d2b78f208a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:44.921185 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3076158-755f-4f2b-a54d-ff8e39d404e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:44.921940 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3076158-755f-4f2b-a54d-ff8e39d404e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:44.922174 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3076158-755f-4f2b-a54d-ff8e39d404e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:44.922930 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3076158-755f-4f2b-a54d-ff8e39d404e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:34:44.923293 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904bc5b0-9442-4269-ad78-68d2b78f208a admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:44.923418 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3076158-755f-4f2b-a54d-ff8e39d404e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:44.925168 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3076158-755f-4f2b-a54d-ff8e39d404e3 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:44.938062 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 771/1563] 10.222.0.26 () {58 vars in 1152 bytes} [Fri Jul 1 19:34:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:34:44.939158 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4622fe-c934-422d-987f-f8ff8aa13fd0 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:44.939906 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4622fe-c934-422d-987f-f8ff8aa13fd0 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:44.939906 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4622fe-c934-422d-987f-f8ff8aa13fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:44.956975 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 793/1564] 10.222.0.26 () {58 vars in 1152 bytes} [Fri Jul 1 19:34:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:34:44.956975 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3076158-755f-4f2b-a54d-ff8e39d404e3 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:44.960720 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-9e4622fe-c934-422d-987f-f8ff8aa13fd0 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:34:44.962148 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-9e4622fe-c934-422d-987f-f8ff8aa13fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:34:44.968201 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3076158-755f-4f2b-a54d-ff8e39d404e3 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:44.973205 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005ee79c-8a70-4c28-a23e-469312706b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:44.973963 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ee79c-8a70-4c28-a23e-469312706b0d admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:44.974175 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ee79c-8a70-4c28-a23e-469312706b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:44.974451 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ee79c-8a70-4c28-a23e-469312706b0d admin admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:44.975192 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005ee79c-8a70-4c28-a23e-469312706b0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:34:44.975502 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005ee79c-8a70-4c28-a23e-469312706b0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:44.977450 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005ee79c-8a70-4c28-a23e-469312706b0d admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:44.980385 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 772/1565] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:34:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:34:44.983958 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bd0a88-42c8-4249-8e64-7958038cc8b6 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:44.985117 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bd0a88-42c8-4249-8e64-7958038cc8b6 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:44.985617 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bd0a88-42c8-4249-8e64-7958038cc8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:45.000217 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 794/1566] 10.222.0.26 () {58 vars in 1152 bytes} [Fri Jul 1 19:34:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:34:45.001469 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005ee79c-8a70-4c28-a23e-469312706b0d admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:45.009213 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-f4bd0a88-42c8-4249-8e64-7958038cc8b6 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:34:45.010589 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-f4bd0a88-42c8-4249-8e64-7958038cc8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:34:45.012393 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005ee79c-8a70-4c28-a23e-469312706b0d admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:45.017742 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdaa698-5a85-43e5-9205-7cf6c8b309d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:45.018472 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdaa698-5a85-43e5-9205-7cf6c8b309d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:45.018780 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdaa698-5a85-43e5-9205-7cf6c8b309d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:45.019039 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdaa698-5a85-43e5-9205-7cf6c8b309d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:45.019848 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdaa698-5a85-43e5-9205-7cf6c8b309d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:34:45.020158 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdaa698-5a85-43e5-9205-7cf6c8b309d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:45.021384 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 773/1567] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:34:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:34:45.021876 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdaa698-5a85-43e5-9205-7cf6c8b309d9 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:45.022792 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bd0a88-42c8-4249-8e64-7958038cc8b6 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:45.042333 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 795/1568] 10.222.0.26 () {58 vars in 1152 bytes} [Fri Jul 1 19:34:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:34:45.042333 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdaa698-5a85-43e5-9205-7cf6c8b309d9 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:45.042635 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bd0a88-42c8-4249-8e64-7958038cc8b6 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:45.042635 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3625178-0abc-4cef-b3b6-ae0e7cc1965b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:45.042635 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3625178-0abc-4cef-b3b6-ae0e7cc1965b admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:45.043181 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3625178-0abc-4cef-b3b6-ae0e7cc1965b admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:45.043452 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3625178-0abc-4cef-b3b6-ae0e7cc1965b admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:45.044164 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3625178-0abc-4cef-b3b6-ae0e7cc1965b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:45.046189 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3625178-0abc-4cef-b3b6-ae0e7cc1965b admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:45.049920 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdaa698-5a85-43e5-9205-7cf6c8b309d9 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:45.055767 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:34:45.056230 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea7cb36-394f-4960-8015-e6a72de2d943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:45.056935 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea7cb36-394f-4960-8015-e6a72de2d943 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:45.057459 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea7cb36-394f-4960-8015-e6a72de2d943 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:45.057750 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea7cb36-394f-4960-8015-e6a72de2d943 admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:45.058916 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea7cb36-394f-4960-8015-e6a72de2d943 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:45.060279 dv-cinder-844601-7-smb devstack@keystone.service[80246]: WARNING py.warnings [None req-1ea7cb36-394f-4960-8015-e6a72de2d943 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 01 19:34:45.060279 dv-cinder-844601-7-smb devstack@keystone.service[80246]: warnings.warn(msg) Jul 01 19:34:45.060279 dv-cinder-844601-7-smb devstack@keystone.service[80246]: Jul 01 19:34:45.061965 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea7cb36-394f-4960-8015-e6a72de2d943 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:45.079914 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 774/1569] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:34:45 2022] POST /identity/v3/projects => generated 389 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:34:45.080965 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3625178-0abc-4cef-b3b6-ae0e7cc1965b admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:45.097620 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 796/1570] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:34:45 2022] POST /identity/v3/projects => generated 385 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:34:45.098557 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea7cb36-394f-4960-8015-e6a72de2d943 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:45.161582 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3625178-0abc-4cef-b3b6-ae0e7cc1965b admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:45.185159 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea7cb36-394f-4960-8015-e6a72de2d943 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:45.190081 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c26a29-75eb-4d77-8dde-86371af578f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:45.190762 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c26a29-75eb-4d77-8dde-86371af578f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:45.191053 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c26a29-75eb-4d77-8dde-86371af578f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:45.191708 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c26a29-75eb-4d77-8dde-86371af578f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:45.192078 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c26a29-75eb-4d77-8dde-86371af578f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:34:45.192397 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c26a29-75eb-4d77-8dde-86371af578f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:45.194056 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c26a29-75eb-4d77-8dde-86371af578f6 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:45.207066 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 797/1571] 10.222.0.26 () {58 vars in 1152 bytes} [Fri Jul 1 19:34:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:34:45.207921 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c26a29-75eb-4d77-8dde-86371af578f6 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:45.219273 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c26a29-75eb-4d77-8dde-86371af578f6 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:45.224282 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3079b166-66c0-4928-a3ab-ec0c30f9d939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:45.224970 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3079b166-66c0-4928-a3ab-ec0c30f9d939 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:45.225577 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3079b166-66c0-4928-a3ab-ec0c30f9d939 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:45.225866 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3079b166-66c0-4928-a3ab-ec0c30f9d939 admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:45.226584 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3079b166-66c0-4928-a3ab-ec0c30f9d939 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:45.228567 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3079b166-66c0-4928-a3ab-ec0c30f9d939 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:45.248884 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329db1e1-40b9-4471-b7be-e120afa670d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:45.249822 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329db1e1-40b9-4471-b7be-e120afa670d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:45.250199 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329db1e1-40b9-4471-b7be-e120afa670d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:45.250581 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329db1e1-40b9-4471-b7be-e120afa670d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:45.251323 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329db1e1-40b9-4471-b7be-e120afa670d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:45.254384 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329db1e1-40b9-4471-b7be-e120afa670d0 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:45.259617 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 798/1572] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:34:45 2022] POST /identity/v3/projects => generated 381 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:34:45.260424 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3079b166-66c0-4928-a3ab-ec0c30f9d939 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:45.286075 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 775/1573] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:34:45 2022] POST /identity/v3/projects => generated 377 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:34:45.287885 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329db1e1-40b9-4471-b7be-e120afa670d0 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:45.323347 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:34:45.342093 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3079b166-66c0-4928-a3ab-ec0c30f9d939 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:45.369663 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329db1e1-40b9-4471-b7be-e120afa670d0 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:45.378083 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6899acd1-6934-43f2-b96d-8e8940d2fd2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:45.379003 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899acd1-6934-43f2-b96d-8e8940d2fd2f admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:45.379402 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899acd1-6934-43f2-b96d-8e8940d2fd2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:45.379960 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899acd1-6934-43f2-b96d-8e8940d2fd2f admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:45.380987 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6899acd1-6934-43f2-b96d-8e8940d2fd2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:45.385988 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6899acd1-6934-43f2-b96d-8e8940d2fd2f admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:45.411897 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f52fdac-6652-44df-beb2-efd0e3738e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:45.413123 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f52fdac-6652-44df-beb2-efd0e3738e29 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:45.413606 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f52fdac-6652-44df-beb2-efd0e3738e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:45.414182 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f52fdac-6652-44df-beb2-efd0e3738e29 admin admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:45.415076 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f52fdac-6652-44df-beb2-efd0e3738e29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:34:45.415542 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f52fdac-6652-44df-beb2-efd0e3738e29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:45.417356 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f52fdac-6652-44df-beb2-efd0e3738e29 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:45.419016 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 776/1574] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:34:45 2022] POST /identity/v3/projects => generated 365 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:34:45.419839 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6899acd1-6934-43f2-b96d-8e8940d2fd2f admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:45.429530 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:34:45.431962 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 799/1575] 10.222.0.26 () {58 vars in 1152 bytes} [Fri Jul 1 19:34:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:34:45.433068 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f52fdac-6652-44df-beb2-efd0e3738e29 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:45.445062 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f52fdac-6652-44df-beb2-efd0e3738e29 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:45.502779 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6899acd1-6934-43f2-b96d-8e8940d2fd2f admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:45.510684 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a868569d-0436-462f-8893-15e338c8d1e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:45.511586 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a868569d-0436-462f-8893-15e338c8d1e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:45.511811 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a868569d-0436-462f-8893-15e338c8d1e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:45.512058 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a868569d-0436-462f-8893-15e338c8d1e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:45.512860 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a868569d-0436-462f-8893-15e338c8d1e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:45.513885 dv-cinder-844601-7-smb devstack@keystone.service[80247]: WARNING py.warnings [None req-a868569d-0436-462f-8893-15e338c8d1e9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 01 19:34:45.513885 dv-cinder-844601-7-smb devstack@keystone.service[80247]: warnings.warn(msg) Jul 01 19:34:45.513885 dv-cinder-844601-7-smb devstack@keystone.service[80247]: Jul 01 19:34:45.515145 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a868569d-0436-462f-8893-15e338c8d1e9 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:45.518308 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c01b4e7-85cf-4adc-bfc4-f4322be43c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:45.518984 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c01b4e7-85cf-4adc-bfc4-f4322be43c11 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:45.519282 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c01b4e7-85cf-4adc-bfc4-f4322be43c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:45.519557 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c01b4e7-85cf-4adc-bfc4-f4322be43c11 admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:45.520729 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c01b4e7-85cf-4adc-bfc4-f4322be43c11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:45.522884 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c01b4e7-85cf-4adc-bfc4-f4322be43c11 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:45.538126 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 777/1576] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:34:45 2022] POST /identity/v3/users => generated 295 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:34:45.538678 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a868569d-0436-462f-8893-15e338c8d1e9 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:45.548840 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 800/1577] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:34:45 2022] POST /identity/v3/users => generated 293 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:34:45.548840 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c01b4e7-85cf-4adc-bfc4-f4322be43c11 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:45.553424 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a868569d-0436-462f-8893-15e338c8d1e9 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:45.558068 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c01b4e7-85cf-4adc-bfc4-f4322be43c11 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:45.558231 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9e59ec-115a-4d2f-b550-08074ea7549d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:45.558896 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e59ec-115a-4d2f-b550-08074ea7549d admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:45.559309 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e59ec-115a-4d2f-b550-08074ea7549d admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:45.559588 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e59ec-115a-4d2f-b550-08074ea7549d admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:45.560424 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9e59ec-115a-4d2f-b550-08074ea7549d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:45.562998 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9e59ec-115a-4d2f-b550-08074ea7549d admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:45.563929 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e248f6e0-d8e8-4eab-913e-c7e4f77a01c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:45.564604 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248f6e0-d8e8-4eab-913e-c7e4f77a01c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:45.564893 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248f6e0-d8e8-4eab-913e-c7e4f77a01c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:45.565173 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248f6e0-d8e8-4eab-913e-c7e4f77a01c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:45.565925 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e248f6e0-d8e8-4eab-913e-c7e4f77a01c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:45.567822 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e248f6e0-d8e8-4eab-913e-c7e4f77a01c3 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:45.593161 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 801/1578] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:34:45 2022] POST /identity/v3/users => generated 291 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:34:45.597278 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e248f6e0-d8e8-4eab-913e-c7e4f77a01c3 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:45.608095 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e248f6e0-d8e8-4eab-913e-c7e4f77a01c3 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:45.610187 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 778/1579] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:34:45 2022] POST /identity/v3/projects => generated 385 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:34:45.611082 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9e59ec-115a-4d2f-b550-08074ea7549d admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:45.676082 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f1f1a-6283-4221-92de-94e36b1d36a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:45.677078 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f1f1a-6283-4221-92de-94e36b1d36a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:45.677602 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f1f1a-6283-4221-92de-94e36b1d36a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:45.678091 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f1f1a-6283-4221-92de-94e36b1d36a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:45.678961 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5f1f1a-6283-4221-92de-94e36b1d36a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:45.681080 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5f1f1a-6283-4221-92de-94e36b1d36a2 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:45.689056 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:34:45.709437 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9e59ec-115a-4d2f-b550-08074ea7549d admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:45.710485 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 802/1580] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:34:45 2022] POST /identity/v3/users => generated 289 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:34:45.711715 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f1f1a-6283-4221-92de-94e36b1d36a2 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:45.722027 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1cc6a6-23e9-4ee2-9814-7de0ed587353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:45.722726 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1cc6a6-23e9-4ee2-9814-7de0ed587353 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:45.723012 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1cc6a6-23e9-4ee2-9814-7de0ed587353 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:45.723293 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1cc6a6-23e9-4ee2-9814-7de0ed587353 admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:45.724058 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1cc6a6-23e9-4ee2-9814-7de0ed587353 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:45.724665 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f1f1a-6283-4221-92de-94e36b1d36a2 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:45.726320 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1cc6a6-23e9-4ee2-9814-7de0ed587353 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:45.729546 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8df3ef-ef30-4d93-bc56-bc4eb1b2b491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:45.730413 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8df3ef-ef30-4d93-bc56-bc4eb1b2b491 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:45.730703 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8df3ef-ef30-4d93-bc56-bc4eb1b2b491 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:45.730979 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8df3ef-ef30-4d93-bc56-bc4eb1b2b491 admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:45.731919 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8df3ef-ef30-4d93-bc56-bc4eb1b2b491 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:45.734541 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8df3ef-ef30-4d93-bc56-bc4eb1b2b491 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:45.759445 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 779/1581] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:34:45 2022] POST /identity/v3/users => generated 283 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:34:45.760196 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1cc6a6-23e9-4ee2-9814-7de0ed587353 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:45.772248 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1cc6a6-23e9-4ee2-9814-7de0ed587353 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:45.777279 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 803/1582] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:34:45 2022] POST /identity/v3/projects => generated 405 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:34:45.778821 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8df3ef-ef30-4d93-bc56-bc4eb1b2b491 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:45.850780 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1314b05-0856-409f-970c-bf6c0818719c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:45.851955 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1314b05-0856-409f-970c-bf6c0818719c admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:45.852382 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1314b05-0856-409f-970c-bf6c0818719c admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:45.852777 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1314b05-0856-409f-970c-bf6c0818719c admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:45.854021 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1314b05-0856-409f-970c-bf6c0818719c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:45.856563 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1314b05-0856-409f-970c-bf6c0818719c admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:45.864225 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:34:45.873111 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 780/1583] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:34:45 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:34:45.875342 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1314b05-0856-409f-970c-bf6c0818719c admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:45.878393 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8df3ef-ef30-4d93-bc56-bc4eb1b2b491 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:45.887452 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1314b05-0856-409f-970c-bf6c0818719c admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:45.892322 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6dcafe-abbb-4ba0-acb6-978297326e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:45.893153 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6dcafe-abbb-4ba0-acb6-978297326e95 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:45.893601 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6dcafe-abbb-4ba0-acb6-978297326e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:45.894062 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6dcafe-abbb-4ba0-acb6-978297326e95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:45.894946 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6dcafe-abbb-4ba0-acb6-978297326e95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:45.895184 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9439fc34-85d3-45ed-aa50-af91faf4f87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:45.896114 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439fc34-85d3-45ed-aa50-af91faf4f87b admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:45.896585 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439fc34-85d3-45ed-aa50-af91faf4f87b admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:45.897218 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439fc34-85d3-45ed-aa50-af91faf4f87b admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:45.897392 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6dcafe-abbb-4ba0-acb6-978297326e95 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:45.898321 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9439fc34-85d3-45ed-aa50-af91faf4f87b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:45.901026 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9439fc34-85d3-45ed-aa50-af91faf4f87b admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:45.914437 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 804/1585] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:34:45 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:34:45.914997 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 781/1585] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:34:45 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:34:45.915238 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6dcafe-abbb-4ba0-acb6-978297326e95 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:45.916361 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9439fc34-85d3-45ed-aa50-af91faf4f87b admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:45.928889 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9439fc34-85d3-45ed-aa50-af91faf4f87b admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:45.929108 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6dcafe-abbb-4ba0-acb6-978297326e95 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:45.934707 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c576d6-fd9f-4de7-873f-9db2675f906a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:45.935407 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c576d6-fd9f-4de7-873f-9db2675f906a admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:45.935699 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c576d6-fd9f-4de7-873f-9db2675f906a admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:45.935984 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c576d6-fd9f-4de7-873f-9db2675f906a admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:45.936395 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4565261-2afa-4eb5-9d86-9b8a9689b20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:45.936768 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c576d6-fd9f-4de7-873f-9db2675f906a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:45.938215 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4565261-2afa-4eb5-9d86-9b8a9689b20c admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:45.938732 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4565261-2afa-4eb5-9d86-9b8a9689b20c admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:45.939180 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4565261-2afa-4eb5-9d86-9b8a9689b20c admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:45.939792 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c576d6-fd9f-4de7-873f-9db2675f906a admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:45.940322 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4565261-2afa-4eb5-9d86-9b8a9689b20c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:45.942320 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4565261-2afa-4eb5-9d86-9b8a9689b20c admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:45.958301 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 782/1586] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:34:45 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:34:45.959486 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4565261-2afa-4eb5-9d86-9b8a9689b20c admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:45.972234 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 805/1587] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:34:45 2022] POST /identity/v3/users => generated 293 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:34:45.972234 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c576d6-fd9f-4de7-873f-9db2675f906a admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:45.974363 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4565261-2afa-4eb5-9d86-9b8a9689b20c admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:45.980039 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e450de84-1269-4d9b-a9ca-5a9c5decd263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:45.981006 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e450de84-1269-4d9b-a9ca-5a9c5decd263 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:45.981575 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e450de84-1269-4d9b-a9ca-5a9c5decd263 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:45.982036 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e450de84-1269-4d9b-a9ca-5a9c5decd263 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:45.983025 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e450de84-1269-4d9b-a9ca-5a9c5decd263 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:45.984302 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c576d6-fd9f-4de7-873f-9db2675f906a admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:45.985210 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e450de84-1269-4d9b-a9ca-5a9c5decd263 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:45.990324 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e57092-5967-4757-a44a-78bd0523bd84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:45.991111 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e57092-5967-4757-a44a-78bd0523bd84 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:45.992195 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e57092-5967-4757-a44a-78bd0523bd84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:45.992557 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e57092-5967-4757-a44a-78bd0523bd84 admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:45.994078 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e57092-5967-4757-a44a-78bd0523bd84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:45.997981 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e57092-5967-4757-a44a-78bd0523bd84 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:46.004673 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 783/1588] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:34:45 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:34:46.005951 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e450de84-1269-4d9b-a9ca-5a9c5decd263 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:46.020569 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e450de84-1269-4d9b-a9ca-5a9c5decd263 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:46.027636 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d02154-9897-4042-b370-a418b96f992f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:46.028786 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d02154-9897-4042-b370-a418b96f992f admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:46.029181 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 806/1589] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:34:45 2022] POST /identity/v3/users => generated 303 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:34:46.029627 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d02154-9897-4042-b370-a418b96f992f admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:46.030171 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d02154-9897-4042-b370-a418b96f992f admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:46.030298 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e57092-5967-4757-a44a-78bd0523bd84 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:46.031442 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d02154-9897-4042-b370-a418b96f992f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:46.034042 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d02154-9897-4042-b370-a418b96f992f admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:46.044645 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e57092-5967-4757-a44a-78bd0523bd84 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:46.048611 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 784/1590] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:34:46 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:34:46.049730 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d02154-9897-4042-b370-a418b96f992f admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:46.053622 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db0918f-b75d-4780-b622-6213f2787645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:46.054468 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db0918f-b75d-4780-b622-6213f2787645 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:46.054764 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db0918f-b75d-4780-b622-6213f2787645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:46.055049 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db0918f-b75d-4780-b622-6213f2787645 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:46.055794 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db0918f-b75d-4780-b622-6213f2787645 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:46.059433 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db0918f-b75d-4780-b622-6213f2787645 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:46.065641 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d02154-9897-4042-b370-a418b96f992f admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:46.072283 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34cd366-d8ef-43b7-95b6-b4f5db125d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:46.073281 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34cd366-d8ef-43b7-95b6-b4f5db125d05 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:46.073786 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34cd366-d8ef-43b7-95b6-b4f5db125d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:46.074696 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34cd366-d8ef-43b7-95b6-b4f5db125d05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:46.075541 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34cd366-d8ef-43b7-95b6-b4f5db125d05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:46.076191 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 807/1591] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:34:46 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:34:46.078601 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db0918f-b75d-4780-b622-6213f2787645 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:46.081962 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34cd366-d8ef-43b7-95b6-b4f5db125d05 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:46.091593 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db0918f-b75d-4780-b622-6213f2787645 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:46.093544 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 785/1592] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:34:46 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:34:46.094765 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34cd366-d8ef-43b7-95b6-b4f5db125d05 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:46.097395 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4ca364-19de-4d76-859f-4d4ccf9bfbdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:46.098470 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ca364-19de-4d76-859f-4d4ccf9bfbdb admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:46.099063 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ca364-19de-4d76-859f-4d4ccf9bfbdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:46.100011 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ca364-19de-4d76-859f-4d4ccf9bfbdb admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:46.101601 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4ca364-19de-4d76-859f-4d4ccf9bfbdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:46.103757 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4ca364-19de-4d76-859f-4d4ccf9bfbdb admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:46.109402 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34cd366-d8ef-43b7-95b6-b4f5db125d05 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:46.116642 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0893b632-1ef5-433e-8124-9c8749aa83b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:46.116993 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 808/1593] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:34:46 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:34:46.118020 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4ca364-19de-4d76-859f-4d4ccf9bfbdb admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:46.122199 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893b632-1ef5-433e-8124-9c8749aa83b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:46.122487 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893b632-1ef5-433e-8124-9c8749aa83b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:46.122769 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893b632-1ef5-433e-8124-9c8749aa83b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:46.123522 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0893b632-1ef5-433e-8124-9c8749aa83b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:46.126307 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0893b632-1ef5-433e-8124-9c8749aa83b0 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:46.132601 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4ca364-19de-4d76-859f-4d4ccf9bfbdb admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:46.139861 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 786/1594] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:34:46 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:34:46.140337 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e8119-e004-4f91-9aff-1f2597835e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:46.141219 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e8119-e004-4f91-9aff-1f2597835e89 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:46.141608 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e8119-e004-4f91-9aff-1f2597835e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:46.142021 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e8119-e004-4f91-9aff-1f2597835e89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:46.142986 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4e8119-e004-4f91-9aff-1f2597835e89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:46.144016 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0893b632-1ef5-433e-8124-9c8749aa83b0 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:46.145411 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4e8119-e004-4f91-9aff-1f2597835e89 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:46.155473 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0893b632-1ef5-433e-8124-9c8749aa83b0 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:46.160339 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9e9fc5-f956-42f8-ba01-d41ef829dc4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:46.161014 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e9fc5-f956-42f8-ba01-d41ef829dc4c admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:46.161380 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e9fc5-f956-42f8-ba01-d41ef829dc4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:46.161847 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 809/1595] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:34:46 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:34:46.162716 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e8119-e004-4f91-9aff-1f2597835e89 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:46.165091 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e9fc5-f956-42f8-ba01-d41ef829dc4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:46.165940 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9e9fc5-f956-42f8-ba01-d41ef829dc4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:46.169698 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9e9fc5-f956-42f8-ba01-d41ef829dc4c admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:46.179588 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e8119-e004-4f91-9aff-1f2597835e89 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:46.183343 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 787/1596] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:34:46 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:34:46.184181 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9e9fc5-f956-42f8-ba01-d41ef829dc4c admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:46.185543 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866711a2-d12b-435e-99c1-9a90f7ec8465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:46.186711 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866711a2-d12b-435e-99c1-9a90f7ec8465 admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:46.187560 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866711a2-d12b-435e-99c1-9a90f7ec8465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:46.188070 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866711a2-d12b-435e-99c1-9a90f7ec8465 admin admin] PATH_INFO: `/v3/projects/82aa323d169e4cd18abbf365aef1fd84/users/75b8c92fd65a49e493373b4a13c18290/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:46.196234 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9e9fc5-f956-42f8-ba01-d41ef829dc4c admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:46.201581 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f5afc-d0a0-4d87-b108-9cb666b88acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:46.202487 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f5afc-d0a0-4d87-b108-9cb666b88acf admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:46.202932 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f5afc-d0a0-4d87-b108-9cb666b88acf admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:46.203212 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f5afc-d0a0-4d87-b108-9cb666b88acf admin admin] PATH_INFO: `/v3/projects/61d19ec0365f4be29b6550ff692bf7b7/users/32a9543cebb04fb89b48666d34cd38e9/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:46.209389 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866711a2-d12b-435e-99c1-9a90f7ec8465 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82aa323d169e4cd18abbf365aef1fd84, user_id=75b8c92fd65a49e493373b4a13c18290, role_id=4cbf6ec846eb4b7c8cc52e9bfd6f076f)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:46.212320 dv-cinder-844601-7-smb devstack@keystone.service[80246]: WARNING py.warnings [None req-866711a2-d12b-435e-99c1-9a90f7ec8465 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 01 19:34:46.212320 dv-cinder-844601-7-smb devstack@keystone.service[80246]: warnings.warn(msg) Jul 01 19:34:46.212320 dv-cinder-844601-7-smb devstack@keystone.service[80246]: Jul 01 19:34:46.214443 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866711a2-d12b-435e-99c1-9a90f7ec8465 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:46.225204 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57f5afc-d0a0-4d87-b108-9cb666b88acf admin admin] RBAC: Authorizing `identity:create_grant(project_id=61d19ec0365f4be29b6550ff692bf7b7, user_id=32a9543cebb04fb89b48666d34cd38e9, role_id=4cbf6ec846eb4b7c8cc52e9bfd6f076f)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:46.229886 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57f5afc-d0a0-4d87-b108-9cb666b88acf admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:46.237377 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 810/1597] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:34:46 2022] PUT /identity/v3/projects/82aa323d169e4cd18abbf365aef1fd84/users/75b8c92fd65a49e493373b4a13c18290/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:34:46.240279 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866711a2-d12b-435e-99c1-9a90f7ec8465 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:46.253774 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 788/1598] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:34:46 2022] PUT /identity/v3/projects/61d19ec0365f4be29b6550ff692bf7b7/users/32a9543cebb04fb89b48666d34cd38e9/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:34:46.254601 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f5afc-d0a0-4d87-b108-9cb666b88acf admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:46.289691 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:INSERT=11,keystone:SELECT=89 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:34:46.329342 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866711a2-d12b-435e-99c1-9a90f7ec8465 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:46.373554 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f5afc-d0a0-4d87-b108-9cb666b88acf admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:46.381797 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979f7f55-0b64-42b1-84fa-b5454d5b0f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:46.383737 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f7f55-0b64-42b1-84fa-b5454d5b0f22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:46.384531 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f7f55-0b64-42b1-84fa-b5454d5b0f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:46.385037 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f7f55-0b64-42b1-84fa-b5454d5b0f22 admin admin] PATH_INFO: `/v3/projects/8b5daf2a3ae343bd97cdfd34ec5ea7af/users/1827b8d35e274416b3f6adbc28691ad6/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:46.409044 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c14d0e1-c2a5-410a-83a2-cb9676ae52e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:46.409992 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c14d0e1-c2a5-410a-83a2-cb9676ae52e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:46.410283 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c14d0e1-c2a5-410a-83a2-cb9676ae52e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:46.410565 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c14d0e1-c2a5-410a-83a2-cb9676ae52e7 admin admin] PATH_INFO: `/v3/projects/e9a181b474204a1689e14a188e55d297/users/ce26113c70f0460892402b4e64e9cf6d/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:46.417325 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979f7f55-0b64-42b1-84fa-b5454d5b0f22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b5daf2a3ae343bd97cdfd34ec5ea7af, user_id=1827b8d35e274416b3f6adbc28691ad6, role_id=4cbf6ec846eb4b7c8cc52e9bfd6f076f)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:46.423286 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979f7f55-0b64-42b1-84fa-b5454d5b0f22 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:46.434707 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c14d0e1-c2a5-410a-83a2-cb9676ae52e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9a181b474204a1689e14a188e55d297, user_id=ce26113c70f0460892402b4e64e9cf6d, role_id=4cbf6ec846eb4b7c8cc52e9bfd6f076f)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:46.438989 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c14d0e1-c2a5-410a-83a2-cb9676ae52e7 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:46.452778 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 789/1599] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:34:46 2022] PUT /identity/v3/projects/8b5daf2a3ae343bd97cdfd34ec5ea7af/users/1827b8d35e274416b3f6adbc28691ad6/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:34:46.457062 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 811/1600] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:34:46 2022] PUT /identity/v3/projects/e9a181b474204a1689e14a188e55d297/users/ce26113c70f0460892402b4e64e9cf6d/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:34:46.457062 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c14d0e1-c2a5-410a-83a2-cb9676ae52e7 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:46.467824 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979f7f55-0b64-42b1-84fa-b5454d5b0f22 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:46.523945 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:34:46.539298 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c14d0e1-c2a5-410a-83a2-cb9676ae52e7 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:46.552845 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a0e58f-4cd3-49c1-8b71-714fd81dcadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:46.553589 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a0e58f-4cd3-49c1-8b71-714fd81dcadc admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:46.553879 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a0e58f-4cd3-49c1-8b71-714fd81dcadc admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:46.554157 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a0e58f-4cd3-49c1-8b71-714fd81dcadc admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:46.554903 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a0e58f-4cd3-49c1-8b71-714fd81dcadc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:46.556545 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a0e58f-4cd3-49c1-8b71-714fd81dcadc admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:46.557006 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979f7f55-0b64-42b1-84fa-b5454d5b0f22 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:46.566829 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd1defa-0d2c-4fca-90f5-653a16a0ebfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:46.569546 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1defa-0d2c-4fca-90f5-653a16a0ebfd admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:46.569546 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1defa-0d2c-4fca-90f5-653a16a0ebfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:46.569546 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1defa-0d2c-4fca-90f5-653a16a0ebfd admin admin] PATH_INFO: `/v3/projects/a4ce567296d446f3887803e1d5dff1f5/users/29d53f2465154bf88fa83f1a8db3f1dd/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:46.574585 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 812/1601] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:34:46 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:34:46.575577 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a0e58f-4cd3-49c1-8b71-714fd81dcadc admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:46.585632 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a0e58f-4cd3-49c1-8b71-714fd81dcadc admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:46.588277 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd1defa-0d2c-4fca-90f5-653a16a0ebfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4ce567296d446f3887803e1d5dff1f5, user_id=29d53f2465154bf88fa83f1a8db3f1dd, role_id=4cbf6ec846eb4b7c8cc52e9bfd6f076f)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:46.591130 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd1defa-0d2c-4fca-90f5-653a16a0ebfd admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:46.593080 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b3597a-a9a4-4e15-a9f8-55e3743f8db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:46.594616 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3597a-a9a4-4e15-a9f8-55e3743f8db8 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:46.594959 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3597a-a9a4-4e15-a9f8-55e3743f8db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:46.595242 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3597a-a9a4-4e15-a9f8-55e3743f8db8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:46.595996 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b3597a-a9a4-4e15-a9f8-55e3743f8db8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:46.597671 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b3597a-a9a4-4e15-a9f8-55e3743f8db8 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:46.609618 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 813/1602] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:34:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:34:46.610432 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 790/1603] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:34:46 2022] PUT /identity/v3/projects/a4ce567296d446f3887803e1d5dff1f5/users/29d53f2465154bf88fa83f1a8db3f1dd/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:34:46.612078 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0981a0bd-4b8f-4603-95d7-719050df67d8 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:46.612475 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0981a0bd-4b8f-4603-95d7-719050df67d8 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:46.613135 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0981a0bd-4b8f-4603-95d7-719050df67d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:46.628312 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeaf420-4140-44d0-a681-6e72ff581177 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:46.628637 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeaf420-4140-44d0-a681-6e72ff581177 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:46.628924 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeaf420-4140-44d0-a681-6e72ff581177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:46.648506 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-0981a0bd-4b8f-4603-95d7-719050df67d8 None None] MFA Rules not processed for user `32a9543cebb04fb89b48666d34cd38e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:34:46.650252 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-0981a0bd-4b8f-4603-95d7-719050df67d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:34:46.655526 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-bbeaf420-4140-44d0-a681-6e72ff581177 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:34:46.657631 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-bbeaf420-4140-44d0-a681-6e72ff581177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:34:46.763385 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:34:46.770144 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 814/1604] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:34:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:34:46.772181 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8279f6a0-d2e3-44d8-8f00-667baa972bd3 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:46.772726 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8279f6a0-d2e3-44d8-8f00-667baa972bd3 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:46.773261 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8279f6a0-d2e3-44d8-8f00-667baa972bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:46.802713 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-8279f6a0-d2e3-44d8-8f00-667baa972bd3 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:34:46.804744 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-8279f6a0-d2e3-44d8-8f00-667baa972bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:34:46.808411 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 791/1605] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:34:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:34:46.810701 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f545e-ec55-431c-baea-1879829b67bc None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:46.811004 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f545e-ec55-431c-baea-1879829b67bc None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:46.811293 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f545e-ec55-431c-baea-1879829b67bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:46.813769 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 815/1606] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:34:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:34:46.814848 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8279f6a0-d2e3-44d8-8f00-667baa972bd3 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:46.827523 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8279f6a0-d2e3-44d8-8f00-667baa972bd3 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:46.834534 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09459a70-bf8b-436a-9b0c-4931d678d986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:46.835610 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09459a70-bf8b-436a-9b0c-4931d678d986 admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:46.835906 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09459a70-bf8b-436a-9b0c-4931d678d986 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:46.836192 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09459a70-bf8b-436a-9b0c-4931d678d986 admin admin] PATH_INFO: `/v3/projects/0abd48c545f04b649911b0cc552976b5/users/ca5e02a8eda94202b4464352cfbdc41a/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:46.858384 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-e46f545e-ec55-431c-baea-1879829b67bc None None] MFA Rules not processed for user `ce26113c70f0460892402b4e64e9cf6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:34:46.860335 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-e46f545e-ec55-431c-baea-1879829b67bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:34:46.862091 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09459a70-bf8b-436a-9b0c-4931d678d986 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0abd48c545f04b649911b0cc552976b5, user_id=ca5e02a8eda94202b4464352cfbdc41a, role_id=4cbf6ec846eb4b7c8cc52e9bfd6f076f)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:46.872819 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09459a70-bf8b-436a-9b0c-4931d678d986 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:46.916808 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 816/1607] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:34:46 2022] PUT /identity/v3/projects/0abd48c545f04b649911b0cc552976b5/users/ca5e02a8eda94202b4464352cfbdc41a/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:34:46.916808 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09459a70-bf8b-436a-9b0c-4931d678d986 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:46.942893 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 792/1608] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:34:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:34:46.944200 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a5e31e-07a0-4af1-a46c-6825043c404a None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:46.944573 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a5e31e-07a0-4af1-a46c-6825043c404a None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:46.945198 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a5e31e-07a0-4af1-a46c-6825043c404a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:46.976165 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-26a5e31e-07a0-4af1-a46c-6825043c404a None None] MFA Rules not processed for user `29d53f2465154bf88fa83f1a8db3f1dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:34:46.977452 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-26a5e31e-07a0-4af1-a46c-6825043c404a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:34:46.992637 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09459a70-bf8b-436a-9b0c-4931d678d986 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:46.997516 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c85504-259b-4009-bea0-fde43d831221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:46.998511 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c85504-259b-4009-bea0-fde43d831221 admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:46.998868 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c85504-259b-4009-bea0-fde43d831221 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:46.999225 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c85504-259b-4009-bea0-fde43d831221 admin admin] PATH_INFO: `/v3/projects/85d209c18f714abcb4c9fb70fca4e37f/users/aa0c30545c904818b49b703055af87fd/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:47.016072 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:34:47.018667 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c85504-259b-4009-bea0-fde43d831221 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85d209c18f714abcb4c9fb70fca4e37f, user_id=aa0c30545c904818b49b703055af87fd, role_id=4cbf6ec846eb4b7c8cc52e9bfd6f076f)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:47.022151 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c85504-259b-4009-bea0-fde43d831221 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:47.039855 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 817/1609] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:34:46 2022] PUT /identity/v3/projects/85d209c18f714abcb4c9fb70fca4e37f/users/aa0c30545c904818b49b703055af87fd/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:34:47.040570 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c85504-259b-4009-bea0-fde43d831221 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:47.044688 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-10c85504-259b-4009-bea0-fde43d831221 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:34:47.061776 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 793/1610] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:34:46 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:34:47.063051 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a5e31e-07a0-4af1-a46c-6825043c404a None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:47.075251 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a5e31e-07a0-4af1-a46c-6825043c404a None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:47.120991 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c85504-259b-4009-bea0-fde43d831221 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:47.126387 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2952174-a59c-40bc-87bc-5e36af61ad9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:47.127482 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2952174-a59c-40bc-87bc-5e36af61ad9b service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:47.127771 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2952174-a59c-40bc-87bc-5e36af61ad9b service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:47.128050 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2952174-a59c-40bc-87bc-5e36af61ad9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:47.150553 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1736c967-fc53-4f37-b13d-40ece616faa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:47.151653 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1736c967-fc53-4f37-b13d-40ece616faa6 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:47.151775 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1736c967-fc53-4f37-b13d-40ece616faa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:47.152041 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1736c967-fc53-4f37-b13d-40ece616faa6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:47.152812 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1736c967-fc53-4f37-b13d-40ece616faa6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:47.155065 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1736c967-fc53-4f37-b13d-40ece616faa6 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:47.188747 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 794/1611] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:34:47 2022] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:34:47.188747 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1736c967-fc53-4f37-b13d-40ece616faa6 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:47.196365 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:34:47.213863 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2952174-a59c-40bc-87bc-5e36af61ad9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:47.216285 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2952174-a59c-40bc-87bc-5e36af61ad9b service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:47.231660 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 818/1612] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:34:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:34:47.233811 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a07ac-d367-45b4-8a89-fcc9da87e393 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:47.234127 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a07ac-d367-45b4-8a89-fcc9da87e393 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:47.234554 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a07ac-d367-45b4-8a89-fcc9da87e393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:47.251422 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1736c967-fc53-4f37-b13d-40ece616faa6 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:47.256101 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d723c1-3890-43c2-8c9c-af685f99e541 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:47.257000 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d723c1-3890-43c2-8c9c-af685f99e541 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:47.257524 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d723c1-3890-43c2-8c9c-af685f99e541 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:47.258017 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d723c1-3890-43c2-8c9c-af685f99e541 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:47.274921 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-0f8a07ac-d367-45b4-8a89-fcc9da87e393 None None] MFA Rules not processed for user `ca5e02a8eda94202b4464352cfbdc41a`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:34:47.276418 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-0f8a07ac-d367-45b4-8a89-fcc9da87e393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:34:47.354456 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d723c1-3890-43c2-8c9c-af685f99e541 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:47.357381 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d723c1-3890-43c2-8c9c-af685f99e541 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:47.378360 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 795/1613] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:34:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:34:47.379529 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d723c1-3890-43c2-8c9c-af685f99e541 service neutron] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:47.392462 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d723c1-3890-43c2-8c9c-af685f99e541 service neutron] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:47.401591 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b893da-b4b9-43bb-ad97-7edec4c2a690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:47.402602 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b893da-b4b9-43bb-ad97-7edec4c2a690 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:47.403083 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b893da-b4b9-43bb-ad97-7edec4c2a690 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:47.403551 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b893da-b4b9-43bb-ad97-7edec4c2a690 admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:47.404814 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b893da-b4b9-43bb-ad97-7edec4c2a690 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:47.407752 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b893da-b4b9-43bb-ad97-7edec4c2a690 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:47.409929 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 819/1614] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:34:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:34:47.411475 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97615d70-02f7-4748-aa11-5e3c7465e374 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:47.411842 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97615d70-02f7-4748-aa11-5e3c7465e374 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:47.412600 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97615d70-02f7-4748-aa11-5e3c7465e374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:47.414397 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:34:47.456094 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 796/1615] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:34:47 2022] POST /identity/v3/projects => generated 381 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:34:47.456094 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b893da-b4b9-43bb-ad97-7edec4c2a690 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:47.459788 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-97615d70-02f7-4748-aa11-5e3c7465e374 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:34:47.461192 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-97615d70-02f7-4748-aa11-5e3c7465e374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:34:47.574853 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b893da-b4b9-43bb-ad97-7edec4c2a690 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:47.581297 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de07c868-bbb5-4851-a786-2dbc9861a86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:47.582187 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07c868-bbb5-4851-a786-2dbc9861a86a admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:47.582568 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07c868-bbb5-4851-a786-2dbc9861a86a admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:47.583603 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07c868-bbb5-4851-a786-2dbc9861a86a admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:47.584384 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de07c868-bbb5-4851-a786-2dbc9861a86a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:47.587027 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de07c868-bbb5-4851-a786-2dbc9861a86a admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:47.623814 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 820/1616] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:34:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:34:47.624621 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97615d70-02f7-4748-aa11-5e3c7465e374 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:47.647918 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97615d70-02f7-4748-aa11-5e3c7465e374 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:47.678809 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 797/1617] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:34:47 2022] POST /identity/v3/projects => generated 363 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:34:47.681306 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a93c55-e813-4a0a-9703-2d3aa7444c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:47.682088 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a93c55-e813-4a0a-9703-2d3aa7444c95 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:47.682483 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a93c55-e813-4a0a-9703-2d3aa7444c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:47.682846 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a93c55-e813-4a0a-9703-2d3aa7444c95 admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:47.684050 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a93c55-e813-4a0a-9703-2d3aa7444c95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:47.687124 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a93c55-e813-4a0a-9703-2d3aa7444c95 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:47.689027 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6709be1b-118d-4af4-bfb9-9f0b0ebb8744 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:47.689754 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6709be1b-118d-4af4-bfb9-9f0b0ebb8744 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:47.691928 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6709be1b-118d-4af4-bfb9-9f0b0ebb8744 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:47.698099 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 798/1618] 10.222.0.26 () {54 vars in 961 bytes} [Fri Jul 1 19:34:47 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:34:47.700142 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6709be1b-118d-4af4-bfb9-9f0b0ebb8744 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:47.762663 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 821/1619] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:34:47 2022] POST /identity/v3/users => generated 299 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:34:47.763531 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a93c55-e813-4a0a-9703-2d3aa7444c95 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:47.788043 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a93c55-e813-4a0a-9703-2d3aa7444c95 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:47.875221 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3ebf2d-4d4e-4d5d-964b-e72d187d467d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:47.876192 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ebf2d-4d4e-4d5d-964b-e72d187d467d admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:47.876774 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ebf2d-4d4e-4d5d-964b-e72d187d467d admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:47.877068 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ebf2d-4d4e-4d5d-964b-e72d187d467d admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:47.878054 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3ebf2d-4d4e-4d5d-964b-e72d187d467d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:47.880079 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3ebf2d-4d4e-4d5d-964b-e72d187d467d admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:47.889585 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:34:47.913430 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6709be1b-118d-4af4-bfb9-9f0b0ebb8744 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:47.916048 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 822/1620] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:34:47 2022] POST /identity/v3/users => generated 288 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:34:47.918481 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e55c9-5ed0-44a7-9222-fc8ca17ae825 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:47.919062 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e55c9-5ed0-44a7-9222-fc8ca17ae825 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:47.919062 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e55c9-5ed0-44a7-9222-fc8ca17ae825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:47.925919 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa8da4c-85be-4038-8d09-167bb239a535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:47.926998 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8da4c-85be-4038-8d09-167bb239a535 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:47.927405 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8da4c-85be-4038-8d09-167bb239a535 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:47.927832 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8da4c-85be-4038-8d09-167bb239a535 admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:47.929271 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa8da4c-85be-4038-8d09-167bb239a535 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:47.933419 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa8da4c-85be-4038-8d09-167bb239a535 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:47.964310 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-449e55c9-5ed0-44a7-9222-fc8ca17ae825 None None] MFA Rules not processed for user `13fd76fc7dd1410b9cde5adbaa6cb2e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:34:47.965801 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-449e55c9-5ed0-44a7-9222-fc8ca17ae825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:34:47.985784 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 799/1621] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:34:47 2022] POST /identity/v3/users => generated 297 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:34:47.987067 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa8da4c-85be-4038-8d09-167bb239a535 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:48.014315 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa8da4c-85be-4038-8d09-167bb239a535 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:48.033479 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78ea852-b8e7-488f-9164-7f06c560bffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:48.034853 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ea852-b8e7-488f-9164-7f06c560bffd admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:48.035497 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ea852-b8e7-488f-9164-7f06c560bffd admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:48.036350 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ea852-b8e7-488f-9164-7f06c560bffd admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:48.037694 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78ea852-b8e7-488f-9164-7f06c560bffd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:48.043031 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78ea852-b8e7-488f-9164-7f06c560bffd admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:48.065580 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 800/1622] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:34:48.067284 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78ea852-b8e7-488f-9164-7f06c560bffd admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:48.132107 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 823/1623] 10.222.0.26 () {58 vars in 1058 bytes} [Fri Jul 1 19:34:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:34:48.135577 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449e55c9-5ed0-44a7-9222-fc8ca17ae825 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:48.155740 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449e55c9-5ed0-44a7-9222-fc8ca17ae825 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:48.159519 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78ea852-b8e7-488f-9164-7f06c560bffd admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:48.166768 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87823f4-9ae0-4466-9ab0-aadde640dd92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:48.168635 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87823f4-9ae0-4466-9ab0-aadde640dd92 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:48.170029 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87823f4-9ae0-4466-9ab0-aadde640dd92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:48.170909 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc361c3-73c2-41d0-9276-729e81e7b1c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:48.171551 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87823f4-9ae0-4466-9ab0-aadde640dd92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:48.173045 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc361c3-73c2-41d0-9276-729e81e7b1c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:48.173412 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87823f4-9ae0-4466-9ab0-aadde640dd92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:48.175730 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc361c3-73c2-41d0-9276-729e81e7b1c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:48.176097 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc361c3-73c2-41d0-9276-729e81e7b1c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:48.177280 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87823f4-9ae0-4466-9ab0-aadde640dd92 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:48.193426 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:34:48.202675 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc361c3-73c2-41d0-9276-729e81e7b1c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:48.207729 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 824/1624] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:34:48 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:34:48.208715 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc361c3-73c2-41d0-9276-729e81e7b1c3 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:48.209807 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87823f4-9ae0-4466-9ab0-aadde640dd92 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:48.231335 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87823f4-9ae0-4466-9ab0-aadde640dd92 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:48.235274 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 801/1625] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:34:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:34:48.236306 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc361c3-73c2-41d0-9276-729e81e7b1c3 service neutron] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:48.245918 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc9426-e555-4f9e-9b41-674a2fe7f79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:48.246763 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc9426-e555-4f9e-9b41-674a2fe7f79b admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:48.247155 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc9426-e555-4f9e-9b41-674a2fe7f79b admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:48.247749 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc9426-e555-4f9e-9b41-674a2fe7f79b admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:48.250681 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cc9426-e555-4f9e-9b41-674a2fe7f79b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:48.253865 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cc9426-e555-4f9e-9b41-674a2fe7f79b admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:48.256308 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc361c3-73c2-41d0-9276-729e81e7b1c3 service neutron] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:48.275482 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fede921-1604-4069-b0b9-8d864b7c74d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:48.277054 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fede921-1604-4069-b0b9-8d864b7c74d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:48.277054 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fede921-1604-4069-b0b9-8d864b7c74d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:48.277348 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fede921-1604-4069-b0b9-8d864b7c74d9 admin admin] PATH_INFO: `/v3/projects/0474601a28104b70abd68907c1acd804/users/63d12de6b3d5499984ca8c7c578bcfc7/roles/6cb03785fb184ef587509b3174622f69` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:48.285711 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 825/1626] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:34:48 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:34:48.287231 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc9426-e555-4f9e-9b41-674a2fe7f79b admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:48.325223 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc9426-e555-4f9e-9b41-674a2fe7f79b admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:48.329711 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fede921-1604-4069-b0b9-8d864b7c74d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0474601a28104b70abd68907c1acd804, user_id=63d12de6b3d5499984ca8c7c578bcfc7, role_id=6cb03785fb184ef587509b3174622f69)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:48.338295 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fede921-1604-4069-b0b9-8d864b7c74d9 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:48.351422 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac7ce9a-b454-444b-bfc1-1c145ebd3d37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13fd76fc7dd1410b9cde5adbaa6cb2e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:48.355499 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7ce9a-b454-444b-bfc1-1c145ebd3d37 service nova] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:48.356764 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7ce9a-b454-444b-bfc1-1c145ebd3d37 service nova] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:48.357224 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7ce9a-b454-444b-bfc1-1c145ebd3d37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:48.381957 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 802/1627] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:34:48 2022] PUT /identity/v3/projects/0474601a28104b70abd68907c1acd804/users/63d12de6b3d5499984ca8c7c578bcfc7/roles/6cb03785fb184ef587509b3174622f69 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:34:48.383391 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fede921-1604-4069-b0b9-8d864b7c74d9 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:48.559508 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac7ce9a-b454-444b-bfc1-1c145ebd3d37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:48.565266 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac7ce9a-b454-444b-bfc1-1c145ebd3d37 service nova] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:48.589349 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 826/1628] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:34:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:34:48.591819 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac7ce9a-b454-444b-bfc1-1c145ebd3d37 service nova] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:48.616968 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac7ce9a-b454-444b-bfc1-1c145ebd3d37 service nova] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:48.629486 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73aefee-dd4d-4b36-9bf9-3b6ec5b5e773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:48.630695 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73aefee-dd4d-4b36-9bf9-3b6ec5b5e773 admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:48.631179 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73aefee-dd4d-4b36-9bf9-3b6ec5b5e773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:48.631562 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73aefee-dd4d-4b36-9bf9-3b6ec5b5e773 admin admin] PATH_INFO: `/v3/projects/9553835a1b4e4b7580add88fb8e51319/users/fdb5191dc33d4c6f81be335a0aec2dd8/roles/6cb03785fb184ef587509b3174622f69` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:48.637193 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fede921-1604-4069-b0b9-8d864b7c74d9 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:48.655234 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f93a88-62fe-4c3d-9f59-e7216baa4be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:48.656421 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f93a88-62fe-4c3d-9f59-e7216baa4be5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:48.656836 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f93a88-62fe-4c3d-9f59-e7216baa4be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:48.657119 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f93a88-62fe-4c3d-9f59-e7216baa4be5 admin admin] PATH_INFO: `/v3/projects/1d7f386e433d4480b6aa16fbc3168f07/users/9c85481cba37402480fa4552dbb48107/roles/6cb03785fb184ef587509b3174622f69` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:48.665470 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73aefee-dd4d-4b36-9bf9-3b6ec5b5e773 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9553835a1b4e4b7580add88fb8e51319, user_id=fdb5191dc33d4c6f81be335a0aec2dd8, role_id=6cb03785fb184ef587509b3174622f69)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:48.672729 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73aefee-dd4d-4b36-9bf9-3b6ec5b5e773 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:48.696339 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f93a88-62fe-4c3d-9f59-e7216baa4be5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d7f386e433d4480b6aa16fbc3168f07, user_id=9c85481cba37402480fa4552dbb48107, role_id=6cb03785fb184ef587509b3174622f69)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:48.703101 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f93a88-62fe-4c3d-9f59-e7216baa4be5 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:48.708358 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 827/1629] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:34:48 2022] PUT /identity/v3/projects/9553835a1b4e4b7580add88fb8e51319/users/fdb5191dc33d4c6f81be335a0aec2dd8/roles/6cb03785fb184ef587509b3174622f69 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:34:48.708358 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73aefee-dd4d-4b36-9bf9-3b6ec5b5e773 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:48.751783 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 803/1630] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:34:48 2022] PUT /identity/v3/projects/1d7f386e433d4480b6aa16fbc3168f07/users/9c85481cba37402480fa4552dbb48107/roles/6cb03785fb184ef587509b3174622f69 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:34:48.752856 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f93a88-62fe-4c3d-9f59-e7216baa4be5 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:48.790657 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:34:48.841894 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73aefee-dd4d-4b36-9bf9-3b6ec5b5e773 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:48.930195 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f93a88-62fe-4c3d-9f59-e7216baa4be5 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:48.942120 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1618fe-e127-4988-8b86-33edc48ca005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:48.944734 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1618fe-e127-4988-8b86-33edc48ca005 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:48.945031 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1618fe-e127-4988-8b86-33edc48ca005 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:48.945409 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1618fe-e127-4988-8b86-33edc48ca005 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:48.947154 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1618fe-e127-4988-8b86-33edc48ca005 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:48.951460 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1618fe-e127-4988-8b86-33edc48ca005 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:48.978448 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 804/1631] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:34:48 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:34:48.981145 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1618fe-e127-4988-8b86-33edc48ca005 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:48.995677 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3c8a3e-8df2-4f8a-b581-8a4fe01fe59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:48.996594 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c8a3e-8df2-4f8a-b581-8a4fe01fe59e admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:48.996729 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c8a3e-8df2-4f8a-b581-8a4fe01fe59e admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:48.998177 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c8a3e-8df2-4f8a-b581-8a4fe01fe59e admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:48.999077 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3c8a3e-8df2-4f8a-b581-8a4fe01fe59e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:49.004911 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3c8a3e-8df2-4f8a-b581-8a4fe01fe59e admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:49.006519 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1618fe-e127-4988-8b86-33edc48ca005 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:49.018665 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e524121-a977-45e0-941c-858dbc234b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:49.019392 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e524121-a977-45e0-941c-858dbc234b16 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:49.019815 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e524121-a977-45e0-941c-858dbc234b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:49.021266 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e524121-a977-45e0-941c-858dbc234b16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:49.022029 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e524121-a977-45e0-941c-858dbc234b16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:49.027922 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e524121-a977-45e0-941c-858dbc234b16 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:49.029477 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 828/1632] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:34:48 2022] GET /identity/v3/roles => generated 1420 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:34:49.030552 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3c8a3e-8df2-4f8a-b581-8a4fe01fe59e admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:49.053265 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3c8a3e-8df2-4f8a-b581-8a4fe01fe59e admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:49.059930 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 805/1633] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:34:48 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:34:49.059930 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e524121-a977-45e0-941c-858dbc234b16 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:49.066782 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687f48d0-8a7f-469c-9d6f-6c2e330a2dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:49.068851 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687f48d0-8a7f-469c-9d6f-6c2e330a2dfd admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:49.069605 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687f48d0-8a7f-469c-9d6f-6c2e330a2dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:49.069904 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687f48d0-8a7f-469c-9d6f-6c2e330a2dfd admin admin] PATH_INFO: `/v3/projects/9553835a1b4e4b7580add88fb8e51319/users/fdb5191dc33d4c6f81be335a0aec2dd8/roles/6cb03785fb184ef587509b3174622f69` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:49.076706 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687f48d0-8a7f-469c-9d6f-6c2e330a2dfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=9553835a1b4e4b7580add88fb8e51319, user_id=fdb5191dc33d4c6f81be335a0aec2dd8, role_id=6cb03785fb184ef587509b3174622f69)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:49.079939 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e524121-a977-45e0-941c-858dbc234b16 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:49.084534 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687f48d0-8a7f-469c-9d6f-6c2e330a2dfd admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:49.105077 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71f6af2-51a9-42c4-ad16-08f6e44f0ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:49.106721 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f6af2-51a9-42c4-ad16-08f6e44f0ab2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:49.107015 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f6af2-51a9-42c4-ad16-08f6e44f0ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:49.107296 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f6af2-51a9-42c4-ad16-08f6e44f0ab2 admin admin] PATH_INFO: `/v3/projects/0474601a28104b70abd68907c1acd804/users/63d12de6b3d5499984ca8c7c578bcfc7/roles/6cb03785fb184ef587509b3174622f69` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:49.112943 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71f6af2-51a9-42c4-ad16-08f6e44f0ab2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0474601a28104b70abd68907c1acd804, user_id=63d12de6b3d5499984ca8c7c578bcfc7, role_id=6cb03785fb184ef587509b3174622f69)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:49.120244 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71f6af2-51a9-42c4-ad16-08f6e44f0ab2 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:49.135311 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 829/1634] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:34:49 2022] PUT /identity/v3/projects/9553835a1b4e4b7580add88fb8e51319/users/fdb5191dc33d4c6f81be335a0aec2dd8/roles/6cb03785fb184ef587509b3174622f69 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:34:49.136747 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687f48d0-8a7f-469c-9d6f-6c2e330a2dfd admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:49.173059 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 806/1635] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:34:49 2022] PUT /identity/v3/projects/0474601a28104b70abd68907c1acd804/users/63d12de6b3d5499984ca8c7c578bcfc7/roles/6cb03785fb184ef587509b3174622f69 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:34:49.177229 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e9845-7e56-4691-8a2a-d0e355e27773 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:49.177534 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e9845-7e56-4691-8a2a-d0e355e27773 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:49.177812 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e9845-7e56-4691-8a2a-d0e355e27773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:49.281628 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-b08e9845-7e56-4691-8a2a-d0e355e27773 None None] MFA Rules not processed for user `fdb5191dc33d4c6f81be335a0aec2dd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:34:49.285405 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-b08e9845-7e56-4691-8a2a-d0e355e27773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:34:49.300118 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687f48d0-8a7f-469c-9d6f-6c2e330a2dfd admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:49.325754 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:34:49.437759 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c366a7-2aae-4d4f-8ed3-aefb44f0a4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:49.438915 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c366a7-2aae-4d4f-8ed3-aefb44f0a4ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:49.439964 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c366a7-2aae-4d4f-8ed3-aefb44f0a4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:49.440361 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c366a7-2aae-4d4f-8ed3-aefb44f0a4ea admin admin] PATH_INFO: `/v3/projects/1d7f386e433d4480b6aa16fbc3168f07/users/9c85481cba37402480fa4552dbb48107/roles/6cb03785fb184ef587509b3174622f69` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:49.447019 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c366a7-2aae-4d4f-8ed3-aefb44f0a4ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d7f386e433d4480b6aa16fbc3168f07, user_id=9c85481cba37402480fa4552dbb48107, role_id=6cb03785fb184ef587509b3174622f69)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:49.457375 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c366a7-2aae-4d4f-8ed3-aefb44f0a4ea admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:49.490988 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 830/1636] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:34:49 2022] PUT /identity/v3/projects/1d7f386e433d4480b6aa16fbc3168f07/users/9c85481cba37402480fa4552dbb48107/roles/6cb03785fb184ef587509b3174622f69 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:34:49.492600 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac737c4f-28cb-479d-8b90-3e68dd8d1971 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:49.492927 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac737c4f-28cb-479d-8b90-3e68dd8d1971 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:49.493216 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac737c4f-28cb-479d-8b90-3e68dd8d1971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:49.520483 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:34:49.528401 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 807/1637] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:34:49 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:34:49.530078 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79eafa8-6453-419d-b2ac-e8ac973fd309 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:49.531111 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79eafa8-6453-419d-b2ac-e8ac973fd309 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:49.536961 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79eafa8-6453-419d-b2ac-e8ac973fd309 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:49.544002 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 808/1638] 10.222.0.26 () {54 vars in 912 bytes} [Fri Jul 1 19:34:49 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:34:49.546163 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff7789e-725a-4693-8830-559faa307ce1 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:49.549903 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff7789e-725a-4693-8830-559faa307ce1 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:49.551175 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff7789e-725a-4693-8830-559faa307ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:49.563023 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-ac737c4f-28cb-479d-8b90-3e68dd8d1971 None None] MFA Rules not processed for user `63d12de6b3d5499984ca8c7c578bcfc7`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:34:49.568959 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-ac737c4f-28cb-479d-8b90-3e68dd8d1971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:34:49.627922 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-aff7789e-725a-4693-8830-559faa307ce1 None None] MFA Rules not processed for user `9c85481cba37402480fa4552dbb48107`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:34:49.629555 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-aff7789e-725a-4693-8830-559faa307ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:34:49.770429 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 831/1639] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:34:49 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:34:49.771222 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac737c4f-28cb-479d-8b90-3e68dd8d1971 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:49.803669 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 809/1640] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:34:49 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:34:49.805163 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb46a9-3239-47bd-85d8-100ac2234466 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:49.805590 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb46a9-3239-47bd-85d8-100ac2234466 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:49.805984 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb46a9-3239-47bd-85d8-100ac2234466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:49.853807 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-86bb46a9-3239-47bd-85d8-100ac2234466 None None] MFA Rules not processed for user `13fd76fc7dd1410b9cde5adbaa6cb2e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:34:49.857321 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-86bb46a9-3239-47bd-85d8-100ac2234466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:34:49.905499 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac737c4f-28cb-479d-8b90-3e68dd8d1971 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:49.914732 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ec96e1-5cf6-4f9b-8c82-9beb29609e5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a3ed285ee4c4d04abf7daf0aeb9fb7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:49.915417 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec96e1-5cf6-4f9b-8c82-9beb29609e5d service cinder] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:49.915708 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec96e1-5cf6-4f9b-8c82-9beb29609e5d service cinder] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:49.915987 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec96e1-5cf6-4f9b-8c82-9beb29609e5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:50.032967 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 810/1641] 10.222.0.26 () {58 vars in 1009 bytes} [Fri Jul 1 19:34:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:34:50.037277 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb46a9-3239-47bd-85d8-100ac2234466 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:50.067643 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ec96e1-5cf6-4f9b-8c82-9beb29609e5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:50.069394 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ec96e1-5cf6-4f9b-8c82-9beb29609e5d service cinder] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:50.073488 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb46a9-3239-47bd-85d8-100ac2234466 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:50.081912 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90f8201-3d01-479a-ae4d-58e658f81175 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a3ed285ee4c4d04abf7daf0aeb9fb7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:50.083082 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90f8201-3d01-479a-ae4d-58e658f81175 service cinder] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:50.084856 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90f8201-3d01-479a-ae4d-58e658f81175 service cinder] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:50.084856 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90f8201-3d01-479a-ae4d-58e658f81175 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:50.097634 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 832/1642] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:34:49 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:34:50.100727 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90f8201-3d01-479a-ae4d-58e658f81175 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:50.102440 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90f8201-3d01-479a-ae4d-58e658f81175 service cinder] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:50.118091 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 811/1643] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:34:50 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:34:50.169039 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ec96e1-5cf6-4f9b-8c82-9beb29609e5d service cinder] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:50.243187 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ec96e1-5cf6-4f9b-8c82-9beb29609e5d service cinder] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:50.258507 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bc9d37-82cc-4665-920f-7281198f6bb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a3ed285ee4c4d04abf7daf0aeb9fb7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:50.280960 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bc9d37-82cc-4665-920f-7281198f6bb3 service cinder] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:50.281885 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bc9d37-82cc-4665-920f-7281198f6bb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:50.285492 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bc9d37-82cc-4665-920f-7281198f6bb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:50.288194 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90f8201-3d01-479a-ae4d-58e658f81175 service cinder] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:50.311344 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90f8201-3d01-479a-ae4d-58e658f81175 service cinder] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:50.322115 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616806c-7e28-4ce6-94c8-85515218e9ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a3ed285ee4c4d04abf7daf0aeb9fb7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:50.323254 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616806c-7e28-4ce6-94c8-85515218e9ca service cinder] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:50.323656 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616806c-7e28-4ce6-94c8-85515218e9ca service cinder] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:50.324278 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bc9d37-82cc-4665-920f-7281198f6bb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:50.324588 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616806c-7e28-4ce6-94c8-85515218e9ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:50.326552 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bc9d37-82cc-4665-920f-7281198f6bb3 service cinder] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:50.344285 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 833/1644] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:34:50 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:34:50.348342 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c616806c-7e28-4ce6-94c8-85515218e9ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:50.350065 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c616806c-7e28-4ce6-94c8-85515218e9ca service cinder] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:50.356913 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:34:50.381720 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 812/1645] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:34:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:34:50.660289 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bc9d37-82cc-4665-920f-7281198f6bb3 service cinder] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:50.821797 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616806c-7e28-4ce6-94c8-85515218e9ca service cinder] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:50.822141 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:34:50.833593 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616806c-7e28-4ce6-94c8-85515218e9ca service cinder] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:50.850227 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10d8156-99ec-4df3-b8bb-37cbc6848028 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a3ed285ee4c4d04abf7daf0aeb9fb7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:50.851055 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d8156-99ec-4df3-b8bb-37cbc6848028 service cinder] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:50.852225 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d8156-99ec-4df3-b8bb-37cbc6848028 service cinder] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:50.852603 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d8156-99ec-4df3-b8bb-37cbc6848028 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:50.928866 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bc9d37-82cc-4665-920f-7281198f6bb3 service cinder] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:50.948382 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743394c0-9e69-4dc4-b93b-fbdc46e81c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:50.949310 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743394c0-9e69-4dc4-b93b-fbdc46e81c21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:50.949597 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743394c0-9e69-4dc4-b93b-fbdc46e81c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:50.949872 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743394c0-9e69-4dc4-b93b-fbdc46e81c21 admin admin] PATH_INFO: `/v3/users/32a9543cebb04fb89b48666d34cd38e9` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:50.958901 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743394c0-9e69-4dc4-b93b-fbdc46e81c21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32a9543cebb04fb89b48666d34cd38e9)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:50.959827 dv-cinder-844601-7-smb devstack@keystone.service[80246]: WARNING py.warnings [None req-743394c0-9e69-4dc4-b93b-fbdc46e81c21 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 01 19:34:50.959827 dv-cinder-844601-7-smb devstack@keystone.service[80246]: warnings.warn(msg) Jul 01 19:34:50.959827 dv-cinder-844601-7-smb devstack@keystone.service[80246]: Jul 01 19:34:50.961390 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743394c0-9e69-4dc4-b93b-fbdc46e81c21 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:51.002956 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10d8156-99ec-4df3-b8bb-37cbc6848028 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:51.004531 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10d8156-99ec-4df3-b8bb-37cbc6848028 service cinder] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:51.025161 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 813/1646] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:34:50 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 19:34:51.115425 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-743394c0-9e69-4dc4-b93b-fbdc46e81c21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32a9543cebb04fb89b48666d34cd38e9'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:34:51.118850 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-743394c0-9e69-4dc4-b93b-fbdc46e81c21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32a9543cebb04fb89b48666d34cd38e9'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:34:51.175004 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-743394c0-9e69-4dc4-b93b-fbdc46e81c21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32a9543cebb04fb89b48666d34cd38e9'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:34:51.201771 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-743394c0-9e69-4dc4-b93b-fbdc46e81c21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32a9543cebb04fb89b48666d34cd38e9'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:34:51.226844 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-743394c0-9e69-4dc4-b93b-fbdc46e81c21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32a9543cebb04fb89b48666d34cd38e9'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:34:51.238660 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 834/1647] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:34:50 2022] DELETE /identity/v3/users/32a9543cebb04fb89b48666d34cd38e9 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:34:51.241022 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f411ee1-37ca-4b1c-95c5-a13d8e2b7faf None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:51.247393 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f411ee1-37ca-4b1c-95c5-a13d8e2b7faf None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:51.248506 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f411ee1-37ca-4b1c-95c5-a13d8e2b7faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:51.275946 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-0f411ee1-37ca-4b1c-95c5-a13d8e2b7faf None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:34:51.283460 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-0f411ee1-37ca-4b1c-95c5-a13d8e2b7faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:34:51.480668 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 814/1648] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:34:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:34:51.481685 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743394c0-9e69-4dc4-b93b-fbdc46e81c21 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:51.483369 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-743394c0-9e69-4dc4-b93b-fbdc46e81c21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:34:51.522575 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f411ee1-37ca-4b1c-95c5-a13d8e2b7faf None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:51.524597 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-0f411ee1-37ca-4b1c-95c5-a13d8e2b7faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:34:51.696808 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743394c0-9e69-4dc4-b93b-fbdc46e81c21 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:51.715049 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618991c1-3beb-4668-837f-c1e0d2181d7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a3ed285ee4c4d04abf7daf0aeb9fb7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:51.719646 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618991c1-3beb-4668-837f-c1e0d2181d7e service cinder] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:51.721114 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618991c1-3beb-4668-837f-c1e0d2181d7e service cinder] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:51.723391 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618991c1-3beb-4668-837f-c1e0d2181d7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:51.729446 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-618991c1-3beb-4668-837f-c1e0d2181d7e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:34:51.740292 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f411ee1-37ca-4b1c-95c5-a13d8e2b7faf None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:51.763809 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412de3d5-d6f0-4c5b-a794-07e74c4f2669 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:51.772245 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412de3d5-d6f0-4c5b-a794-07e74c4f2669 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:51.772771 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412de3d5-d6f0-4c5b-a794-07e74c4f2669 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:51.783691 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412de3d5-d6f0-4c5b-a794-07e74c4f2669 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:51.850496 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412de3d5-d6f0-4c5b-a794-07e74c4f2669 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:51.852144 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412de3d5-d6f0-4c5b-a794-07e74c4f2669 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:51.929751 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 815/1649] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:34:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 19:34:51.949125 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618991c1-3beb-4668-837f-c1e0d2181d7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:51.956930 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618991c1-3beb-4668-837f-c1e0d2181d7e service cinder] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:52.023827 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 835/1650] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:34:51 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 19:34:52.562827 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11521374-2c9c-4d3b-941f-9fe379cf3174 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:52.563310 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11521374-2c9c-4d3b-941f-9fe379cf3174 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:52.563392 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11521374-2c9c-4d3b-941f-9fe379cf3174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:52.588474 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cab672-74f0-4c58-a82a-bf86a187ef35 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:52.589032 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cab672-74f0-4c58-a82a-bf86a187ef35 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:52.589099 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cab672-74f0-4c58-a82a-bf86a187ef35 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:52.590509 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 836/1651] 10.222.0.26 () {54 vars in 961 bytes} [Fri Jul 1 19:34:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 19:34:52.613677 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d21dd04-7f68-4ec3-88a4-1c6386e128ce None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:52.614002 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d21dd04-7f68-4ec3-88a4-1c6386e128ce None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:52.614342 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d21dd04-7f68-4ec3-88a4-1c6386e128ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:52.622311 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:34:52.644367 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-11521374-2c9c-4d3b-941f-9fe379cf3174 None None] MFA Rules not processed for user `2db4b840ca744ad6975c4fb3ad5e2351`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:34:52.649634 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-11521374-2c9c-4d3b-941f-9fe379cf3174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:34:52.665777 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-1d21dd04-7f68-4ec3-88a4-1c6386e128ce None None] MFA Rules not processed for user `13fd76fc7dd1410b9cde5adbaa6cb2e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:34:52.667319 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-1d21dd04-7f68-4ec3-88a4-1c6386e128ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:34:52.794296 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:34:52.885498 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 816/1652] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:34:52 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:34:52.885701 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 837/1653] 10.222.0.26 () {58 vars in 1058 bytes} [Fri Jul 1 19:34:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:34:52.896227 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63646770-d365-4ce3-af9d-f95714bfd718 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:52.896527 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63646770-d365-4ce3-af9d-f95714bfd718 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:52.896809 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63646770-d365-4ce3-af9d-f95714bfd718 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:52.898688 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 817/1654] 10.222.0.26 () {54 vars in 912 bytes} [Fri Jul 1 19:34:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:34:52.898803 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dd8d9e-983a-4d5f-89c9-a059cbf729bf None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:52.899161 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dd8d9e-983a-4d5f-89c9-a059cbf729bf None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:52.899596 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dd8d9e-983a-4d5f-89c9-a059cbf729bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:52.918196 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c076fd40-e7a4-4df8-aa45-d78291fca70a None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:52.918412 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c076fd40-e7a4-4df8-aa45-d78291fca70a None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:52.919012 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c076fd40-e7a4-4df8-aa45-d78291fca70a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:52.940814 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-61dd8d9e-983a-4d5f-89c9-a059cbf729bf None None] MFA Rules not processed for user `2db4b840ca744ad6975c4fb3ad5e2351`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:34:52.942340 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-61dd8d9e-983a-4d5f-89c9-a059cbf729bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:34:52.962252 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 838/1655] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:34:52 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:34:52.963867 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e332c-f678-4196-aea2-6846a0e379d0 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:52.964375 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e332c-f678-4196-aea2-6846a0e379d0 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:52.964864 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e332c-f678-4196-aea2-6846a0e379d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:52.998194 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-c076fd40-e7a4-4df8-aa45-d78291fca70a None None] MFA Rules not processed for user `13fd76fc7dd1410b9cde5adbaa6cb2e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:34:53.001948 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-c076fd40-e7a4-4df8-aa45-d78291fca70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:34:53.012441 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-0b7e332c-f678-4196-aea2-6846a0e379d0 None None] MFA Rules not processed for user `aa0c30545c904818b49b703055af87fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:34:53.014512 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-0b7e332c-f678-4196-aea2-6846a0e379d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:34:53.031268 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 818/1656] 10.222.0.26 () {58 vars in 1009 bytes} [Fri Jul 1 19:34:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:34:53.033914 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c076fd40-e7a4-4df8-aa45-d78291fca70a None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:53.037785 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-c076fd40-e7a4-4df8-aa45-d78291fca70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:34:53.059051 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c076fd40-e7a4-4df8-aa45-d78291fca70a None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:53.069065 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d17415-e979-409e-8c33-b06153400dbd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13fd76fc7dd1410b9cde5adbaa6cb2e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:53.069944 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d17415-e979-409e-8c33-b06153400dbd service nova] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:53.070550 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d17415-e979-409e-8c33-b06153400dbd service nova] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:53.071626 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d17415-e979-409e-8c33-b06153400dbd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:53.096172 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d17415-e979-409e-8c33-b06153400dbd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:53.099479 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d17415-e979-409e-8c33-b06153400dbd service nova] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:53.121011 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 819/1657] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:34:53 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:34:53.125411 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d17415-e979-409e-8c33-b06153400dbd service nova] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:53.129734 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-d5d17415-e979-409e-8c33-b06153400dbd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:34:53.134716 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 839/1658] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:34:52 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:34:53.135998 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7e332c-f678-4196-aea2-6846a0e379d0 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:53.137448 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-0b7e332c-f678-4196-aea2-6846a0e379d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:34:53.164447 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d17415-e979-409e-8c33-b06153400dbd service nova] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:53.167506 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7e332c-f678-4196-aea2-6846a0e379d0 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:53.171840 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b33e1-94fc-4f2b-8cd4-3bbc7f8051b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:53.172966 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b33e1-94fc-4f2b-8cd4-3bbc7f8051b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:53.173795 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b33e1-94fc-4f2b-8cd4-3bbc7f8051b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:53.173795 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b33e1-94fc-4f2b-8cd4-3bbc7f8051b7 admin admin] PATH_INFO: `/v3/projects/61d19ec0365f4be29b6550ff692bf7b7` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:53.174915 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7b33e1-94fc-4f2b-8cd4-3bbc7f8051b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61d19ec0365f4be29b6550ff692bf7b7)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:53.175530 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3d1acd-7082-4775-a989-c3f751b45e61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a3ed285ee4c4d04abf7daf0aeb9fb7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:53.176455 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d1acd-7082-4775-a989-c3f751b45e61 service cinder] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:53.177132 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d1acd-7082-4775-a989-c3f751b45e61 service cinder] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:53.177659 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d1acd-7082-4775-a989-c3f751b45e61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:53.179198 dv-cinder-844601-7-smb devstack@keystone.service[80247]: WARNING py.warnings [None req-cd7b33e1-94fc-4f2b-8cd4-3bbc7f8051b7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 01 19:34:53.179198 dv-cinder-844601-7-smb devstack@keystone.service[80247]: warnings.warn(msg) Jul 01 19:34:53.179198 dv-cinder-844601-7-smb devstack@keystone.service[80247]: Jul 01 19:34:53.181333 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7b33e1-94fc-4f2b-8cd4-3bbc7f8051b7 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:53.194984 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3d1acd-7082-4775-a989-c3f751b45e61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:53.196947 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3d1acd-7082-4775-a989-c3f751b45e61 service cinder] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:53.222156 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 840/1659] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:34:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:34:53.242693 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3d1acd-7082-4775-a989-c3f751b45e61 service cinder] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:53.250059 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-1a3d1acd-7082-4775-a989-c3f751b45e61 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:34:53.313970 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-cd7b33e1-94fc-4f2b-8cd4-3bbc7f8051b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61d19ec0365f4be29b6550ff692bf7b7', 'request_id': 'req-cd7b33e1-94fc-4f2b-8cd4-3bbc7f8051b7'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:34:53.327037 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-cd7b33e1-94fc-4f2b-8cd4-3bbc7f8051b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61d19ec0365f4be29b6550ff692bf7b7', 'request_id': 'req-cd7b33e1-94fc-4f2b-8cd4-3bbc7f8051b7'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:34:53.342495 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3d1acd-7082-4775-a989-c3f751b45e61 service cinder] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:53.356367 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-cd7b33e1-94fc-4f2b-8cd4-3bbc7f8051b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61d19ec0365f4be29b6550ff692bf7b7', 'request_id': 'req-cd7b33e1-94fc-4f2b-8cd4-3bbc7f8051b7'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:34:53.408359 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-cd7b33e1-94fc-4f2b-8cd4-3bbc7f8051b7 admin admin] The token cache is being invalidate because project 61d19ec0365f4be29b6550ff692bf7b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:34:53.409566 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-cd7b33e1-94fc-4f2b-8cd4-3bbc7f8051b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:34:53.410669 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-cd7b33e1-94fc-4f2b-8cd4-3bbc7f8051b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:34:53.424171 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 820/1660] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:34:53 2022] DELETE /identity/v3/projects/61d19ec0365f4be29b6550ff692bf7b7 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:34:53.428894 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b33e1-94fc-4f2b-8cd4-3bbc7f8051b7 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:53.432180 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-cd7b33e1-94fc-4f2b-8cd4-3bbc7f8051b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:34:53.652924 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b33e1-94fc-4f2b-8cd4-3bbc7f8051b7 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:53.658717 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1cf5e3-0ef7-4294-b0b5-48976f8931ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:53.659562 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1cf5e3-0ef7-4294-b0b5-48976f8931ad admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:53.659670 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1cf5e3-0ef7-4294-b0b5-48976f8931ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:53.659952 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1cf5e3-0ef7-4294-b0b5-48976f8931ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:53.660663 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1cf5e3-0ef7-4294-b0b5-48976f8931ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:53.667372 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1cf5e3-0ef7-4294-b0b5-48976f8931ad admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:53.678600 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7a8c7b-8234-4895-8246-de93db7ccbbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:53.679466 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a8c7b-8234-4895-8246-de93db7ccbbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:53.679756 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a8c7b-8234-4895-8246-de93db7ccbbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:53.680040 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a8c7b-8234-4895-8246-de93db7ccbbd admin admin] PATH_INFO: `/v3/users/63d12de6b3d5499984ca8c7c578bcfc7` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:53.681498 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7a8c7b-8234-4895-8246-de93db7ccbbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=63d12de6b3d5499984ca8c7c578bcfc7)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:53.684424 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7a8c7b-8234-4895-8246-de93db7ccbbd admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:53.729444 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:34:53.796496 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:34:53.810647 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-4c7a8c7b-8234-4895-8246-de93db7ccbbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63d12de6b3d5499984ca8c7c578bcfc7'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:34:53.813851 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-4c7a8c7b-8234-4895-8246-de93db7ccbbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63d12de6b3d5499984ca8c7c578bcfc7'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:34:53.831167 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-4c7a8c7b-8234-4895-8246-de93db7ccbbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63d12de6b3d5499984ca8c7c578bcfc7'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:34:53.869949 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-4c7a8c7b-8234-4895-8246-de93db7ccbbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63d12de6b3d5499984ca8c7c578bcfc7'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:34:53.870671 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-4c7a8c7b-8234-4895-8246-de93db7ccbbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63d12de6b3d5499984ca8c7c578bcfc7'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:34:53.875451 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 841/1661] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:34:53 2022] POST /identity/v3/projects => generated 403 bytes in 633 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:34:53.877773 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1cf5e3-0ef7-4294-b0b5-48976f8931ad admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:53.882285 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-ad1cf5e3-0ef7-4294-b0b5-48976f8931ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:34:53.923535 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 821/1662] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:34:53 2022] DELETE /identity/v3/users/63d12de6b3d5499984ca8c7c578bcfc7 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:34:54.089110 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1cf5e3-0ef7-4294-b0b5-48976f8931ad admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:54.260804 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fb1e0c-c2d9-4ada-a03b-48499c9f572d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:54.263390 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb1e0c-c2d9-4ada-a03b-48499c9f572d admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:54.264110 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb1e0c-c2d9-4ada-a03b-48499c9f572d admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:54.265077 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb1e0c-c2d9-4ada-a03b-48499c9f572d admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:54.267624 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fb1e0c-c2d9-4ada-a03b-48499c9f572d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:54.272555 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fb1e0c-c2d9-4ada-a03b-48499c9f572d admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:54.342624 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 842/1663] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:34:53 2022] POST /identity/v3/users => generated 308 bytes in 465 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:34:54.348866 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7a8c7b-8234-4895-8246-de93db7ccbbd admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:54.379335 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7a8c7b-8234-4895-8246-de93db7ccbbd admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:54.392959 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f1a94b-ccdc-4ce6-baea-23bfe14acf17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:54.394026 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f1a94b-ccdc-4ce6-baea-23bfe14acf17 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:54.394321 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f1a94b-ccdc-4ce6-baea-23bfe14acf17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:54.394605 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f1a94b-ccdc-4ce6-baea-23bfe14acf17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:54.395367 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f1a94b-ccdc-4ce6-baea-23bfe14acf17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:54.401968 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f1a94b-ccdc-4ce6-baea-23bfe14acf17 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:54.450548 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fb1e0c-c2d9-4ada-a03b-48499c9f572d admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:54.450662 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 822/1664] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:34:54 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:34:54.473445 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fb1e0c-c2d9-4ada-a03b-48499c9f572d admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:54.480227 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aabde0a-495e-4df4-9393-39fce7814136 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:54.482240 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aabde0a-495e-4df4-9393-39fce7814136 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:54.487654 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aabde0a-495e-4df4-9393-39fce7814136 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:54.490636 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 823/1665] 10.222.0.26 () {54 vars in 912 bytes} [Fri Jul 1 19:34:54 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:34:54.497888 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ef9e5-5e16-4377-80ac-12cd75bf77bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:54.499632 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84385290-053a-4327-ac9a-9ad7f0f25cab None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:54.500149 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84385290-053a-4327-ac9a-9ad7f0f25cab None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:54.500742 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84385290-053a-4327-ac9a-9ad7f0f25cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:54.501879 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ef9e5-5e16-4377-80ac-12cd75bf77bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:54.502866 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ef9e5-5e16-4377-80ac-12cd75bf77bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:54.504274 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ef9e5-5e16-4377-80ac-12cd75bf77bd admin admin] PATH_INFO: `/v3/projects/e04799bbf437462eb2bfbc39ccbcaf07/users/2edaac5f684445f88b613afd46c202c1/roles/6cb03785fb184ef587509b3174622f69` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:54.558714 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99ef9e5-5e16-4377-80ac-12cd75bf77bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e04799bbf437462eb2bfbc39ccbcaf07, user_id=2edaac5f684445f88b613afd46c202c1, role_id=6cb03785fb184ef587509b3174622f69)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:54.565826 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99ef9e5-5e16-4377-80ac-12cd75bf77bd admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:54.613275 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 843/1666] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:34:54 2022] PUT /identity/v3/projects/e04799bbf437462eb2bfbc39ccbcaf07/users/2edaac5f684445f88b613afd46c202c1/roles/6cb03785fb184ef587509b3174622f69 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:34:54.616613 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ef9e5-5e16-4377-80ac-12cd75bf77bd admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:54.643546 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-84385290-053a-4327-ac9a-9ad7f0f25cab None None] MFA Rules not processed for user `4557d17438a249ee8f75927449a1a059`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:34:54.648267 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-84385290-053a-4327-ac9a-9ad7f0f25cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:34:54.803585 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ef9e5-5e16-4377-80ac-12cd75bf77bd admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:54.813003 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb63fc7-fe59-44e1-a4af-3d621212a4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:54.814091 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb63fc7-fe59-44e1-a4af-3d621212a4b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:54.814642 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb63fc7-fe59-44e1-a4af-3d621212a4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:54.815122 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb63fc7-fe59-44e1-a4af-3d621212a4b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:54.816201 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb63fc7-fe59-44e1-a4af-3d621212a4b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:54.818154 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb63fc7-fe59-44e1-a4af-3d621212a4b1 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:54.821076 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:34:54.837158 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 844/1667] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:34:54 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:34:54.842142 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb63fc7-fe59-44e1-a4af-3d621212a4b1 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:54.855850 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 824/1668] 10.222.0.26 () {58 vars in 1009 bytes} [Fri Jul 1 19:34:54 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:34:54.862000 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb63fc7-fe59-44e1-a4af-3d621212a4b1 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:54.867949 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4f6e81-dd71-44e0-957b-8896ff78cef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:54.869815 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84385290-053a-4327-ac9a-9ad7f0f25cab None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:54.871632 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-84385290-053a-4327-ac9a-9ad7f0f25cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:34:54.881009 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f6e81-dd71-44e0-957b-8896ff78cef7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:54.881329 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f6e81-dd71-44e0-957b-8896ff78cef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:54.881622 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f6e81-dd71-44e0-957b-8896ff78cef7 admin admin] PATH_INFO: `/v3/projects/e04799bbf437462eb2bfbc39ccbcaf07/users/2edaac5f684445f88b613afd46c202c1/roles/6cb03785fb184ef587509b3174622f69` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:54.886709 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84385290-053a-4327-ac9a-9ad7f0f25cab None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:54.888876 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4f6e81-dd71-44e0-957b-8896ff78cef7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e04799bbf437462eb2bfbc39ccbcaf07, user_id=2edaac5f684445f88b613afd46c202c1, role_id=6cb03785fb184ef587509b3174622f69)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:54.895721 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4f6e81-dd71-44e0-957b-8896ff78cef7 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:54.899213 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1404ee-96e2-4215-b2cf-4fa79a2425c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:54.900756 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1404ee-96e2-4215-b2cf-4fa79a2425c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:54.901045 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1404ee-96e2-4215-b2cf-4fa79a2425c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:54.901505 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1404ee-96e2-4215-b2cf-4fa79a2425c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:54.925752 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1404ee-96e2-4215-b2cf-4fa79a2425c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:54.929648 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 845/1669] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:34:54 2022] PUT /identity/v3/projects/e04799bbf437462eb2bfbc39ccbcaf07/users/2edaac5f684445f88b613afd46c202c1/roles/6cb03785fb184ef587509b3174622f69 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:34:54.934218 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1404ee-96e2-4215-b2cf-4fa79a2425c7 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:54.947925 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 825/1670] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:34:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 19:34:55.763632 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4f6e81-dd71-44e0-957b-8896ff78cef7 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:55.766240 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-5c4f6e81-dd71-44e0-957b-8896ff78cef7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:34:55.927785 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4f6e81-dd71-44e0-957b-8896ff78cef7 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:55.934295 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d48e13b-313b-4cd4-96c5-bd3f0bf6b461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:55.935531 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48e13b-313b-4cd4-96c5-bd3f0bf6b461 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:55.936023 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48e13b-313b-4cd4-96c5-bd3f0bf6b461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:55.936520 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48e13b-313b-4cd4-96c5-bd3f0bf6b461 admin admin] PATH_INFO: `/v3/projects/0474601a28104b70abd68907c1acd804` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:55.938127 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d48e13b-313b-4cd4-96c5-bd3f0bf6b461 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0474601a28104b70abd68907c1acd804)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:55.941117 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d48e13b-313b-4cd4-96c5-bd3f0bf6b461 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:56.021911 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c4324-acd5-4340-9fd2-5177c02e29e6 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:56.022427 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c4324-acd5-4340-9fd2-5177c02e29e6 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:56.022512 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c4324-acd5-4340-9fd2-5177c02e29e6 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:56.027708 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 826/1671] 10.222.0.26 () {54 vars in 960 bytes} [Fri Jul 1 19:34:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:34:56.033735 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa8eb4-e601-4603-a63d-e3a61066667b None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:56.034257 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa8eb4-e601-4603-a63d-e3a61066667b None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:56.034847 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa8eb4-e601-4603-a63d-e3a61066667b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:56.063247 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-9d48e13b-313b-4cd4-96c5-bd3f0bf6b461 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0474601a28104b70abd68907c1acd804', 'request_id': 'req-9d48e13b-313b-4cd4-96c5-bd3f0bf6b461'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:34:56.096840 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-9d48e13b-313b-4cd4-96c5-bd3f0bf6b461 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0474601a28104b70abd68907c1acd804', 'request_id': 'req-9d48e13b-313b-4cd4-96c5-bd3f0bf6b461'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:34:56.110652 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-77fa8eb4-e601-4603-a63d-e3a61066667b None None] MFA Rules not processed for user `941e65d95bcd4e66a6489280520c12de`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:34:56.111894 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-77fa8eb4-e601-4603-a63d-e3a61066667b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:34:56.123749 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-9d48e13b-313b-4cd4-96c5-bd3f0bf6b461 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0474601a28104b70abd68907c1acd804', 'request_id': 'req-9d48e13b-313b-4cd4-96c5-bd3f0bf6b461'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:34:56.173136 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-9d48e13b-313b-4cd4-96c5-bd3f0bf6b461 admin admin] The token cache is being invalidate because project 0474601a28104b70abd68907c1acd804 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:34:56.173456 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-9d48e13b-313b-4cd4-96c5-bd3f0bf6b461 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:34:56.176950 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-9d48e13b-313b-4cd4-96c5-bd3f0bf6b461 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:34:56.189050 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 846/1672] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:34:55 2022] DELETE /identity/v3/projects/0474601a28104b70abd68907c1acd804 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:34:56.193000 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ae63b-e9c1-4cf1-9b2a-a48e226f7ba8 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:56.193333 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ae63b-e9c1-4cf1-9b2a-a48e226f7ba8 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:56.193876 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ae63b-e9c1-4cf1-9b2a-a48e226f7ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:56.228817 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-712ae63b-e9c1-4cf1-9b2a-a48e226f7ba8 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:34:56.230153 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-712ae63b-e9c1-4cf1-9b2a-a48e226f7ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:34:56.300037 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 827/1673] 10.222.0.26 () {58 vars in 1057 bytes} [Fri Jul 1 19:34:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:34:56.309189 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fa8eb4-e601-4603-a63d-e3a61066667b None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:56.334152 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fa8eb4-e601-4603-a63d-e3a61066667b None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:56.342053 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c58c7be-f458-4209-b8f9-72a9296ee630 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '941e65d95bcd4e66a6489280520c12de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:56.342882 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c58c7be-f458-4209-b8f9-72a9296ee630 service placement] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:56.343269 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c58c7be-f458-4209-b8f9-72a9296ee630 service placement] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:56.343619 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c58c7be-f458-4209-b8f9-72a9296ee630 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:56.345828 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-6c58c7be-f458-4209-b8f9-72a9296ee630 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:34:56.377936 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c58c7be-f458-4209-b8f9-72a9296ee630 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:56.380923 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c58c7be-f458-4209-b8f9-72a9296ee630 service placement] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:56.396405 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 828/1674] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:34:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 19:34:56.464277 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 847/1675] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:34:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:34:56.473143 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d17b3a-e088-4df3-a8a3-4dd6c286c8ce None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:56.474389 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d17b3a-e088-4df3-a8a3-4dd6c286c8ce None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:56.475185 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d17b3a-e088-4df3-a8a3-4dd6c286c8ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:56.522067 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-73d17b3a-e088-4df3-a8a3-4dd6c286c8ce None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:34:56.523879 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-73d17b3a-e088-4df3-a8a3-4dd6c286c8ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:34:56.557012 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 829/1676] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:34:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:34:56.558517 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712ae63b-e9c1-4cf1-9b2a-a48e226f7ba8 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:56.580133 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712ae63b-e9c1-4cf1-9b2a-a48e226f7ba8 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:56.601388 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fac893-341b-4ec0-a27e-1ce43553275c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:56.601388 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fac893-341b-4ec0-a27e-1ce43553275c admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:56.601388 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fac893-341b-4ec0-a27e-1ce43553275c admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:56.601388 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fac893-341b-4ec0-a27e-1ce43553275c admin admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:56.601924 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fac893-341b-4ec0-a27e-1ce43553275c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:34:56.610101 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fac893-341b-4ec0-a27e-1ce43553275c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:56.612300 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fac893-341b-4ec0-a27e-1ce43553275c admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:56.652598 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 848/1677] 10.222.0.26 () {58 vars in 1152 bytes} [Fri Jul 1 19:34:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:34:56.658318 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d17b3a-e088-4df3-a8a3-4dd6c286c8ce None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:56.678060 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:34:56.683732 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d17b3a-e088-4df3-a8a3-4dd6c286c8ce None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:56.696533 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d1b3ca-cac6-4a5c-a69c-673ee4374abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:56.697532 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1b3ca-cac6-4a5c-a69c-673ee4374abd admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:56.698007 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1b3ca-cac6-4a5c-a69c-673ee4374abd admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:56.698629 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1b3ca-cac6-4a5c-a69c-673ee4374abd admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:56.700168 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d1b3ca-cac6-4a5c-a69c-673ee4374abd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:56.710501 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d1b3ca-cac6-4a5c-a69c-673ee4374abd admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:56.764807 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 830/1678] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:34:56 2022] POST /identity/v3/projects => generated 387 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:34:56.768731 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fac893-341b-4ec0-a27e-1ce43553275c admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:56.781012 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:34:56.793275 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fac893-341b-4ec0-a27e-1ce43553275c admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:56.901038 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77d2b75-3d3f-401d-875e-c1413ab284a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:56.902402 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d2b75-3d3f-401d-875e-c1413ab284a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:56.904259 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d2b75-3d3f-401d-875e-c1413ab284a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:56.904881 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d2b75-3d3f-401d-875e-c1413ab284a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:56.907175 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77d2b75-3d3f-401d-875e-c1413ab284a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:56.911329 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77d2b75-3d3f-401d-875e-c1413ab284a6 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:56.962316 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 849/1679] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:34:56 2022] POST /identity/v3/users => generated 294 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:34:56.966245 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d1b3ca-cac6-4a5c-a69c-673ee4374abd admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:56.988865 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d1b3ca-cac6-4a5c-a69c-673ee4374abd admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:57.003482 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a31eb98-e62a-496e-8076-be25285adacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:57.004518 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31eb98-e62a-496e-8076-be25285adacd admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:57.005829 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31eb98-e62a-496e-8076-be25285adacd admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:57.005829 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31eb98-e62a-496e-8076-be25285adacd admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:57.023507 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a31eb98-e62a-496e-8076-be25285adacd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:57.034857 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a31eb98-e62a-496e-8076-be25285adacd admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:57.080887 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 831/1680] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:34:56 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 19:34:57.087734 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77d2b75-3d3f-401d-875e-c1413ab284a6 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:57.132631 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77d2b75-3d3f-401d-875e-c1413ab284a6 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:57.145789 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8785981-622e-449a-9a00-0d779a247dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:57.146992 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8785981-622e-449a-9a00-0d779a247dff admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:57.147580 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8785981-622e-449a-9a00-0d779a247dff admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:57.148078 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8785981-622e-449a-9a00-0d779a247dff admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:57.149670 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8785981-622e-449a-9a00-0d779a247dff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:57.153904 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8785981-622e-449a-9a00-0d779a247dff admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:57.190746 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 850/1681] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:34:57 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:34:57.196106 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a31eb98-e62a-496e-8076-be25285adacd admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:57.237838 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a31eb98-e62a-496e-8076-be25285adacd admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:57.268776 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9725c5c8-8aba-4467-955e-91e4352929c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:57.273324 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725c5c8-8aba-4467-955e-91e4352929c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:57.273697 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725c5c8-8aba-4467-955e-91e4352929c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:57.277929 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725c5c8-8aba-4467-955e-91e4352929c2 admin admin] PATH_INFO: `/v3/projects/0bc74ce9f94e4dacadd806adf2a4fd3c/users/ee9916387f1949ddbaebad4cf8be8a77/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:57.377289 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9725c5c8-8aba-4467-955e-91e4352929c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bc74ce9f94e4dacadd806adf2a4fd3c, user_id=ee9916387f1949ddbaebad4cf8be8a77, role_id=4cbf6ec846eb4b7c8cc52e9bfd6f076f)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:57.394285 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9725c5c8-8aba-4467-955e-91e4352929c2 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:57.427694 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 832/1682] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:34:57 2022] PUT /identity/v3/projects/0bc74ce9f94e4dacadd806adf2a4fd3c/users/ee9916387f1949ddbaebad4cf8be8a77/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:34:57.443033 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250aec89-25ff-4ffa-a884-374e9b8a37fd None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:57.443763 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250aec89-25ff-4ffa-a884-374e9b8a37fd None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:57.444359 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250aec89-25ff-4ffa-a884-374e9b8a37fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:57.575127 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-250aec89-25ff-4ffa-a884-374e9b8a37fd None None] MFA Rules not processed for user `ee9916387f1949ddbaebad4cf8be8a77`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:34:57.578815 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-250aec89-25ff-4ffa-a884-374e9b8a37fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:34:57.908322 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 851/1683] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:34:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 466 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:34:57.911245 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9725c5c8-8aba-4467-955e-91e4352929c2 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:58.092648 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9725c5c8-8aba-4467-955e-91e4352929c2 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:58.100330 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e7e020-a2f6-4315-9268-5646a67e7a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:58.101421 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e7e020-a2f6-4315-9268-5646a67e7a8a admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:58.101774 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e7e020-a2f6-4315-9268-5646a67e7a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:58.102316 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e7e020-a2f6-4315-9268-5646a67e7a8a admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:58.103299 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e7e020-a2f6-4315-9268-5646a67e7a8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:58.110381 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e7e020-a2f6-4315-9268-5646a67e7a8a admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:58.177999 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 833/1684] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:34:57 2022] POST /identity/v3/projects => generated 385 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:34:58.179418 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250aec89-25ff-4ffa-a884-374e9b8a37fd None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:58.208376 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250aec89-25ff-4ffa-a884-374e9b8a37fd None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:58.268966 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e7e020-a2f6-4315-9268-5646a67e7a8a admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:58.271941 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-71e7e020-a2f6-4315-9268-5646a67e7a8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:34:58.357198 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cc7452-04bb-462a-96a2-21b3eee6268e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:58.357922 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc7452-04bb-462a-96a2-21b3eee6268e admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:58.359103 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc7452-04bb-462a-96a2-21b3eee6268e admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:58.359392 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc7452-04bb-462a-96a2-21b3eee6268e admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:58.360317 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cc7452-04bb-462a-96a2-21b3eee6268e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:58.375769 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cc7452-04bb-462a-96a2-21b3eee6268e admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:58.413776 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:34:58.430298 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 852/1685] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:34:58 2022] POST /identity/v3/users => generated 293 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:34:58.434562 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cc7452-04bb-462a-96a2-21b3eee6268e admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:58.457146 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cc7452-04bb-462a-96a2-21b3eee6268e admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:58.496339 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f3c777-a153-4e20-8e20-ad2212d28ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:58.497000 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f3c777-a153-4e20-8e20-ad2212d28ca1 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:58.497311 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f3c777-a153-4e20-8e20-ad2212d28ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:58.497594 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f3c777-a153-4e20-8e20-ad2212d28ca1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:58.505702 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f3c777-a153-4e20-8e20-ad2212d28ca1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:58.508071 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f3c777-a153-4e20-8e20-ad2212d28ca1 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:58.620056 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 853/1686] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:34:58 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:34:58.640946 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f3c777-a153-4e20-8e20-ad2212d28ca1 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:58.689043 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e7e020-a2f6-4315-9268-5646a67e7a8a admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:58.690124 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f3c777-a153-4e20-8e20-ad2212d28ca1 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:58.705504 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7025eb31-aac5-4bb9-9d97-ff8f6c30e0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:58.708209 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7025eb31-aac5-4bb9-9d97-ff8f6c30e0d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:58.708724 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96331ecf-c6d3-4f1d-9a60-817dc7de5c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:58.708959 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7025eb31-aac5-4bb9-9d97-ff8f6c30e0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:58.710319 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96331ecf-c6d3-4f1d-9a60-817dc7de5c46 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:58.711467 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7025eb31-aac5-4bb9-9d97-ff8f6c30e0d1 admin admin] PATH_INFO: `/v3/users/ca5e02a8eda94202b4464352cfbdc41a` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:58.712190 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96331ecf-c6d3-4f1d-9a60-817dc7de5c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:58.713258 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96331ecf-c6d3-4f1d-9a60-817dc7de5c46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:58.717456 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96331ecf-c6d3-4f1d-9a60-817dc7de5c46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:58.721915 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7025eb31-aac5-4bb9-9d97-ff8f6c30e0d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca5e02a8eda94202b4464352cfbdc41a)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:58.725993 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96331ecf-c6d3-4f1d-9a60-817dc7de5c46 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:58.732769 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7025eb31-aac5-4bb9-9d97-ff8f6c30e0d1 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:58.773229 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 854/1687] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:34:58 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:34:58.778693 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96331ecf-c6d3-4f1d-9a60-817dc7de5c46 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:58.842326 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96331ecf-c6d3-4f1d-9a60-817dc7de5c46 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:58.865288 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:34:58.870431 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b843195b-c590-4f1a-89cd-c2a17b237fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:58.871372 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843195b-c590-4f1a-89cd-c2a17b237fde admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:58.875173 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843195b-c590-4f1a-89cd-c2a17b237fde admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:58.875554 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843195b-c590-4f1a-89cd-c2a17b237fde admin admin] PATH_INFO: `/v3/projects/2b2212f9b0cd4c8a9559e6b00ca7b448/users/c14ce27ccd4f4b409863582212916e43/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:58.903014 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-7025eb31-aac5-4bb9-9d97-ff8f6c30e0d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca5e02a8eda94202b4464352cfbdc41a'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:34:58.906795 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-7025eb31-aac5-4bb9-9d97-ff8f6c30e0d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca5e02a8eda94202b4464352cfbdc41a'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:34:58.928623 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-7025eb31-aac5-4bb9-9d97-ff8f6c30e0d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca5e02a8eda94202b4464352cfbdc41a'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:34:58.950483 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b843195b-c590-4f1a-89cd-c2a17b237fde admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b2212f9b0cd4c8a9559e6b00ca7b448, user_id=c14ce27ccd4f4b409863582212916e43, role_id=4cbf6ec846eb4b7c8cc52e9bfd6f076f)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:58.965563 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b843195b-c590-4f1a-89cd-c2a17b237fde admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:58.965810 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-7025eb31-aac5-4bb9-9d97-ff8f6c30e0d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca5e02a8eda94202b4464352cfbdc41a'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:34:58.966596 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-7025eb31-aac5-4bb9-9d97-ff8f6c30e0d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca5e02a8eda94202b4464352cfbdc41a'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:34:59.019600 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 834/1688] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:34:58 2022] DELETE /identity/v3/users/ca5e02a8eda94202b4464352cfbdc41a => generated 0 bytes in 752 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:34:59.022149 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4061745-1a42-4cbf-ae65-06e998c6f806 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:59.023861 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4061745-1a42-4cbf-ae65-06e998c6f806 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:59.024306 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4061745-1a42-4cbf-ae65-06e998c6f806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:59.035214 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 855/1689] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:34:58 2022] PUT /identity/v3/projects/2b2212f9b0cd4c8a9559e6b00ca7b448/users/c14ce27ccd4f4b409863582212916e43/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:34:59.036921 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd96f74f-fb9e-400f-ab76-41da2b218b5c None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:59.037226 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd96f74f-fb9e-400f-ab76-41da2b218b5c None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:59.037540 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd96f74f-fb9e-400f-ab76-41da2b218b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:59.090641 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-c4061745-1a42-4cbf-ae65-06e998c6f806 None None] MFA Rules not processed for user `2edaac5f684445f88b613afd46c202c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:34:59.095444 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-c4061745-1a42-4cbf-ae65-06e998c6f806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:34:59.098831 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-fd96f74f-fb9e-400f-ab76-41da2b218b5c None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:34:59.105018 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-fd96f74f-fb9e-400f-ab76-41da2b218b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:34:59.347752 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 856/1690] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:34:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:34:59.347752 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08af536-4c38-4d13-b4fd-e6ed36216171 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:59.347752 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08af536-4c38-4d13-b4fd-e6ed36216171 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:59.347752 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08af536-4c38-4d13-b4fd-e6ed36216171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:59.381157 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 835/1691] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:34:59 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:34:59.400729 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4061745-1a42-4cbf-ae65-06e998c6f806 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:59.400729 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-c4061745-1a42-4cbf-ae65-06e998c6f806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:34:59.431294 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-f08af536-4c38-4d13-b4fd-e6ed36216171 None None] MFA Rules not processed for user `c14ce27ccd4f4b409863582212916e43`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:34:59.436818 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-f08af536-4c38-4d13-b4fd-e6ed36216171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:34:59.561175 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4061745-1a42-4cbf-ae65-06e998c6f806 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:59.566481 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c56c20f-0e13-4fdc-a0cc-12f2cd9b7ae5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:59.567566 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56c20f-0e13-4fdc-a0cc-12f2cd9b7ae5 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:59.568358 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56c20f-0e13-4fdc-a0cc-12f2cd9b7ae5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:59.568896 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56c20f-0e13-4fdc-a0cc-12f2cd9b7ae5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:59.606281 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c56c20f-0e13-4fdc-a0cc-12f2cd9b7ae5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:59.610375 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c56c20f-0e13-4fdc-a0cc-12f2cd9b7ae5 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:59.635053 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 836/1692] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:34:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:34:59.707830 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 857/1693] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:34:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:34:59.712567 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c56c20f-0e13-4fdc-a0cc-12f2cd9b7ae5 service neutron] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:59.714717 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-4c56c20f-0e13-4fdc-a0cc-12f2cd9b7ae5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:34:59.744908 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c56c20f-0e13-4fdc-a0cc-12f2cd9b7ae5 service neutron] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:59.755350 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680c3c0f-4e88-4888-bb8e-65e9e29b982a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:59.756569 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c3c0f-4e88-4888-bb8e-65e9e29b982a admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:59.756994 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c3c0f-4e88-4888-bb8e-65e9e29b982a admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:59.757412 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c3c0f-4e88-4888-bb8e-65e9e29b982a admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:59.758853 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680c3c0f-4e88-4888-bb8e-65e9e29b982a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:59.761625 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680c3c0f-4e88-4888-bb8e-65e9e29b982a admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:59.833862 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 837/1694] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:34:59 2022] POST /identity/v3/projects => generated 387 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:34:59.838461 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08af536-4c38-4d13-b4fd-e6ed36216171 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:59.859701 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08af536-4c38-4d13-b4fd-e6ed36216171 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:00.023667 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:00.090752 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a35da8c-ba5b-49cd-b908-67c2365d3fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:00.091632 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a35da8c-ba5b-49cd-b908-67c2365d3fe3 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:00.093384 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a35da8c-ba5b-49cd-b908-67c2365d3fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:00.094111 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a35da8c-ba5b-49cd-b908-67c2365d3fe3 admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:00.097474 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a35da8c-ba5b-49cd-b908-67c2365d3fe3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:00.103796 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a35da8c-ba5b-49cd-b908-67c2365d3fe3 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:00.186336 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 858/1695] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:34:59 2022] POST /identity/v3/users => generated 300 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 19:35:00.191373 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680c3c0f-4e88-4888-bb8e-65e9e29b982a admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:00.208340 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680c3c0f-4e88-4888-bb8e-65e9e29b982a admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:00.230425 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f65e2a-881b-44c6-b0a9-9a5d87f51232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:00.231316 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f65e2a-881b-44c6-b0a9-9a5d87f51232 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:00.231976 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f65e2a-881b-44c6-b0a9-9a5d87f51232 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:00.232396 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f65e2a-881b-44c6-b0a9-9a5d87f51232 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:00.234111 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f65e2a-881b-44c6-b0a9-9a5d87f51232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:00.239976 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f65e2a-881b-44c6-b0a9-9a5d87f51232 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:00.275008 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 838/1696] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:35:00 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:35:00.279165 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a35da8c-ba5b-49cd-b908-67c2365d3fe3 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:00.295390 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a35da8c-ba5b-49cd-b908-67c2365d3fe3 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:00.344604 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47afaa01-35d0-4f56-8cba-9a9fb6fcd326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:00.345834 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47afaa01-35d0-4f56-8cba-9a9fb6fcd326 admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:00.353809 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47afaa01-35d0-4f56-8cba-9a9fb6fcd326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:00.354469 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f65e2a-881b-44c6-b0a9-9a5d87f51232 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:00.355316 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47afaa01-35d0-4f56-8cba-9a9fb6fcd326 admin admin] PATH_INFO: `/v3/projects/016b0d91d0a5492fb9f274633a6d720a/users/5753d5252e2b4bb6b4150bd6e6c978e6/roles/6cb03785fb184ef587509b3174622f69` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:00.356611 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-90f65e2a-881b-44c6-b0a9-9a5d87f51232 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:00.376606 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:00.383389 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f65e2a-881b-44c6-b0a9-9a5d87f51232 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:00.399124 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278ad767-a3c0-499b-8887-46114cc2b701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:00.400041 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ad767-a3c0-499b-8887-46114cc2b701 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:00.400341 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ad767-a3c0-499b-8887-46114cc2b701 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:00.400668 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ad767-a3c0-499b-8887-46114cc2b701 admin admin] PATH_INFO: `/v3/users/ce26113c70f0460892402b4e64e9cf6d` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:00.403909 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278ad767-a3c0-499b-8887-46114cc2b701 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce26113c70f0460892402b4e64e9cf6d)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:00.418498 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278ad767-a3c0-499b-8887-46114cc2b701 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:00.449573 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47afaa01-35d0-4f56-8cba-9a9fb6fcd326 admin admin] RBAC: Authorizing `identity:create_grant(project_id=016b0d91d0a5492fb9f274633a6d720a, user_id=5753d5252e2b4bb6b4150bd6e6c978e6, role_id=6cb03785fb184ef587509b3174622f69)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:00.452720 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47afaa01-35d0-4f56-8cba-9a9fb6fcd326 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:00.516786 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 859/1697] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:35:00 2022] PUT /identity/v3/projects/016b0d91d0a5492fb9f274633a6d720a/users/5753d5252e2b4bb6b4150bd6e6c978e6/roles/6cb03785fb184ef587509b3174622f69 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:00.526185 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47afaa01-35d0-4f56-8cba-9a9fb6fcd326 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:00.619278 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-278ad767-a3c0-499b-8887-46114cc2b701 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce26113c70f0460892402b4e64e9cf6d'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:00.622494 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-278ad767-a3c0-499b-8887-46114cc2b701 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce26113c70f0460892402b4e64e9cf6d'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:00.657274 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-278ad767-a3c0-499b-8887-46114cc2b701 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce26113c70f0460892402b4e64e9cf6d'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:00.684028 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-278ad767-a3c0-499b-8887-46114cc2b701 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce26113c70f0460892402b4e64e9cf6d'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:00.691378 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-278ad767-a3c0-499b-8887-46114cc2b701 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce26113c70f0460892402b4e64e9cf6d'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:00.785687 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 839/1698] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:35:00 2022] DELETE /identity/v3/users/ce26113c70f0460892402b4e64e9cf6d => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:00.787253 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8defbf6-1e1d-43ca-87fb-459343d23c74 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:00.787552 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8defbf6-1e1d-43ca-87fb-459343d23c74 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:00.787835 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8defbf6-1e1d-43ca-87fb-459343d23c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:00.800218 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47afaa01-35d0-4f56-8cba-9a9fb6fcd326 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:00.855914 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-f8defbf6-1e1d-43ca-87fb-459343d23c74 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:00.869832 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-f8defbf6-1e1d-43ca-87fb-459343d23c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:01.106478 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 840/1699] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:35:01.108926 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0a2dd-0a35-4240-a4b6-c3843fde45c5 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:01.109487 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0a2dd-0a35-4240-a4b6-c3843fde45c5 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:01.109908 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0a2dd-0a35-4240-a4b6-c3843fde45c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:01.116322 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ddaaeb-3e0a-4d86-bfd9-fbbfed429ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:01.116483 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ddaaeb-3e0a-4d86-bfd9-fbbfed429ca1 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:01.116751 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ddaaeb-3e0a-4d86-bfd9-fbbfed429ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:01.117042 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ddaaeb-3e0a-4d86-bfd9-fbbfed429ca1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:01.117921 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ddaaeb-3e0a-4d86-bfd9-fbbfed429ca1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:01.120147 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ddaaeb-3e0a-4d86-bfd9-fbbfed429ca1 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:01.141642 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 860/1700] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:35:00 2022] GET /identity/v3/roles => generated 1420 bytes in 617 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:35:01.144680 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ddaaeb-3e0a-4d86-bfd9-fbbfed429ca1 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:01.146568 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-9ae0a2dd-0a35-4240-a4b6-c3843fde45c5 None None] MFA Rules not processed for user `0834256bdfbc48ffbc5af6d6760ecdd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:01.147751 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-9ae0a2dd-0a35-4240-a4b6-c3843fde45c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:01.150068 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-32ddaaeb-3e0a-4d86-bfd9-fbbfed429ca1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:01.182083 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ddaaeb-3e0a-4d86-bfd9-fbbfed429ca1 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:01.196609 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebf82e2-163d-4169-bc0d-40284da75cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:01.197677 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf82e2-163d-4169-bc0d-40284da75cbd admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:01.199115 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf82e2-163d-4169-bc0d-40284da75cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:01.200286 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf82e2-163d-4169-bc0d-40284da75cbd admin admin] PATH_INFO: `/v3/projects/016b0d91d0a5492fb9f274633a6d720a/users/5753d5252e2b4bb6b4150bd6e6c978e6/roles/6cb03785fb184ef587509b3174622f69` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:01.207768 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebf82e2-163d-4169-bc0d-40284da75cbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=016b0d91d0a5492fb9f274633a6d720a, user_id=5753d5252e2b4bb6b4150bd6e6c978e6, role_id=6cb03785fb184ef587509b3174622f69)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:01.217019 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebf82e2-163d-4169-bc0d-40284da75cbd admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:01.261309 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 861/1701] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:35:01 2022] PUT /identity/v3/projects/016b0d91d0a5492fb9f274633a6d720a/users/5753d5252e2b4bb6b4150bd6e6c978e6/roles/6cb03785fb184ef587509b3174622f69 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:01.275425 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac1bbc-0a31-4f42-aa5e-0bc0cc6f2e52 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:01.276162 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac1bbc-0a31-4f42-aa5e-0bc0cc6f2e52 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:01.276271 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac1bbc-0a31-4f42-aa5e-0bc0cc6f2e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:01.324022 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-2aac1bbc-0a31-4f42-aa5e-0bc0cc6f2e52 None None] MFA Rules not processed for user `5753d5252e2b4bb6b4150bd6e6c978e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:01.325697 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-2aac1bbc-0a31-4f42-aa5e-0bc0cc6f2e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:01.365395 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 841/1702] 10.222.0.26 () {58 vars in 1009 bytes} [Fri Jul 1 19:35:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:35:01.366293 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae0a2dd-0a35-4240-a4b6-c3843fde45c5 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:01.375490 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-9ae0a2dd-0a35-4240-a4b6-c3843fde45c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:01.463906 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:01.510144 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:01.618004 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae0a2dd-0a35-4240-a4b6-c3843fde45c5 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:01.643031 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 862/1703] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:01 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:35:01.647345 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aac1bbc-0a31-4f42-aa5e-0bc0cc6f2e52 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:01.652131 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-2aac1bbc-0a31-4f42-aa5e-0bc0cc6f2e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:01.774468 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595885fb-4dab-44d8-a5eb-48f7eb1c0290 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:01.775391 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595885fb-4dab-44d8-a5eb-48f7eb1c0290 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:01.775828 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595885fb-4dab-44d8-a5eb-48f7eb1c0290 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:01.776248 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595885fb-4dab-44d8-a5eb-48f7eb1c0290 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:01.835247 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aac1bbc-0a31-4f42-aa5e-0bc0cc6f2e52 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:01.849561 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b114e40-4f3f-44b6-a465-2149f75231a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a3ed285ee4c4d04abf7daf0aeb9fb7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:01.850245 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b114e40-4f3f-44b6-a465-2149f75231a0 service cinder] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:01.850527 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b114e40-4f3f-44b6-a465-2149f75231a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:01.850802 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b114e40-4f3f-44b6-a465-2149f75231a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:01.876902 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b114e40-4f3f-44b6-a465-2149f75231a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:01.877469 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595885fb-4dab-44d8-a5eb-48f7eb1c0290 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:01.878461 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b114e40-4f3f-44b6-a465-2149f75231a0 service cinder] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:01.879851 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595885fb-4dab-44d8-a5eb-48f7eb1c0290 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:01.895659 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 842/1704] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:35:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:35:01.896768 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595885fb-4dab-44d8-a5eb-48f7eb1c0290 service neutron] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:01.898934 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-595885fb-4dab-44d8-a5eb-48f7eb1c0290 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:01.913376 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 863/1705] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:35:01 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:35:01.978865 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a58af-0ba6-47b4-bc9b-36c886c43641 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:01.979160 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a58af-0ba6-47b4-bc9b-36c886c43641 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:01.979744 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a58af-0ba6-47b4-bc9b-36c886c43641 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:01.981260 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 864/1706] 10.222.0.26 () {54 vars in 921 bytes} [Fri Jul 1 19:35:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 19:35:02.001443 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab663b-fc4f-4d3c-baf4-535ed6b82822 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:02.001731 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab663b-fc4f-4d3c-baf4-535ed6b82822 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:02.002009 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab663b-fc4f-4d3c-baf4-535ed6b82822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:02.070317 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-7aab663b-fc4f-4d3c-baf4-535ed6b82822 None None] MFA Rules not processed for user `941e65d95bcd4e66a6489280520c12de`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:02.071573 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-7aab663b-fc4f-4d3c-baf4-535ed6b82822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:02.072885 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595885fb-4dab-44d8-a5eb-48f7eb1c0290 service neutron] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:02.107979 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f964f59a-4601-45c6-b1d0-edb50298baba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e958c5b03a9346d59c32675c5271bf3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:02.110411 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964f59a-4601-45c6-b1d0-edb50298baba service swift] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:02.112458 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964f59a-4601-45c6-b1d0-edb50298baba service swift] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:02.114866 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964f59a-4601-45c6-b1d0-edb50298baba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:02.222128 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:02.271418 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 865/1707] 10.222.0.26 () {58 vars in 1018 bytes} [Fri Jul 1 19:35:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:35:02.304385 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aab663b-fc4f-4d3c-baf4-535ed6b82822 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:02.304600 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f964f59a-4601-45c6-b1d0-edb50298baba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:02.306952 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-7aab663b-fc4f-4d3c-baf4-535ed6b82822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:02.307338 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f964f59a-4601-45c6-b1d0-edb50298baba service swift] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:02.335791 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aab663b-fc4f-4d3c-baf4-535ed6b82822 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:02.336748 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 843/1708] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Jul 1 19:35:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 01 19:35:02.355210 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41df6e76-dd2e-4461-96e3-dfac0fca5282 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '941e65d95bcd4e66a6489280520c12de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:02.355888 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df6e76-dd2e-4461-96e3-dfac0fca5282 service placement] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:02.356723 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df6e76-dd2e-4461-96e3-dfac0fca5282 service placement] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:02.357040 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df6e76-dd2e-4461-96e3-dfac0fca5282 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:02.372089 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41df6e76-dd2e-4461-96e3-dfac0fca5282 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:02.376712 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41df6e76-dd2e-4461-96e3-dfac0fca5282 service placement] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:02.404120 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 866/1709] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:35:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 19:35:02.689598 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f964f59a-4601-45c6-b1d0-edb50298baba service swift] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:02.692316 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-f964f59a-4601-45c6-b1d0-edb50298baba service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:02.719870 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f964f59a-4601-45c6-b1d0-edb50298baba service swift] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:02.733346 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53723ef7-5150-41d0-b040-50becdc4b4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:02.734667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53723ef7-5150-41d0-b040-50becdc4b4af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:02.736067 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53723ef7-5150-41d0-b040-50becdc4b4af admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:02.737205 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53723ef7-5150-41d0-b040-50becdc4b4af admin admin] PATH_INFO: `/v3/users/29d53f2465154bf88fa83f1a8db3f1dd` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:02.739354 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53723ef7-5150-41d0-b040-50becdc4b4af admin admin] RBAC: Authorizing `identity:delete_user(user_id=29d53f2465154bf88fa83f1a8db3f1dd)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:02.746159 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53723ef7-5150-41d0-b040-50becdc4b4af admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:02.892177 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-53723ef7-5150-41d0-b040-50becdc4b4af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29d53f2465154bf88fa83f1a8db3f1dd'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:02.893512 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-53723ef7-5150-41d0-b040-50becdc4b4af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29d53f2465154bf88fa83f1a8db3f1dd'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:02.934101 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-53723ef7-5150-41d0-b040-50becdc4b4af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29d53f2465154bf88fa83f1a8db3f1dd'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:02.961392 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-53723ef7-5150-41d0-b040-50becdc4b4af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29d53f2465154bf88fa83f1a8db3f1dd'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:02.962604 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-53723ef7-5150-41d0-b040-50becdc4b4af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29d53f2465154bf88fa83f1a8db3f1dd'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:03.023118 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 844/1710] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:35:02 2022] DELETE /identity/v3/users/29d53f2465154bf88fa83f1a8db3f1dd => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:03.028547 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea03eb-6e6a-426e-abdf-e543a0bf255a None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:03.029053 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea03eb-6e6a-426e-abdf-e543a0bf255a None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:03.029149 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea03eb-6e6a-426e-abdf-e543a0bf255a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:03.079839 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-eaea03eb-6e6a-426e-abdf-e543a0bf255a None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:03.081141 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-eaea03eb-6e6a-426e-abdf-e543a0bf255a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:03.269379 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53723ef7-5150-41d0-b040-50becdc4b4af admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:03.271103 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-53723ef7-5150-41d0-b040-50becdc4b4af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:03.320829 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:03.403233 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 867/1711] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:35:03.486617 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea03eb-6e6a-426e-abdf-e543a0bf255a None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:03.489387 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-eaea03eb-6e6a-426e-abdf-e543a0bf255a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:03.530447 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53723ef7-5150-41d0-b040-50becdc4b4af admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:03.545471 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd33d8b-8cd1-488c-8921-67abd095baaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:03.546911 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd33d8b-8cd1-488c-8921-67abd095baaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:03.547202 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd33d8b-8cd1-488c-8921-67abd095baaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:03.548111 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd33d8b-8cd1-488c-8921-67abd095baaf admin admin] PATH_INFO: `/v3/projects/0abd48c545f04b649911b0cc552976b5` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:03.550117 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd33d8b-8cd1-488c-8921-67abd095baaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=0abd48c545f04b649911b0cc552976b5)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:03.553185 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd33d8b-8cd1-488c-8921-67abd095baaf admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:03.658557 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea03eb-6e6a-426e-abdf-e543a0bf255a None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:03.698732 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:03.714909 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-2bd33d8b-8cd1-488c-8921-67abd095baaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0abd48c545f04b649911b0cc552976b5', 'request_id': 'req-2bd33d8b-8cd1-488c-8921-67abd095baaf'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:03.744444 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-2bd33d8b-8cd1-488c-8921-67abd095baaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0abd48c545f04b649911b0cc552976b5', 'request_id': 'req-2bd33d8b-8cd1-488c-8921-67abd095baaf'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:03.775215 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-2bd33d8b-8cd1-488c-8921-67abd095baaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0abd48c545f04b649911b0cc552976b5', 'request_id': 'req-2bd33d8b-8cd1-488c-8921-67abd095baaf'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:03.806035 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-2bd33d8b-8cd1-488c-8921-67abd095baaf admin admin] The token cache is being invalidate because project 0abd48c545f04b649911b0cc552976b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:35:03.806572 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-2bd33d8b-8cd1-488c-8921-67abd095baaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:03.807416 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-2bd33d8b-8cd1-488c-8921-67abd095baaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:03.817651 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 845/1712] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:35:03 2022] DELETE /identity/v3/projects/0abd48c545f04b649911b0cc552976b5 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 19:35:03.819093 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd33d8b-8cd1-488c-8921-67abd095baaf admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:03.821199 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-2bd33d8b-8cd1-488c-8921-67abd095baaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:03.881174 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac404d-5886-4d23-88c4-3e1964a2f725 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a3ed285ee4c4d04abf7daf0aeb9fb7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:03.882330 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac404d-5886-4d23-88c4-3e1964a2f725 service cinder] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:03.882846 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac404d-5886-4d23-88c4-3e1964a2f725 service cinder] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:03.883277 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac404d-5886-4d23-88c4-3e1964a2f725 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:03.909730 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-37ac404d-5886-4d23-88c4-3e1964a2f725 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:04.027398 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd33d8b-8cd1-488c-8921-67abd095baaf admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:04.034806 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef27c51f-7f27-4179-8192-064f28af91ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:04.036608 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef27c51f-7f27-4179-8192-064f28af91ac service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:04.037396 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef27c51f-7f27-4179-8192-064f28af91ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:04.038147 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef27c51f-7f27-4179-8192-064f28af91ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:04.041421 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-ef27c51f-7f27-4179-8192-064f28af91ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:04.088550 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ac404d-5886-4d23-88c4-3e1964a2f725 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:04.090187 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ac404d-5886-4d23-88c4-3e1964a2f725 service cinder] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:04.116019 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 868/1713] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:35:03 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 631 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 19:35:04.117949 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5683dc9-2e33-4c5c-8846-4eb0c163a60f None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:04.120167 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5683dc9-2e33-4c5c-8846-4eb0c163a60f None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:04.120690 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5683dc9-2e33-4c5c-8846-4eb0c163a60f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:04.172722 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-e5683dc9-2e33-4c5c-8846-4eb0c163a60f None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:04.174273 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-e5683dc9-2e33-4c5c-8846-4eb0c163a60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:04.313870 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef27c51f-7f27-4179-8192-064f28af91ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:04.315399 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef27c51f-7f27-4179-8192-064f28af91ac service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:04.366942 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 869/1714] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:35:04.374619 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da4b7c-8b6d-463a-bacb-8d7768c7fa0a None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:04.374619 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da4b7c-8b6d-463a-bacb-8d7768c7fa0a None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:04.374619 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da4b7c-8b6d-463a-bacb-8d7768c7fa0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:04.398889 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:04.420439 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 846/1715] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:35:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 602 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:35:04.434213 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-c0da4b7c-8b6d-463a-bacb-8d7768c7fa0a None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:04.435695 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-c0da4b7c-8b6d-463a-bacb-8d7768c7fa0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:04.466274 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 870/1716] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:35:04.470477 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef27c51f-7f27-4179-8192-064f28af91ac service neutron] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:04.523204 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef27c51f-7f27-4179-8192-064f28af91ac service neutron] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:04.540460 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b566f7bb-2a9a-43bc-897a-40fd7606e201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:04.545328 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b566f7bb-2a9a-43bc-897a-40fd7606e201 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:04.545683 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b566f7bb-2a9a-43bc-897a-40fd7606e201 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:04.546481 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b566f7bb-2a9a-43bc-897a-40fd7606e201 admin admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:04.547249 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b566f7bb-2a9a-43bc-897a-40fd7606e201 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:35:04.547569 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b566f7bb-2a9a-43bc-897a-40fd7606e201 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:04.549313 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b566f7bb-2a9a-43bc-897a-40fd7606e201 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:04.622111 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 847/1717] 10.222.0.26 () {58 vars in 1152 bytes} [Fri Jul 1 19:35:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:35:04.626576 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0da4b7c-8b6d-463a-bacb-8d7768c7fa0a None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:04.653984 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0da4b7c-8b6d-463a-bacb-8d7768c7fa0a None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:04.677353 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee1f2f2-e3d2-4ec0-86be-7aabf6b8f8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:04.680801 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee1f2f2-e3d2-4ec0-86be-7aabf6b8f8bb admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:04.681543 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee1f2f2-e3d2-4ec0-86be-7aabf6b8f8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:04.682531 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b566f7bb-2a9a-43bc-897a-40fd7606e201 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:04.685303 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-b566f7bb-2a9a-43bc-897a-40fd7606e201 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:04.687318 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee1f2f2-e3d2-4ec0-86be-7aabf6b8f8bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:04.689954 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee1f2f2-e3d2-4ec0-86be-7aabf6b8f8bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:04.700038 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee1f2f2-e3d2-4ec0-86be-7aabf6b8f8bb admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:04.732924 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b566f7bb-2a9a-43bc-897a-40fd7606e201 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:04.780839 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76802716-8153-4702-85ae-b468d7dcdef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:04.781882 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76802716-8153-4702-85ae-b468d7dcdef5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:04.782177 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76802716-8153-4702-85ae-b468d7dcdef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:04.794512 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76802716-8153-4702-85ae-b468d7dcdef5 admin admin] PATH_INFO: `/v3/projects/e9a181b474204a1689e14a188e55d297` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:04.805428 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76802716-8153-4702-85ae-b468d7dcdef5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9a181b474204a1689e14a188e55d297)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:04.812691 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 871/1718] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:35:04 2022] POST /identity/v3/projects => generated 371 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:35:04.816202 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee1f2f2-e3d2-4ec0-86be-7aabf6b8f8bb admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:04.821035 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76802716-8153-4702-85ae-b468d7dcdef5 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:04.973528 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee1f2f2-e3d2-4ec0-86be-7aabf6b8f8bb admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:04.989183 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575ed25f-e8e3-4b31-b1aa-b266b03d59fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:04.989801 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ed25f-e8e3-4b31-b1aa-b266b03d59fd admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:04.990092 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ed25f-e8e3-4b31-b1aa-b266b03d59fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:04.990371 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ed25f-e8e3-4b31-b1aa-b266b03d59fd admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:04.991094 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575ed25f-e8e3-4b31-b1aa-b266b03d59fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:04.993291 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575ed25f-e8e3-4b31-b1aa-b266b03d59fd admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:05.064115 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 872/1719] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:35:04 2022] POST /identity/v3/users => generated 286 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:35:05.065717 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575ed25f-e8e3-4b31-b1aa-b266b03d59fd admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:05.070451 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-76802716-8153-4702-85ae-b468d7dcdef5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9a181b474204a1689e14a188e55d297', 'request_id': 'req-76802716-8153-4702-85ae-b468d7dcdef5'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:05.089780 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-76802716-8153-4702-85ae-b468d7dcdef5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9a181b474204a1689e14a188e55d297', 'request_id': 'req-76802716-8153-4702-85ae-b468d7dcdef5'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:05.097082 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575ed25f-e8e3-4b31-b1aa-b266b03d59fd admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:05.122192 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-76802716-8153-4702-85ae-b468d7dcdef5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9a181b474204a1689e14a188e55d297', 'request_id': 'req-76802716-8153-4702-85ae-b468d7dcdef5'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:05.124690 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:05.151391 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-76802716-8153-4702-85ae-b468d7dcdef5 admin admin] The token cache is being invalidate because project e9a181b474204a1689e14a188e55d297 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:35:05.151701 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-76802716-8153-4702-85ae-b468d7dcdef5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:05.153117 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-76802716-8153-4702-85ae-b468d7dcdef5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:05.161993 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 848/1720] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:35:04 2022] DELETE /identity/v3/projects/e9a181b474204a1689e14a188e55d297 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:05.166513 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76802716-8153-4702-85ae-b468d7dcdef5 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:05.169999 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-76802716-8153-4702-85ae-b468d7dcdef5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:05.299374 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999b331f-5b24-432b-88fd-8464861de85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:05.300233 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b331f-5b24-432b-88fd-8464861de85c admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:05.300629 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b331f-5b24-432b-88fd-8464861de85c admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:05.301019 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b331f-5b24-432b-88fd-8464861de85c admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:05.302016 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999b331f-5b24-432b-88fd-8464861de85c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:05.304222 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999b331f-5b24-432b-88fd-8464861de85c admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:05.335202 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 873/1721] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:35:05 2022] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:35:05.337957 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999b331f-5b24-432b-88fd-8464861de85c admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:05.342488 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-999b331f-5b24-432b-88fd-8464861de85c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:05.371997 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999b331f-5b24-432b-88fd-8464861de85c admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:05.387026 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c9899-3df5-4376-80ab-84d6cf15f3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:05.389325 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c9899-3df5-4376-80ab-84d6cf15f3fd admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:05.390160 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c9899-3df5-4376-80ab-84d6cf15f3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:05.390160 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c9899-3df5-4376-80ab-84d6cf15f3fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:05.395184 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451c9899-3df5-4376-80ab-84d6cf15f3fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:05.397480 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451c9899-3df5-4376-80ab-84d6cf15f3fd admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:05.433498 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 874/1722] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:35:05 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:35:05.434666 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c9899-3df5-4376-80ab-84d6cf15f3fd admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:05.437370 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-451c9899-3df5-4376-80ab-84d6cf15f3fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:05.448699 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76802716-8153-4702-85ae-b468d7dcdef5 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:05.463387 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3591ee83-03ce-4400-9461-95d39db0e4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:05.464436 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591ee83-03ce-4400-9461-95d39db0e4c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:05.466129 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591ee83-03ce-4400-9461-95d39db0e4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:05.466418 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591ee83-03ce-4400-9461-95d39db0e4c8 admin admin] PATH_INFO: `/v3/users/fdb5191dc33d4c6f81be335a0aec2dd8` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:05.471194 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3591ee83-03ce-4400-9461-95d39db0e4c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdb5191dc33d4c6f81be335a0aec2dd8)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:05.482780 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3591ee83-03ce-4400-9461-95d39db0e4c8 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:05.491087 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c9899-3df5-4376-80ab-84d6cf15f3fd admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:05.497638 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf1f5e0-4b28-48cc-beac-87840773ef1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:05.498962 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf1f5e0-4b28-48cc-beac-87840773ef1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:05.499494 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf1f5e0-4b28-48cc-beac-87840773ef1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:05.500016 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf1f5e0-4b28-48cc-beac-87840773ef1a admin admin] PATH_INFO: `/v3/users/aa0c30545c904818b49b703055af87fd` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:05.501856 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf1f5e0-4b28-48cc-beac-87840773ef1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa0c30545c904818b49b703055af87fd)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:05.504561 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf1f5e0-4b28-48cc-beac-87840773ef1a admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:05.592199 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:05.595228 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-1cf1f5e0-4b28-48cc-beac-87840773ef1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa0c30545c904818b49b703055af87fd'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:05.595884 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-1cf1f5e0-4b28-48cc-beac-87840773ef1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa0c30545c904818b49b703055af87fd'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:05.620432 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-1cf1f5e0-4b28-48cc-beac-87840773ef1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa0c30545c904818b49b703055af87fd'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:05.630450 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-1cf1f5e0-4b28-48cc-beac-87840773ef1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa0c30545c904818b49b703055af87fd'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:05.660108 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-1cf1f5e0-4b28-48cc-beac-87840773ef1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa0c30545c904818b49b703055af87fd'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:05.699235 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 875/1723] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:35:05 2022] DELETE /identity/v3/users/aa0c30545c904818b49b703055af87fd => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:05.701587 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf1f5e0-4b28-48cc-beac-87840773ef1a admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:05.704447 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-1cf1f5e0-4b28-48cc-beac-87840773ef1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:05.712738 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-3591ee83-03ce-4400-9461-95d39db0e4c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdb5191dc33d4c6f81be335a0aec2dd8'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:05.717134 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-3591ee83-03ce-4400-9461-95d39db0e4c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdb5191dc33d4c6f81be335a0aec2dd8'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:05.742652 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-3591ee83-03ce-4400-9461-95d39db0e4c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdb5191dc33d4c6f81be335a0aec2dd8'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:05.768295 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-3591ee83-03ce-4400-9461-95d39db0e4c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdb5191dc33d4c6f81be335a0aec2dd8'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:05.769844 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-3591ee83-03ce-4400-9461-95d39db0e4c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdb5191dc33d4c6f81be335a0aec2dd8'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:05.869297 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 849/1724] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:35:05 2022] DELETE /identity/v3/users/fdb5191dc33d4c6f81be335a0aec2dd8 => generated 0 bytes in 703 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:05.878239 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01104a6-c7cb-4d3d-80a5-81982193a5c0 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:05.878885 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01104a6-c7cb-4d3d-80a5-81982193a5c0 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:05.882331 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01104a6-c7cb-4d3d-80a5-81982193a5c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:05.990433 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-c01104a6-c7cb-4d3d-80a5-81982193a5c0 None None] MFA Rules not processed for user `75b8c92fd65a49e493373b4a13c18290`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:05.993701 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf1f5e0-4b28-48cc-beac-87840773ef1a admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:05.995323 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-c01104a6-c7cb-4d3d-80a5-81982193a5c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:06.372994 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b8a0c2-8b45-4a88-881e-b2dcb08a8e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:06.380481 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8a0c2-8b45-4a88-881e-b2dcb08a8e1a admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:06.383489 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8a0c2-8b45-4a88-881e-b2dcb08a8e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:06.387369 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8a0c2-8b45-4a88-881e-b2dcb08a8e1a admin admin] PATH_INFO: `/v3/projects/d881978a82424b5e9195cf1e6e81eaa4/users/62dabefe9d844b2fbf4bb51d83ce8075/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:06.422648 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:06.432500 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 850/1725] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:05 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 563 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:35:06.455593 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01104a6-c7cb-4d3d-80a5-81982193a5c0 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:06.458028 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-c01104a6-c7cb-4d3d-80a5-81982193a5c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:06.470861 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b8a0c2-8b45-4a88-881e-b2dcb08a8e1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d881978a82424b5e9195cf1e6e81eaa4, user_id=62dabefe9d844b2fbf4bb51d83ce8075, role_id=4cbf6ec846eb4b7c8cc52e9bfd6f076f)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:06.518873 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b8a0c2-8b45-4a88-881e-b2dcb08a8e1a admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:06.630465 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 876/1726] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:35:05 2022] PUT /identity/v3/projects/d881978a82424b5e9195cf1e6e81eaa4/users/62dabefe9d844b2fbf4bb51d83ce8075/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 0 bytes in 917 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:06.642605 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085597d9-f342-466c-b717-b0ad07e776b6 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:06.643869 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085597d9-f342-466c-b717-b0ad07e776b6 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:06.644173 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085597d9-f342-466c-b717-b0ad07e776b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:06.837546 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-085597d9-f342-466c-b717-b0ad07e776b6 None None] MFA Rules not processed for user `62dabefe9d844b2fbf4bb51d83ce8075`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:06.847963 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-085597d9-f342-466c-b717-b0ad07e776b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:06.888631 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01104a6-c7cb-4d3d-80a5-81982193a5c0 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:07.135215 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:07.164705 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa19f5c8-86e1-43b2-a07a-50b1d41afc77 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13fd76fc7dd1410b9cde5adbaa6cb2e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:07.173030 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19f5c8-86e1-43b2-a07a-50b1d41afc77 service nova] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:07.173293 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19f5c8-86e1-43b2-a07a-50b1d41afc77 service nova] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:07.173793 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19f5c8-86e1-43b2-a07a-50b1d41afc77 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:07.265031 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 877/1727] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 629 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:35:07.269841 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085597d9-f342-466c-b717-b0ad07e776b6 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:07.274309 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-085597d9-f342-466c-b717-b0ad07e776b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:07.431938 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa19f5c8-86e1-43b2-a07a-50b1d41afc77 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:07.437929 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa19f5c8-86e1-43b2-a07a-50b1d41afc77 service nova] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:07.481668 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 851/1728] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:35:06 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 1026 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 19:35:07.555282 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085597d9-f342-466c-b717-b0ad07e776b6 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:07.582564 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bbdba5-869e-43c3-9854-68d567915fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:07.584110 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbdba5-869e-43c3-9854-68d567915fd3 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:07.584728 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbdba5-869e-43c3-9854-68d567915fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:07.585223 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbdba5-869e-43c3-9854-68d567915fd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:07.586228 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bbdba5-869e-43c3-9854-68d567915fd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:07.588782 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bbdba5-869e-43c3-9854-68d567915fd3 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:07.684210 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 878/1729] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:35:07 2022] POST /identity/v3/projects => generated 373 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:35:07.688633 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa19f5c8-86e1-43b2-a07a-50b1d41afc77 service nova] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:07.704832 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa19f5c8-86e1-43b2-a07a-50b1d41afc77 service nova] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:07.837459 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:07.917563 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f6c8e9-9a94-46e0-8078-690f49c6608a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:07.923135 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6c8e9-9a94-46e0-8078-690f49c6608a admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:07.923580 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6c8e9-9a94-46e0-8078-690f49c6608a admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:07.923940 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6c8e9-9a94-46e0-8078-690f49c6608a admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:07.927120 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f6c8e9-9a94-46e0-8078-690f49c6608a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:07.944066 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f6c8e9-9a94-46e0-8078-690f49c6608a admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:08.015515 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 852/1730] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:35:07 2022] POST /identity/v3/users => generated 293 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:35:08.021016 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bbdba5-869e-43c3-9854-68d567915fd3 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:08.039495 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bbdba5-869e-43c3-9854-68d567915fd3 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:08.051742 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc8f216-0628-4a67-8927-825f905c89b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:08.053481 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8f216-0628-4a67-8927-825f905c89b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:08.054088 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8f216-0628-4a67-8927-825f905c89b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:08.054535 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8f216-0628-4a67-8927-825f905c89b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:08.055451 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc8f216-0628-4a67-8927-825f905c89b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:08.057290 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc8f216-0628-4a67-8927-825f905c89b3 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:08.141125 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 879/1731] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:35:08 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:35:08.144977 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f6c8e9-9a94-46e0-8078-690f49c6608a admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:08.163829 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f6c8e9-9a94-46e0-8078-690f49c6608a admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:08.171062 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f949653-3723-4e78-a03d-89af30030865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:08.172131 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f949653-3723-4e78-a03d-89af30030865 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:08.172795 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f949653-3723-4e78-a03d-89af30030865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:08.173382 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f949653-3723-4e78-a03d-89af30030865 admin admin] PATH_INFO: `/v3/projects/11359997acc8462fa5024bf0bc8778a2/users/3ef185f0c28b40eebf3a48a657faea0d/roles/6cb03785fb184ef587509b3174622f69` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:08.242884 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f949653-3723-4e78-a03d-89af30030865 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11359997acc8462fa5024bf0bc8778a2, user_id=3ef185f0c28b40eebf3a48a657faea0d, role_id=6cb03785fb184ef587509b3174622f69)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:08.259157 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f949653-3723-4e78-a03d-89af30030865 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:08.314554 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 853/1732] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:35:08 2022] PUT /identity/v3/projects/11359997acc8462fa5024bf0bc8778a2/users/3ef185f0c28b40eebf3a48a657faea0d/roles/6cb03785fb184ef587509b3174622f69 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:08.316640 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc8f216-0628-4a67-8927-825f905c89b3 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:08.342317 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc8f216-0628-4a67-8927-825f905c89b3 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:08.382064 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117936c9-e041-4ce4-8b8f-546b61116b7a None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:08.383276 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117936c9-e041-4ce4-8b8f-546b61116b7a None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:08.383633 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117936c9-e041-4ce4-8b8f-546b61116b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:08.458670 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-117936c9-e041-4ce4-8b8f-546b61116b7a None None] MFA Rules not processed for user `4557d17438a249ee8f75927449a1a059`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:08.465175 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-117936c9-e041-4ce4-8b8f-546b61116b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:08.713789 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb84053-6fbf-42a8-8f6c-1bbb4aaa54d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:08.719524 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb84053-6fbf-42a8-8f6c-1bbb4aaa54d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:08.721626 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb84053-6fbf-42a8-8f6c-1bbb4aaa54d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:08.722169 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb84053-6fbf-42a8-8f6c-1bbb4aaa54d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:08.723173 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb84053-6fbf-42a8-8f6c-1bbb4aaa54d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:08.729667 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb84053-6fbf-42a8-8f6c-1bbb4aaa54d8 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:08.754634 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 880/1733] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:35:08 2022] GET /identity/v3/roles => generated 1420 bytes in 439 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:35:08.758090 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb84053-6fbf-42a8-8f6c-1bbb4aaa54d8 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:08.762878 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-4bb84053-6fbf-42a8-8f6c-1bbb4aaa54d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:08.823518 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 854/1734] 10.222.0.55 () {58 vars in 1015 bytes} [Fri Jul 1 19:35:08 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 443 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:35:08.824695 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117936c9-e041-4ce4-8b8f-546b61116b7a None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:08.854208 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb84053-6fbf-42a8-8f6c-1bbb4aaa54d8 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:08.880981 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad73fe0d-15f5-400e-90b1-34ceb7731017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:08.886284 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad73fe0d-15f5-400e-90b1-34ceb7731017 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:08.888392 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad73fe0d-15f5-400e-90b1-34ceb7731017 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:08.890112 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad73fe0d-15f5-400e-90b1-34ceb7731017 admin admin] PATH_INFO: `/v3/projects/a4ce567296d446f3887803e1d5dff1f5` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:08.902779 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad73fe0d-15f5-400e-90b1-34ceb7731017 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4ce567296d446f3887803e1d5dff1f5)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:08.906232 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117936c9-e041-4ce4-8b8f-546b61116b7a None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:08.908948 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad73fe0d-15f5-400e-90b1-34ceb7731017 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:08.922554 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db73e4a-6079-4b91-8814-5081f057c34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:08.924217 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db73e4a-6079-4b91-8814-5081f057c34e admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:08.924697 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db73e4a-6079-4b91-8814-5081f057c34e admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:08.925129 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db73e4a-6079-4b91-8814-5081f057c34e admin admin] PATH_INFO: `/v3/projects/11359997acc8462fa5024bf0bc8778a2/users/3ef185f0c28b40eebf3a48a657faea0d/roles/6cb03785fb184ef587509b3174622f69` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:08.930825 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db73e4a-6079-4b91-8814-5081f057c34e admin admin] RBAC: Authorizing `identity:create_grant(project_id=11359997acc8462fa5024bf0bc8778a2, user_id=3ef185f0c28b40eebf3a48a657faea0d, role_id=6cb03785fb184ef587509b3174622f69)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:08.934181 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db73e4a-6079-4b91-8814-5081f057c34e admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:09.028246 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 855/1735] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:35:08 2022] PUT /identity/v3/projects/11359997acc8462fa5024bf0bc8778a2/users/3ef185f0c28b40eebf3a48a657faea0d/roles/6cb03785fb184ef587509b3174622f69 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:09.029438 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db73e4a-6079-4b91-8814-5081f057c34e admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:09.037949 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-7db73e4a-6079-4b91-8814-5081f057c34e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:09.116100 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:09.128050 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-ad73fe0d-15f5-400e-90b1-34ceb7731017 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4ce567296d446f3887803e1d5dff1f5', 'request_id': 'req-ad73fe0d-15f5-400e-90b1-34ceb7731017'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:09.163459 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-ad73fe0d-15f5-400e-90b1-34ceb7731017 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4ce567296d446f3887803e1d5dff1f5', 'request_id': 'req-ad73fe0d-15f5-400e-90b1-34ceb7731017'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:09.196042 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-ad73fe0d-15f5-400e-90b1-34ceb7731017 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4ce567296d446f3887803e1d5dff1f5', 'request_id': 'req-ad73fe0d-15f5-400e-90b1-34ceb7731017'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:09.244045 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-ad73fe0d-15f5-400e-90b1-34ceb7731017 admin admin] The token cache is being invalidate because project a4ce567296d446f3887803e1d5dff1f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:35:09.244593 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-ad73fe0d-15f5-400e-90b1-34ceb7731017 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:09.246827 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-ad73fe0d-15f5-400e-90b1-34ceb7731017 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:09.258517 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 881/1736] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:35:08 2022] DELETE /identity/v3/projects/a4ce567296d446f3887803e1d5dff1f5 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:09.261478 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5462c6cc-1efe-4a5f-8547-91304150bb10 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:09.261929 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5462c6cc-1efe-4a5f-8547-91304150bb10 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:09.262331 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5462c6cc-1efe-4a5f-8547-91304150bb10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:09.288123 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db73e4a-6079-4b91-8814-5081f057c34e admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:09.394319 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-5462c6cc-1efe-4a5f-8547-91304150bb10 None None] MFA Rules not processed for user `3ef185f0c28b40eebf3a48a657faea0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:09.395584 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-5462c6cc-1efe-4a5f-8547-91304150bb10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:09.435674 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a966a7-fade-437d-a7a0-e76e4ee08608 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:09.437084 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a966a7-fade-437d-a7a0-e76e4ee08608 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:09.437675 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a966a7-fade-437d-a7a0-e76e4ee08608 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:09.438531 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a966a7-fade-437d-a7a0-e76e4ee08608 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:09.440903 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-85a966a7-fade-437d-a7a0-e76e4ee08608 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:09.470677 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:09.473788 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a966a7-fade-437d-a7a0-e76e4ee08608 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:09.475708 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a966a7-fade-437d-a7a0-e76e4ee08608 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:09.491432 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 856/1737] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:35:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:35:09.492533 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a966a7-fade-437d-a7a0-e76e4ee08608 service neutron] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:09.507205 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-85a966a7-fade-437d-a7a0-e76e4ee08608 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:09.702160 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 882/1738] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:09 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 438 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:35:09.714076 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5462c6cc-1efe-4a5f-8547-91304150bb10 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:09.724373 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-5462c6cc-1efe-4a5f-8547-91304150bb10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:09.825830 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a966a7-fade-437d-a7a0-e76e4ee08608 service neutron] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:09.854221 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662c7b98-bf20-4ae1-bfd8-027af60488d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:09.855373 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c7b98-bf20-4ae1-bfd8-027af60488d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:09.855863 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c7b98-bf20-4ae1-bfd8-027af60488d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:09.856356 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c7b98-bf20-4ae1-bfd8-027af60488d6 admin admin] PATH_INFO: `/v3/users/9c85481cba37402480fa4552dbb48107` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:09.862151 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662c7b98-bf20-4ae1-bfd8-027af60488d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c85481cba37402480fa4552dbb48107)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:09.868742 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662c7b98-bf20-4ae1-bfd8-027af60488d6 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:09.967009 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5462c6cc-1efe-4a5f-8547-91304150bb10 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:09.977628 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492f11cd-acef-4867-9ea5-6cbb159e2ca8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a3ed285ee4c4d04abf7daf0aeb9fb7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:09.981372 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492f11cd-acef-4867-9ea5-6cbb159e2ca8 service cinder] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:09.981990 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492f11cd-acef-4867-9ea5-6cbb159e2ca8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:09.983664 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492f11cd-acef-4867-9ea5-6cbb159e2ca8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:10.084202 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492f11cd-acef-4867-9ea5-6cbb159e2ca8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:10.098846 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492f11cd-acef-4867-9ea5-6cbb159e2ca8 service cinder] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:10.129287 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-662c7b98-bf20-4ae1-bfd8-027af60488d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c85481cba37402480fa4552dbb48107'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:10.130353 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-662c7b98-bf20-4ae1-bfd8-027af60488d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c85481cba37402480fa4552dbb48107'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:10.150103 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-662c7b98-bf20-4ae1-bfd8-027af60488d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c85481cba37402480fa4552dbb48107'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:10.171616 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-662c7b98-bf20-4ae1-bfd8-027af60488d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c85481cba37402480fa4552dbb48107'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:10.174297 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-662c7b98-bf20-4ae1-bfd8-027af60488d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c85481cba37402480fa4552dbb48107'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:10.202879 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 883/1739] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:35:09 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:35:10.204409 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492f11cd-acef-4867-9ea5-6cbb159e2ca8 service cinder] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:10.225817 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-492f11cd-acef-4867-9ea5-6cbb159e2ca8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:10.238392 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 857/1740] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:35:09 2022] DELETE /identity/v3/users/9c85481cba37402480fa4552dbb48107 => generated 0 bytes in 746 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:10.251267 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f30eaa4-5e16-428d-a290-0dbdd756ee07 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:10.252165 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f30eaa4-5e16-428d-a290-0dbdd756ee07 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:10.252509 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f30eaa4-5e16-428d-a290-0dbdd756ee07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:10.298097 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492f11cd-acef-4867-9ea5-6cbb159e2ca8 service cinder] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:10.369108 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-3f30eaa4-5e16-428d-a290-0dbdd756ee07 None None] MFA Rules not processed for user `1827b8d35e274416b3f6adbc28691ad6`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:10.378313 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-3f30eaa4-5e16-428d-a290-0dbdd756ee07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:10.615880 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec94519-b531-4e0e-81c4-a0bc906b25b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:10.623614 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec94519-b531-4e0e-81c4-a0bc906b25b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:10.624485 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec94519-b531-4e0e-81c4-a0bc906b25b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:10.626703 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec94519-b531-4e0e-81c4-a0bc906b25b7 admin admin] PATH_INFO: `/v3/projects/85d209c18f714abcb4c9fb70fca4e37f` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:10.640118 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec94519-b531-4e0e-81c4-a0bc906b25b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85d209c18f714abcb4c9fb70fca4e37f)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:10.643558 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec94519-b531-4e0e-81c4-a0bc906b25b7 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:10.653647 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:10.664851 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 858/1741] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 420 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:35:10.664851 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f30eaa4-5e16-428d-a290-0dbdd756ee07 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:10.667814 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-3f30eaa4-5e16-428d-a290-0dbdd756ee07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:10.722862 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:10.731682 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f30eaa4-5e16-428d-a290-0dbdd756ee07 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:10.754948 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe290c92-0d86-4375-8e2c-70794f7b8136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:10.755745 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe290c92-0d86-4375-8e2c-70794f7b8136 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:10.756037 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe290c92-0d86-4375-8e2c-70794f7b8136 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:10.756318 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe290c92-0d86-4375-8e2c-70794f7b8136 admin admin] PATH_INFO: `/v3/projects/9553835a1b4e4b7580add88fb8e51319` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:10.767631 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe290c92-0d86-4375-8e2c-70794f7b8136 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9553835a1b4e4b7580add88fb8e51319)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:10.771400 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe290c92-0d86-4375-8e2c-70794f7b8136 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:10.844293 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-9ec94519-b531-4e0e-81c4-a0bc906b25b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85d209c18f714abcb4c9fb70fca4e37f', 'request_id': 'req-9ec94519-b531-4e0e-81c4-a0bc906b25b7'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:10.855266 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-9ec94519-b531-4e0e-81c4-a0bc906b25b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85d209c18f714abcb4c9fb70fca4e37f', 'request_id': 'req-9ec94519-b531-4e0e-81c4-a0bc906b25b7'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:10.865739 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-9ec94519-b531-4e0e-81c4-a0bc906b25b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85d209c18f714abcb4c9fb70fca4e37f', 'request_id': 'req-9ec94519-b531-4e0e-81c4-a0bc906b25b7'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:10.913337 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-9ec94519-b531-4e0e-81c4-a0bc906b25b7 admin admin] The token cache is being invalidate because project 85d209c18f714abcb4c9fb70fca4e37f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:35:10.913626 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-9ec94519-b531-4e0e-81c4-a0bc906b25b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:10.914880 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-9ec94519-b531-4e0e-81c4-a0bc906b25b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:10.923041 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 884/1742] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:35:10 2022] DELETE /identity/v3/projects/85d209c18f714abcb4c9fb70fca4e37f => generated 0 bytes in 716 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:10.923256 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec94519-b531-4e0e-81c4-a0bc906b25b7 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:10.932848 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-9ec94519-b531-4e0e-81c4-a0bc906b25b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:11.032774 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-fe290c92-0d86-4375-8e2c-70794f7b8136 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9553835a1b4e4b7580add88fb8e51319', 'request_id': 'req-fe290c92-0d86-4375-8e2c-70794f7b8136'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:11.048405 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-fe290c92-0d86-4375-8e2c-70794f7b8136 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9553835a1b4e4b7580add88fb8e51319', 'request_id': 'req-fe290c92-0d86-4375-8e2c-70794f7b8136'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:11.060780 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-fe290c92-0d86-4375-8e2c-70794f7b8136 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9553835a1b4e4b7580add88fb8e51319', 'request_id': 'req-fe290c92-0d86-4375-8e2c-70794f7b8136'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:11.084103 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-fe290c92-0d86-4375-8e2c-70794f7b8136 admin admin] The token cache is being invalidate because project 9553835a1b4e4b7580add88fb8e51319 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:35:11.086213 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-fe290c92-0d86-4375-8e2c-70794f7b8136 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:11.087873 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-fe290c92-0d86-4375-8e2c-70794f7b8136 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:11.093262 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 859/1743] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:35:10 2022] DELETE /identity/v3/projects/9553835a1b4e4b7580add88fb8e51319 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:11.093262 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe290c92-0d86-4375-8e2c-70794f7b8136 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:11.094118 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-fe290c92-0d86-4375-8e2c-70794f7b8136 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:11.184590 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec94519-b531-4e0e-81c4-a0bc906b25b7 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:11.199726 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2103a5-12a7-4f1c-ad88-976a5811493e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a3ed285ee4c4d04abf7daf0aeb9fb7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:11.200416 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2103a5-12a7-4f1c-ad88-976a5811493e service cinder] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:11.201321 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2103a5-12a7-4f1c-ad88-976a5811493e service cinder] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:11.201321 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2103a5-12a7-4f1c-ad88-976a5811493e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:11.206646 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-1e2103a5-12a7-4f1c-ad88-976a5811493e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:11.224285 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe290c92-0d86-4375-8e2c-70794f7b8136 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:11.248300 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f231c2fc-6563-4bce-8557-bbf4b522e02d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a3ed285ee4c4d04abf7daf0aeb9fb7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:11.265958 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f231c2fc-6563-4bce-8557-bbf4b522e02d service cinder] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:11.271540 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f231c2fc-6563-4bce-8557-bbf4b522e02d service cinder] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:11.275280 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f231c2fc-6563-4bce-8557-bbf4b522e02d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:11.289651 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-f231c2fc-6563-4bce-8557-bbf4b522e02d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:11.354639 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2103a5-12a7-4f1c-ad88-976a5811493e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:11.356203 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2103a5-12a7-4f1c-ad88-976a5811493e service cinder] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:11.393138 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 885/1744] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:35:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:35:11.394320 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2103a5-12a7-4f1c-ad88-976a5811493e service cinder] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:11.410191 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-1e2103a5-12a7-4f1c-ad88-976a5811493e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:11.455970 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f231c2fc-6563-4bce-8557-bbf4b522e02d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:11.456722 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f231c2fc-6563-4bce-8557-bbf4b522e02d service cinder] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:11.487378 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 860/1745] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:35:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:35:11.488589 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f231c2fc-6563-4bce-8557-bbf4b522e02d service cinder] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:11.491074 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-f231c2fc-6563-4bce-8557-bbf4b522e02d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:11.587796 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:11.656556 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:11.688469 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f231c2fc-6563-4bce-8557-bbf4b522e02d service cinder] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:11.719284 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8014fbba-4dcc-4ce2-86ef-ede680afd3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:11.723100 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8014fbba-4dcc-4ce2-86ef-ede680afd3fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:11.724048 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8014fbba-4dcc-4ce2-86ef-ede680afd3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:11.727733 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8014fbba-4dcc-4ce2-86ef-ede680afd3fa admin admin] PATH_INFO: `/v3/users/2edaac5f684445f88b613afd46c202c1` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:11.733118 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8014fbba-4dcc-4ce2-86ef-ede680afd3fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=2edaac5f684445f88b613afd46c202c1)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:11.742230 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8014fbba-4dcc-4ce2-86ef-ede680afd3fa admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:11.785470 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2103a5-12a7-4f1c-ad88-976a5811493e service cinder] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:11.811029 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1ae701-d17f-4ccb-8952-63b66fd770e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13fd76fc7dd1410b9cde5adbaa6cb2e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:11.811740 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ae701-d17f-4ccb-8952-63b66fd770e1 service nova] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:11.814692 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ae701-d17f-4ccb-8952-63b66fd770e1 service nova] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:11.823657 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ae701-d17f-4ccb-8952-63b66fd770e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:11.856912 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-6b1ae701-d17f-4ccb-8952-63b66fd770e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:11.981714 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-8014fbba-4dcc-4ce2-86ef-ede680afd3fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2edaac5f684445f88b613afd46c202c1'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:11.986901 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-8014fbba-4dcc-4ce2-86ef-ede680afd3fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2edaac5f684445f88b613afd46c202c1'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:12.021898 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-8014fbba-4dcc-4ce2-86ef-ede680afd3fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2edaac5f684445f88b613afd46c202c1'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:12.072527 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-8014fbba-4dcc-4ce2-86ef-ede680afd3fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2edaac5f684445f88b613afd46c202c1'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:12.073730 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-8014fbba-4dcc-4ce2-86ef-ede680afd3fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2edaac5f684445f88b613afd46c202c1'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:12.100605 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1ae701-d17f-4ccb-8952-63b66fd770e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:12.102769 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1ae701-d17f-4ccb-8952-63b66fd770e1 service nova] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:12.115507 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 886/1746] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:35:11 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 722 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:35:12.117857 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d464491-91c8-4523-bf6b-00b5db7e1344 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:12.118351 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d464491-91c8-4523-bf6b-00b5db7e1344 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:12.125042 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d464491-91c8-4523-bf6b-00b5db7e1344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:12.150930 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 861/1747] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:35:11 2022] DELETE /identity/v3/users/2edaac5f684445f88b613afd46c202c1 => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:12.165346 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-1d464491-91c8-4523-bf6b-00b5db7e1344 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:12.167104 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-1d464491-91c8-4523-bf6b-00b5db7e1344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:12.222433 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8014fbba-4dcc-4ce2-86ef-ede680afd3fa admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:12.228597 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-8014fbba-4dcc-4ce2-86ef-ede680afd3fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:12.426968 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 887/1748] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:35:12.429288 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd4415-d0eb-4ce4-a8f6-45f34e5357a0 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:12.429766 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd4415-d0eb-4ce4-a8f6-45f34e5357a0 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:12.430233 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd4415-d0eb-4ce4-a8f6-45f34e5357a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:12.546116 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-d4dd4415-d0eb-4ce4-a8f6-45f34e5357a0 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:12.547360 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-d4dd4415-d0eb-4ce4-a8f6-45f34e5357a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:12.553828 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8014fbba-4dcc-4ce2-86ef-ede680afd3fa admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:12.591321 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548c0ac4-734f-4661-b520-5a768145d5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:12.593571 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c0ac4-734f-4661-b520-5a768145d5c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:12.593742 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 888/1749] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:35:12.593897 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c0ac4-734f-4661-b520-5a768145d5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:12.598356 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dd4415-d0eb-4ce4-a8f6-45f34e5357a0 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:12.609646 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c0ac4-734f-4661-b520-5a768145d5c7 admin admin] PATH_INFO: `/v3/projects/1d7f386e433d4480b6aa16fbc3168f07` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:12.614302 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548c0ac4-734f-4661-b520-5a768145d5c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d7f386e433d4480b6aa16fbc3168f07)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:12.617715 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548c0ac4-734f-4661-b520-5a768145d5c7 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:12.619134 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dd4415-d0eb-4ce4-a8f6-45f34e5357a0 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:12.647251 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c3668-6aee-4291-b80b-d47d8b7f19f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:12.648375 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c3668-6aee-4291-b80b-d47d8b7f19f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:12.648820 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c3668-6aee-4291-b80b-d47d8b7f19f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:12.649314 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c3668-6aee-4291-b80b-d47d8b7f19f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:12.650613 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2c3668-6aee-4291-b80b-d47d8b7f19f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:35:12.651130 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2c3668-6aee-4291-b80b-d47d8b7f19f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:12.662202 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2c3668-6aee-4291-b80b-d47d8b7f19f9 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:12.707854 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 889/1750] 10.222.0.26 () {58 vars in 1152 bytes} [Fri Jul 1 19:35:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:35:12.712087 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c3668-6aee-4291-b80b-d47d8b7f19f9 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:12.765985 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c3668-6aee-4291-b80b-d47d8b7f19f9 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:12.782781 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-548c0ac4-734f-4661-b520-5a768145d5c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d7f386e433d4480b6aa16fbc3168f07', 'request_id': 'req-548c0ac4-734f-4661-b520-5a768145d5c7'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:12.794227 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-548c0ac4-734f-4661-b520-5a768145d5c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d7f386e433d4480b6aa16fbc3168f07', 'request_id': 'req-548c0ac4-734f-4661-b520-5a768145d5c7'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:12.812138 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-548c0ac4-734f-4661-b520-5a768145d5c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d7f386e433d4480b6aa16fbc3168f07', 'request_id': 'req-548c0ac4-734f-4661-b520-5a768145d5c7'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:12.817995 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:12.857304 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-548c0ac4-734f-4661-b520-5a768145d5c7 admin admin] The token cache is being invalidate because project 1d7f386e433d4480b6aa16fbc3168f07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:35:12.857680 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-548c0ac4-734f-4661-b520-5a768145d5c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:12.863272 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-548c0ac4-734f-4661-b520-5a768145d5c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:12.868048 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 862/1751] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:35:12 2022] DELETE /identity/v3/projects/1d7f386e433d4480b6aa16fbc3168f07 => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:12.873127 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c03d85-390b-4c19-8948-f71b43d2af76 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:12.874616 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c03d85-390b-4c19-8948-f71b43d2af76 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:12.874899 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c03d85-390b-4c19-8948-f71b43d2af76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:12.943169 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-87c03d85-390b-4c19-8948-f71b43d2af76 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:12.951525 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-87c03d85-390b-4c19-8948-f71b43d2af76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:13.085623 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3c3ca3-ddbe-40be-9521-39139f27d0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:13.087316 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c3ca3-ddbe-40be-9521-39139f27d0c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:13.087800 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c3ca3-ddbe-40be-9521-39139f27d0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:13.088265 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c3ca3-ddbe-40be-9521-39139f27d0c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:13.089867 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3c3ca3-ddbe-40be-9521-39139f27d0c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:13.094976 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3c3ca3-ddbe-40be-9521-39139f27d0c5 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:13.114701 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:13.223490 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 890/1752] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:35:12 2022] POST /identity/v3/projects => generated 357 bytes in 512 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:35:13.224811 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3c3ca3-ddbe-40be-9521-39139f27d0c5 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:13.231620 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-1c3c3ca3-ddbe-40be-9521-39139f27d0c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:13.249952 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 863/1753] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:35:13.250683 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c03d85-390b-4c19-8948-f71b43d2af76 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:13.257999 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-87c03d85-390b-4c19-8948-f71b43d2af76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:13.303552 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c03d85-390b-4c19-8948-f71b43d2af76 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:13.474276 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cf30f1-5ca1-4dfa-810b-f065aa43f48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:13.475072 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf30f1-5ca1-4dfa-810b-f065aa43f48c admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:13.475353 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf30f1-5ca1-4dfa-810b-f065aa43f48c admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:13.475706 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf30f1-5ca1-4dfa-810b-f065aa43f48c admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:13.476936 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cf30f1-5ca1-4dfa-810b-f065aa43f48c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:13.482055 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cf30f1-5ca1-4dfa-810b-f065aa43f48c admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:13.532130 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 864/1754] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:35:13 2022] POST /identity/v3/users => generated 279 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:35:13.539265 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3c3ca3-ddbe-40be-9521-39139f27d0c5 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:13.546643 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9118fe04-aeb3-4ad9-8172-42185ed098cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:13.547998 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118fe04-aeb3-4ad9-8172-42185ed098cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:13.548449 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118fe04-aeb3-4ad9-8172-42185ed098cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:13.555137 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118fe04-aeb3-4ad9-8172-42185ed098cc admin admin] PATH_INFO: `/v3/projects/e04799bbf437462eb2bfbc39ccbcaf07` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:13.559434 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9118fe04-aeb3-4ad9-8172-42185ed098cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=e04799bbf437462eb2bfbc39ccbcaf07)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:13.561905 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9118fe04-aeb3-4ad9-8172-42185ed098cc admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:13.568438 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd597149-7555-4090-b8c4-8bb46ea359ea None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:13.568753 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd597149-7555-4090-b8c4-8bb46ea359ea None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:13.569259 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd597149-7555-4090-b8c4-8bb46ea359ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:13.650168 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-dd597149-7555-4090-b8c4-8bb46ea359ea None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:13.654259 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-dd597149-7555-4090-b8c4-8bb46ea359ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:13.702995 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 865/1755] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:35:13.705381 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd597149-7555-4090-b8c4-8bb46ea359ea None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:13.754240 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd597149-7555-4090-b8c4-8bb46ea359ea None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:13.794308 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-9118fe04-aeb3-4ad9-8172-42185ed098cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e04799bbf437462eb2bfbc39ccbcaf07', 'request_id': 'req-9118fe04-aeb3-4ad9-8172-42185ed098cc'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:13.820303 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-9118fe04-aeb3-4ad9-8172-42185ed098cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e04799bbf437462eb2bfbc39ccbcaf07', 'request_id': 'req-9118fe04-aeb3-4ad9-8172-42185ed098cc'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:13.866232 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-9118fe04-aeb3-4ad9-8172-42185ed098cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e04799bbf437462eb2bfbc39ccbcaf07', 'request_id': 'req-9118fe04-aeb3-4ad9-8172-42185ed098cc'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:13.938935 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-9118fe04-aeb3-4ad9-8172-42185ed098cc admin admin] The token cache is being invalidate because project e04799bbf437462eb2bfbc39ccbcaf07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:35:13.939451 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-9118fe04-aeb3-4ad9-8172-42185ed098cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:13.941877 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-9118fe04-aeb3-4ad9-8172-42185ed098cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:13.955587 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 891/1756] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:35:13 2022] DELETE /identity/v3/projects/e04799bbf437462eb2bfbc39ccbcaf07 => generated 0 bytes in 725 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:13.956912 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9118fe04-aeb3-4ad9-8172-42185ed098cc admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:13.966201 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-9118fe04-aeb3-4ad9-8172-42185ed098cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:14.043868 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18d88ed-0fcb-4a5a-a7aa-b76ad25be88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:14.048637 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d88ed-0fcb-4a5a-a7aa-b76ad25be88e admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:14.049166 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d88ed-0fcb-4a5a-a7aa-b76ad25be88e admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:14.050721 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d88ed-0fcb-4a5a-a7aa-b76ad25be88e admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:14.054153 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18d88ed-0fcb-4a5a-a7aa-b76ad25be88e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:14.060376 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18d88ed-0fcb-4a5a-a7aa-b76ad25be88e admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:14.096466 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 866/1757] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:35:13 2022] GET /identity/v3/roles => generated 1420 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:35:14.101274 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec6a592-9469-4cbe-8e4f-0c54a3002575 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:14.102062 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec6a592-9469-4cbe-8e4f-0c54a3002575 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:14.102476 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec6a592-9469-4cbe-8e4f-0c54a3002575 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:14.107537 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 867/1758] 10.222.0.26 () {54 vars in 921 bytes} [Fri Jul 1 19:35:14 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:35:14.112928 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f240c4-38b6-4ee6-8a2d-3bc80a9daedd None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:14.115000 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f240c4-38b6-4ee6-8a2d-3bc80a9daedd None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:14.115355 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f240c4-38b6-4ee6-8a2d-3bc80a9daedd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:14.166540 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-76f240c4-38b6-4ee6-8a2d-3bc80a9daedd None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:14.173858 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-76f240c4-38b6-4ee6-8a2d-3bc80a9daedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:14.197922 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 868/1759] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:35:14.199111 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f240c4-38b6-4ee6-8a2d-3bc80a9daedd None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:14.202863 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-76f240c4-38b6-4ee6-8a2d-3bc80a9daedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:14.227167 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:14.246723 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f240c4-38b6-4ee6-8a2d-3bc80a9daedd None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:14.260841 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9118fe04-aeb3-4ad9-8172-42185ed098cc admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:14.267197 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27879145-6b11-4f7e-80b0-1913152a995f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:14.281726 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27879145-6b11-4f7e-80b0-1913152a995f admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:14.281726 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27879145-6b11-4f7e-80b0-1913152a995f admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:14.281726 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27879145-6b11-4f7e-80b0-1913152a995f admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:14.281726 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27879145-6b11-4f7e-80b0-1913152a995f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:14.284731 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d80403-1958-4a0c-a7cd-40015c97ea0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:14.285445 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d80403-1958-4a0c-a7cd-40015c97ea0d admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:14.285819 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d80403-1958-4a0c-a7cd-40015c97ea0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:14.286471 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d80403-1958-4a0c-a7cd-40015c97ea0d admin admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:14.286848 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d80403-1958-4a0c-a7cd-40015c97ea0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:35:14.287161 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d80403-1958-4a0c-a7cd-40015c97ea0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:14.288830 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d80403-1958-4a0c-a7cd-40015c97ea0d admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:14.294782 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27879145-6b11-4f7e-80b0-1913152a995f admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:14.317609 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 892/1760] 10.222.0.26 () {58 vars in 1152 bytes} [Fri Jul 1 19:35:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:35:14.321809 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd2212-bd25-496b-8d63-4274936f347d None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:14.322129 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd2212-bd25-496b-8d63-4274936f347d None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:14.322413 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd2212-bd25-496b-8d63-4274936f347d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:14.359033 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 869/1761] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:35:14 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:35:14.369575 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4793471b-217b-47cd-8461-8e0cd145bd46 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:14.369575 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4793471b-217b-47cd-8461-8e0cd145bd46 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:14.369575 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4793471b-217b-47cd-8461-8e0cd145bd46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:14.378332 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-25cd2212-bd25-496b-8d63-4274936f347d None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:14.380330 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-25cd2212-bd25-496b-8d63-4274936f347d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:14.400462 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 893/1762] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:35:14.401313 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cd2212-bd25-496b-8d63-4274936f347d None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:14.416871 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cd2212-bd25-496b-8d63-4274936f347d None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:14.430924 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98cab7b-f470-4b3d-a799-76531a373f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:14.432679 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98cab7b-f470-4b3d-a799-76531a373f24 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:14.434531 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98cab7b-f470-4b3d-a799-76531a373f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:14.435294 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98cab7b-f470-4b3d-a799-76531a373f24 admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:14.438935 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98cab7b-f470-4b3d-a799-76531a373f24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:14.441164 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98cab7b-f470-4b3d-a799-76531a373f24 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:14.457632 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:14.459565 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-4793471b-217b-47cd-8461-8e0cd145bd46 None None] MFA Rules not processed for user `13fd76fc7dd1410b9cde5adbaa6cb2e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:14.460897 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-4793471b-217b-47cd-8461-8e0cd145bd46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:14.533040 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 894/1763] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:35:14 2022] POST /identity/v3/projects => generated 377 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:35:14.533040 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98cab7b-f470-4b3d-a799-76531a373f24 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:14.708089 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98cab7b-f470-4b3d-a799-76531a373f24 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:14.723076 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b744c9-6983-4dbb-b01c-2c0e01044129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:14.723614 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b744c9-6983-4dbb-b01c-2c0e01044129 admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:14.723977 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b744c9-6983-4dbb-b01c-2c0e01044129 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:14.724286 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b744c9-6983-4dbb-b01c-2c0e01044129 admin admin] PATH_INFO: `/v3/projects/d614ef8724cb4f33adf286f869d5ce19/users/bcf3571d49b8438ab86baf80ac44c18a/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:14.761933 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 870/1764] 10.222.0.26 () {58 vars in 1018 bytes} [Fri Jul 1 19:35:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 402 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:35:14.764712 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4793471b-217b-47cd-8461-8e0cd145bd46 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:14.764881 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b744c9-6983-4dbb-b01c-2c0e01044129 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d614ef8724cb4f33adf286f869d5ce19, user_id=bcf3571d49b8438ab86baf80ac44c18a, role_id=4cbf6ec846eb4b7c8cc52e9bfd6f076f)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:14.767810 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b744c9-6983-4dbb-b01c-2c0e01044129 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:14.791255 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4793471b-217b-47cd-8461-8e0cd145bd46 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:14.808557 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 895/1765] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:35:14 2022] PUT /identity/v3/projects/d614ef8724cb4f33adf286f869d5ce19/users/bcf3571d49b8438ab86baf80ac44c18a/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:14.808557 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b744c9-6983-4dbb-b01c-2c0e01044129 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:14.966778 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b744c9-6983-4dbb-b01c-2c0e01044129 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:14.980664 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515f0a79-6706-4f4a-8e30-73cf7372c20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:14.981551 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f0a79-6706-4f4a-8e30-73cf7372c20e admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:14.981937 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f0a79-6706-4f4a-8e30-73cf7372c20e admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:14.982292 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f0a79-6706-4f4a-8e30-73cf7372c20e admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:14.983750 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515f0a79-6706-4f4a-8e30-73cf7372c20e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:14.988908 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515f0a79-6706-4f4a-8e30-73cf7372c20e admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:15.043688 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 896/1766] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:35:14 2022] POST /identity/v3/users => generated 289 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:35:15.045204 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbabf457-4bda-4b73-9066-c0ba7c866fff None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:15.046155 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbabf457-4bda-4b73-9066-c0ba7c866fff None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:15.046511 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbabf457-4bda-4b73-9066-c0ba7c866fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:15.118913 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-dbabf457-4bda-4b73-9066-c0ba7c866fff None None] MFA Rules not processed for user `bcf3571d49b8438ab86baf80ac44c18a`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:15.119098 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1412b788-4e77-48c4-b05e-dfc359c6d6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:15.121895 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-dbabf457-4bda-4b73-9066-c0ba7c866fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:15.127105 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1412b788-4e77-48c4-b05e-dfc359c6d6db admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:15.129273 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1412b788-4e77-48c4-b05e-dfc359c6d6db admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:15.129991 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1412b788-4e77-48c4-b05e-dfc359c6d6db admin admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:15.133297 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1412b788-4e77-48c4-b05e-dfc359c6d6db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:35:15.135496 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1412b788-4e77-48c4-b05e-dfc359c6d6db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:15.145729 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1412b788-4e77-48c4-b05e-dfc359c6d6db admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:15.223071 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 871/1767] 10.222.0.26 () {58 vars in 1152 bytes} [Fri Jul 1 19:35:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 458 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:35:15.224620 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1412b788-4e77-48c4-b05e-dfc359c6d6db admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:15.230143 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-1412b788-4e77-48c4-b05e-dfc359c6d6db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:15.230753 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:15.296622 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 897/1768] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:15 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:35:15.296622 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbabf457-4bda-4b73-9066-c0ba7c866fff None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:15.342039 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbabf457-4bda-4b73-9066-c0ba7c866fff None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:15.366368 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a003ea06-327b-4c4f-933a-463fd072125c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:15.369211 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a003ea06-327b-4c4f-933a-463fd072125c admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:15.369558 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a003ea06-327b-4c4f-933a-463fd072125c admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:15.369809 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a003ea06-327b-4c4f-933a-463fd072125c admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:15.370576 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a003ea06-327b-4c4f-933a-463fd072125c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:15.381743 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a003ea06-327b-4c4f-933a-463fd072125c admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:15.444066 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 898/1769] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:35:15 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:35:15.445524 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a003ea06-327b-4c4f-933a-463fd072125c admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:15.472271 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a003ea06-327b-4c4f-933a-463fd072125c admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:15.498321 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc38b3c0-5d52-456d-bbc6-f1de1f25887e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:15.499686 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38b3c0-5d52-456d-bbc6-f1de1f25887e admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:15.499991 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38b3c0-5d52-456d-bbc6-f1de1f25887e admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:15.500342 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38b3c0-5d52-456d-bbc6-f1de1f25887e admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:15.501093 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc38b3c0-5d52-456d-bbc6-f1de1f25887e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:15.509289 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc38b3c0-5d52-456d-bbc6-f1de1f25887e admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:15.585519 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 899/1770] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:35:15 2022] POST /identity/v3/projects => generated 373 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:35:15.586643 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc38b3c0-5d52-456d-bbc6-f1de1f25887e admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:15.616644 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1412b788-4e77-48c4-b05e-dfc359c6d6db admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:15.700791 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:15.865068 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc38b3c0-5d52-456d-bbc6-f1de1f25887e admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:15.880845 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff13bf7e-2df6-4487-a92f-188acd9cee09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:15.882107 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff13bf7e-2df6-4487-a92f-188acd9cee09 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:15.883750 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff13bf7e-2df6-4487-a92f-188acd9cee09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:15.884214 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff13bf7e-2df6-4487-a92f-188acd9cee09 admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:15.885161 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff13bf7e-2df6-4487-a92f-188acd9cee09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:15.891761 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff13bf7e-2df6-4487-a92f-188acd9cee09 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:15.968686 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 900/1771] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:35:15 2022] POST /identity/v3/projects => generated 355 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:35:15.968686 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff13bf7e-2df6-4487-a92f-188acd9cee09 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:16.003143 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d1f6d-0f37-4aaa-b08e-9aa476125949 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13fd76fc7dd1410b9cde5adbaa6cb2e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:16.004404 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d1f6d-0f37-4aaa-b08e-9aa476125949 service nova] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:16.004762 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d1f6d-0f37-4aaa-b08e-9aa476125949 service nova] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:16.005070 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d1f6d-0f37-4aaa-b08e-9aa476125949 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:16.033413 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56d1f6d-0f37-4aaa-b08e-9aa476125949 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:16.035095 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56d1f6d-0f37-4aaa-b08e-9aa476125949 service nova] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:16.080819 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 872/1772] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:35:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 859 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:35:16.087788 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d1f6d-0f37-4aaa-b08e-9aa476125949 service nova] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:16.110616 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d1f6d-0f37-4aaa-b08e-9aa476125949 service nova] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:16.286079 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff13bf7e-2df6-4487-a92f-188acd9cee09 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:16.297580 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30814068-0e3e-45c6-848e-0548a14925e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:16.299986 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30814068-0e3e-45c6-848e-0548a14925e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:16.300587 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30814068-0e3e-45c6-848e-0548a14925e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:16.301687 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30814068-0e3e-45c6-848e-0548a14925e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:16.304086 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30814068-0e3e-45c6-848e-0548a14925e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:16.307928 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30814068-0e3e-45c6-848e-0548a14925e4 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:16.340395 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 901/1773] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:35:15 2022] GET /identity/v3/roles => generated 1420 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:35:16.341791 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30814068-0e3e-45c6-848e-0548a14925e4 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:16.360793 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce83b8d-ee50-42bf-9f8c-c163822086ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:16.362364 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce83b8d-ee50-42bf-9f8c-c163822086ca admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:16.375576 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce83b8d-ee50-42bf-9f8c-c163822086ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:16.376900 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce83b8d-ee50-42bf-9f8c-c163822086ca admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:16.377841 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce83b8d-ee50-42bf-9f8c-c163822086ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:16.382897 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce83b8d-ee50-42bf-9f8c-c163822086ca admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:16.419674 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30814068-0e3e-45c6-848e-0548a14925e4 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:16.444984 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95141381-3083-4542-8b0a-cd51a74cc051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:16.445729 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95141381-3083-4542-8b0a-cd51a74cc051 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:16.446026 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95141381-3083-4542-8b0a-cd51a74cc051 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:16.446297 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95141381-3083-4542-8b0a-cd51a74cc051 admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:16.447013 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95141381-3083-4542-8b0a-cd51a74cc051 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:16.456480 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 873/1774] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:35:16 2022] POST /identity/v3/users => generated 287 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:35:16.459338 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95141381-3083-4542-8b0a-cd51a74cc051 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:16.464123 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80dd5b-1895-48c0-bb12-d559bf6fe12f None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:16.465129 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80dd5b-1895-48c0-bb12-d559bf6fe12f None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:16.465472 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80dd5b-1895-48c0-bb12-d559bf6fe12f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:16.523958 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-6e80dd5b-1895-48c0-bb12-d559bf6fe12f None None] MFA Rules not processed for user `75b8c92fd65a49e493373b4a13c18290`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:16.533485 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-6e80dd5b-1895-48c0-bb12-d559bf6fe12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:16.536623 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 902/1775] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:35:16 2022] POST /identity/v3/users => generated 284 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:35:16.538339 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95141381-3083-4542-8b0a-cd51a74cc051 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:16.565196 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95141381-3083-4542-8b0a-cd51a74cc051 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:16.574463 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63183ab-0337-4d9b-95b5-0a8e8646bce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:16.579297 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63183ab-0337-4d9b-95b5-0a8e8646bce0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:16.579795 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63183ab-0337-4d9b-95b5-0a8e8646bce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:16.580192 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63183ab-0337-4d9b-95b5-0a8e8646bce0 admin admin] PATH_INFO: `/v3/projects/cee68036ea8a4edfbd6158055124e8e1/users/41d2687e163a4c72bc52b7733df34d04/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:16.624554 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63183ab-0337-4d9b-95b5-0a8e8646bce0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cee68036ea8a4edfbd6158055124e8e1, user_id=41d2687e163a4c72bc52b7733df34d04, role_id=4cbf6ec846eb4b7c8cc52e9bfd6f076f)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:16.631230 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63183ab-0337-4d9b-95b5-0a8e8646bce0 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:16.634327 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:16.659842 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 903/1776] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:35:16 2022] PUT /identity/v3/projects/cee68036ea8a4edfbd6158055124e8e1/users/41d2687e163a4c72bc52b7733df34d04/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:16.662041 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63183ab-0337-4d9b-95b5-0a8e8646bce0 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:16.711504 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 874/1777] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:35:16.714248 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e80dd5b-1895-48c0-bb12-d559bf6fe12f None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:16.747370 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e80dd5b-1895-48c0-bb12-d559bf6fe12f None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:16.872761 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63183ab-0337-4d9b-95b5-0a8e8646bce0 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:16.891266 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c922a-8670-4db8-80f8-98036db843cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:16.894474 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:16.895879 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c922a-8670-4db8-80f8-98036db843cd admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:16.896375 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c922a-8670-4db8-80f8-98036db843cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:16.896829 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c922a-8670-4db8-80f8-98036db843cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:16.897993 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7c922a-8670-4db8-80f8-98036db843cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:16.902675 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7c922a-8670-4db8-80f8-98036db843cd admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:16.934591 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 904/1778] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:35:16 2022] GET /identity/v3/roles => generated 1420 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:35:16.936688 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395a2ba-753c-4b71-8b44-c88b35501134 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:16.938593 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395a2ba-753c-4b71-8b44-c88b35501134 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:16.939865 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395a2ba-753c-4b71-8b44-c88b35501134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:16.987692 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-2395a2ba-753c-4b71-8b44-c88b35501134 None None] MFA Rules not processed for user `41d2687e163a4c72bc52b7733df34d04`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:16.989226 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-2395a2ba-753c-4b71-8b44-c88b35501134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:16.996520 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa2ac8f-2931-464a-b8ab-c2cbfa57fb4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:16.997338 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa2ac8f-2931-464a-b8ab-c2cbfa57fb4b admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:16.998721 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa2ac8f-2931-464a-b8ab-c2cbfa57fb4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:16.999033 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa2ac8f-2931-464a-b8ab-c2cbfa57fb4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:17.000186 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa2ac8f-2931-464a-b8ab-c2cbfa57fb4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:17.001999 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa2ac8f-2931-464a-b8ab-c2cbfa57fb4b admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:17.035796 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 875/1779] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:35:16 2022] GET /identity/v3/roles => generated 1420 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:35:17.037831 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa2ac8f-2931-464a-b8ab-c2cbfa57fb4b admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:17.056637 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-9aa2ac8f-2931-464a-b8ab-c2cbfa57fb4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:17.126536 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa2ac8f-2931-464a-b8ab-c2cbfa57fb4b admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:17.145255 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7017fca3-b474-4939-972e-6c7308ed0935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:17.146166 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7017fca3-b474-4939-972e-6c7308ed0935 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:17.146451 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7017fca3-b474-4939-972e-6c7308ed0935 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:17.146728 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7017fca3-b474-4939-972e-6c7308ed0935 admin admin] PATH_INFO: `/v3/users/ee9916387f1949ddbaebad4cf8be8a77` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:17.148025 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7017fca3-b474-4939-972e-6c7308ed0935 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee9916387f1949ddbaebad4cf8be8a77)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:17.150096 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7017fca3-b474-4939-972e-6c7308ed0935 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:17.235634 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 905/1780] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:35:17.237021 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2395a2ba-753c-4b71-8b44-c88b35501134 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:17.256416 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-7017fca3-b474-4939-972e-6c7308ed0935 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee9916387f1949ddbaebad4cf8be8a77'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:17.257460 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-7017fca3-b474-4939-972e-6c7308ed0935 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee9916387f1949ddbaebad4cf8be8a77'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:17.265282 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2395a2ba-753c-4b71-8b44-c88b35501134 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:17.271291 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-7017fca3-b474-4939-972e-6c7308ed0935 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee9916387f1949ddbaebad4cf8be8a77'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:17.289672 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-7017fca3-b474-4939-972e-6c7308ed0935 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee9916387f1949ddbaebad4cf8be8a77'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:17.293327 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-7017fca3-b474-4939-972e-6c7308ed0935 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee9916387f1949ddbaebad4cf8be8a77'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:17.297728 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0aa74c-697a-466f-a7ee-bef4ff820423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:17.298413 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0aa74c-697a-466f-a7ee-bef4ff820423 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:17.298699 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0aa74c-697a-466f-a7ee-bef4ff820423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:17.301360 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0aa74c-697a-466f-a7ee-bef4ff820423 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:17.302165 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0aa74c-697a-466f-a7ee-bef4ff820423 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:17.306005 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0aa74c-697a-466f-a7ee-bef4ff820423 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:17.345225 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 906/1781] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:35:17 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:35:17.352187 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0aa74c-697a-466f-a7ee-bef4ff820423 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:17.356291 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-6c0aa74c-697a-466f-a7ee-bef4ff820423 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:17.356925 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 876/1782] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:35:17 2022] DELETE /identity/v3/users/ee9916387f1949ddbaebad4cf8be8a77 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:17.363324 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7017fca3-b474-4939-972e-6c7308ed0935 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:17.369012 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-7017fca3-b474-4939-972e-6c7308ed0935 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:17.397074 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0aa74c-697a-466f-a7ee-bef4ff820423 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:17.604040 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7017fca3-b474-4939-972e-6c7308ed0935 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:17.616934 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752a17b7-21d0-4289-99f2-9872c0d6987c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:17.620567 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a17b7-21d0-4289-99f2-9872c0d6987c admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:17.621039 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a17b7-21d0-4289-99f2-9872c0d6987c admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:17.621461 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a17b7-21d0-4289-99f2-9872c0d6987c admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:17.623745 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752a17b7-21d0-4289-99f2-9872c0d6987c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:17.627699 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752a17b7-21d0-4289-99f2-9872c0d6987c admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:17.634192 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e8539-c683-4f26-8f70-e182ecd78949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:17.641372 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e8539-c683-4f26-8f70-e182ecd78949 admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:17.643312 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e8539-c683-4f26-8f70-e182ecd78949 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:17.643808 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e8539-c683-4f26-8f70-e182ecd78949 admin admin] PATH_INFO: `/v3/projects/9d674429146b4da28686edd5bec6d750/users/5cf00d949df54cbdad79af08b1103aae/roles/6cb03785fb184ef587509b3174622f69` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:17.683507 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:17.693070 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74e8539-c683-4f26-8f70-e182ecd78949 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d674429146b4da28686edd5bec6d750, user_id=5cf00d949df54cbdad79af08b1103aae, role_id=6cb03785fb184ef587509b3174622f69)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:17.697412 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 877/1783] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:35:17 2022] POST /identity/v3/projects => generated 375 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:35:17.697412 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752a17b7-21d0-4289-99f2-9872c0d6987c admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:17.699896 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-752a17b7-21d0-4289-99f2-9872c0d6987c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:17.707650 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74e8539-c683-4f26-8f70-e182ecd78949 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:17.738149 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 907/1784] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:35:17 2022] PUT /identity/v3/projects/9d674429146b4da28686edd5bec6d750/users/5cf00d949df54cbdad79af08b1103aae/roles/6cb03785fb184ef587509b3174622f69 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:17.740093 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b4bd8-c888-4a3f-9a40-335f4a178f5a None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:17.745408 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b4bd8-c888-4a3f-9a40-335f4a178f5a None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:17.748279 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b4bd8-c888-4a3f-9a40-335f4a178f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:17.804269 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-c99b4bd8-c888-4a3f-9a40-335f4a178f5a None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:17.807614 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-c99b4bd8-c888-4a3f-9a40-335f4a178f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:17.835965 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:17.981838 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752a17b7-21d0-4289-99f2-9872c0d6987c admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:18.035758 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 908/1785] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:35:18.036587 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99b4bd8-c888-4a3f-9a40-335f4a178f5a None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:18.058506 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99b4bd8-c888-4a3f-9a40-335f4a178f5a None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:18.109804 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da31838-4f3e-43bf-9196-b7a06ec4e622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:18.110720 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da31838-4f3e-43bf-9196-b7a06ec4e622 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:18.111001 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da31838-4f3e-43bf-9196-b7a06ec4e622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:18.111280 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da31838-4f3e-43bf-9196-b7a06ec4e622 admin admin] PATH_INFO: `/v3/projects/3c927d015c78419bb30a069d3444e9a7/users/fd772d060fbd4ab3a6bb2f533367c0ac/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:18.129675 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da31838-4f3e-43bf-9196-b7a06ec4e622 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c927d015c78419bb30a069d3444e9a7, user_id=fd772d060fbd4ab3a6bb2f533367c0ac, role_id=4cbf6ec846eb4b7c8cc52e9bfd6f076f)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:18.132569 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da31838-4f3e-43bf-9196-b7a06ec4e622 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:18.143069 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9199a9f0-25c8-4393-b9cd-e73627747f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:18.148175 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9199a9f0-25c8-4393-b9cd-e73627747f23 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:18.148433 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9199a9f0-25c8-4393-b9cd-e73627747f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:18.148712 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9199a9f0-25c8-4393-b9cd-e73627747f23 admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:18.149505 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9199a9f0-25c8-4393-b9cd-e73627747f23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:18.152663 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9199a9f0-25c8-4393-b9cd-e73627747f23 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:18.162144 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 878/1786] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:35:17 2022] PUT /identity/v3/projects/3c927d015c78419bb30a069d3444e9a7/users/fd772d060fbd4ab3a6bb2f533367c0ac/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:18.178680 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da31838-4f3e-43bf-9196-b7a06ec4e622 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:18.217041 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 909/1787] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:35:18 2022] POST /identity/v3/users => generated 294 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:35:18.218502 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9199a9f0-25c8-4393-b9cd-e73627747f23 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:18.222288 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-9199a9f0-25c8-4393-b9cd-e73627747f23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:18.426660 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9199a9f0-25c8-4393-b9cd-e73627747f23 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:18.446375 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da31838-4f3e-43bf-9196-b7a06ec4e622 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:18.464542 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f50bbc-a52a-4960-afa1-3c2931705ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:18.465179 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f50bbc-a52a-4960-afa1-3c2931705ba5 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:18.465705 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f50bbc-a52a-4960-afa1-3c2931705ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:18.465809 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f50bbc-a52a-4960-afa1-3c2931705ba5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:18.470791 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f50bbc-a52a-4960-afa1-3c2931705ba5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:18.473818 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f50bbc-a52a-4960-afa1-3c2931705ba5 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:18.498204 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 879/1788] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:35:18 2022] GET /identity/v3/roles => generated 1420 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:35:18.500525 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b84423-62d5-4341-936f-af0636a74099 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:18.500635 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b84423-62d5-4341-936f-af0636a74099 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:18.500835 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b84423-62d5-4341-936f-af0636a74099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:18.585398 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-54b84423-62d5-4341-936f-af0636a74099 None None] MFA Rules not processed for user `fd772d060fbd4ab3a6bb2f533367c0ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:18.587223 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-54b84423-62d5-4341-936f-af0636a74099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:18.631683 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d9121f-0ae3-499d-9942-70a419827e01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:18.632389 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d9121f-0ae3-499d-9942-70a419827e01 service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:18.632635 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d9121f-0ae3-499d-9942-70a419827e01 service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:18.633143 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d9121f-0ae3-499d-9942-70a419827e01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:18.665283 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d9121f-0ae3-499d-9942-70a419827e01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:18.666950 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d9121f-0ae3-499d-9942-70a419827e01 service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:18.697715 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:18.700173 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 910/1789] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:35:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:35:18.701315 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d9121f-0ae3-499d-9942-70a419827e01 service neutron] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:18.736707 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d9121f-0ae3-499d-9942-70a419827e01 service neutron] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:18.742963 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 880/1790] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:35:18.744930 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b84423-62d5-4341-936f-af0636a74099 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:18.747554 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b007bfc-42f9-4d07-b41e-54e09ddfc13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:18.751883 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b007bfc-42f9-4d07-b41e-54e09ddfc13f admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:18.752130 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b007bfc-42f9-4d07-b41e-54e09ddfc13f admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:18.752266 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b007bfc-42f9-4d07-b41e-54e09ddfc13f admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:18.753183 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b007bfc-42f9-4d07-b41e-54e09ddfc13f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:18.754864 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b007bfc-42f9-4d07-b41e-54e09ddfc13f admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:18.765304 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b84423-62d5-4341-936f-af0636a74099 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:18.773418 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebfbcc5-d344-4a8a-9043-b3bdc5546534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:18.774609 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebfbcc5-d344-4a8a-9043-b3bdc5546534 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:18.774903 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebfbcc5-d344-4a8a-9043-b3bdc5546534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:18.775188 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebfbcc5-d344-4a8a-9043-b3bdc5546534 admin admin] PATH_INFO: `/v3/projects/9d674429146b4da28686edd5bec6d750/users/5cf00d949df54cbdad79af08b1103aae/roles/6cb03785fb184ef587509b3174622f69` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:18.777749 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebfbcc5-d344-4a8a-9043-b3bdc5546534 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d674429146b4da28686edd5bec6d750, user_id=5cf00d949df54cbdad79af08b1103aae, role_id=6cb03785fb184ef587509b3174622f69)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:18.779501 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 911/1791] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:35:18 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:35:18.780983 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b007bfc-42f9-4d07-b41e-54e09ddfc13f admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:18.787234 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebfbcc5-d344-4a8a-9043-b3bdc5546534 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:18.811392 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b007bfc-42f9-4d07-b41e-54e09ddfc13f admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:18.819176 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 881/1792] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:35:18 2022] PUT /identity/v3/projects/9d674429146b4da28686edd5bec6d750/users/5cf00d949df54cbdad79af08b1103aae/roles/6cb03785fb184ef587509b3174622f69 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:18.819743 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebfbcc5-d344-4a8a-9043-b3bdc5546534 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:18.850126 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:18.983891 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebfbcc5-d344-4a8a-9043-b3bdc5546534 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:18.993271 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbc5a9c-0f29-4f93-b2dc-bb0d6223b1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:18.994543 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc5a9c-0f29-4f93-b2dc-bb0d6223b1f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:18.995909 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc5a9c-0f29-4f93-b2dc-bb0d6223b1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:18.997969 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc5a9c-0f29-4f93-b2dc-bb0d6223b1f4 admin admin] PATH_INFO: `/v3/projects/8c0ba6694ee14ae5a6354310dc73a0b5/users/16db52b2b8724533bed11bcde781f70e/roles/6cb03785fb184ef587509b3174622f69` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:19.038848 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbc5a9c-0f29-4f93-b2dc-bb0d6223b1f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c0ba6694ee14ae5a6354310dc73a0b5, user_id=16db52b2b8724533bed11bcde781f70e, role_id=6cb03785fb184ef587509b3174622f69)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:19.042823 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbc5a9c-0f29-4f93-b2dc-bb0d6223b1f4 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:19.048259 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e792a4a-4256-4f95-9e7f-7ca96c7c80fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:19.050627 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e792a4a-4256-4f95-9e7f-7ca96c7c80fe admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:19.050898 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e792a4a-4256-4f95-9e7f-7ca96c7c80fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:19.051204 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e792a4a-4256-4f95-9e7f-7ca96c7c80fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:19.056538 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e792a4a-4256-4f95-9e7f-7ca96c7c80fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:19.058862 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e792a4a-4256-4f95-9e7f-7ca96c7c80fe admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:19.083426 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 882/1793] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:35:18 2022] PUT /identity/v3/projects/8c0ba6694ee14ae5a6354310dc73a0b5/users/16db52b2b8724533bed11bcde781f70e/roles/6cb03785fb184ef587509b3174622f69 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:19.088448 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b65889-0dfd-4da7-8417-a4a51e7c1660 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:19.091261 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b65889-0dfd-4da7-8417-a4a51e7c1660 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:19.091573 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b65889-0dfd-4da7-8417-a4a51e7c1660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:19.126176 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 912/1794] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:35:18 2022] POST /identity/v3/projects => generated 373 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:35:19.126714 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e792a4a-4256-4f95-9e7f-7ca96c7c80fe admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:19.175769 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-b1b65889-0dfd-4da7-8417-a4a51e7c1660 None None] MFA Rules not processed for user `5cf00d949df54cbdad79af08b1103aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:19.177912 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-b1b65889-0dfd-4da7-8417-a4a51e7c1660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:19.322340 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e792a4a-4256-4f95-9e7f-7ca96c7c80fe admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:19.340753 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27092713-c202-40a2-9170-6068c1bd7de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:19.341818 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 883/1795] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:19 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:35:19.342042 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27092713-c202-40a2-9170-6068c1bd7de8 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:19.342681 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27092713-c202-40a2-9170-6068c1bd7de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:19.342824 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27092713-c202-40a2-9170-6068c1bd7de8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:19.342950 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b65889-0dfd-4da7-8417-a4a51e7c1660 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:19.343756 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27092713-c202-40a2-9170-6068c1bd7de8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:19.347117 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27092713-c202-40a2-9170-6068c1bd7de8 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:19.377094 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 913/1796] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:35:19 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:35:19.380532 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27092713-c202-40a2-9170-6068c1bd7de8 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:19.386627 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b65889-0dfd-4da7-8417-a4a51e7c1660 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:19.387548 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-27092713-c202-40a2-9170-6068c1bd7de8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:19.399244 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901bb59-0b07-4c06-b82c-dc8c469adde1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:19.399984 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901bb59-0b07-4c06-b82c-dc8c469adde1 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:19.400286 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901bb59-0b07-4c06-b82c-dc8c469adde1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:19.400677 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901bb59-0b07-4c06-b82c-dc8c469adde1 admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:19.414335 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2901bb59-0b07-4c06-b82c-dc8c469adde1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:19.420847 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2901bb59-0b07-4c06-b82c-dc8c469adde1 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:19.474049 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 884/1797] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:35:19 2022] POST /identity/v3/users => generated 293 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:35:19.476720 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901bb59-0b07-4c06-b82c-dc8c469adde1 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:19.492855 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901bb59-0b07-4c06-b82c-dc8c469adde1 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:19.500878 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b6250c-78de-47f0-821f-3bf0c18faa80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:19.501987 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b6250c-78de-47f0-821f-3bf0c18faa80 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:19.503199 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b6250c-78de-47f0-821f-3bf0c18faa80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:19.503555 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b6250c-78de-47f0-821f-3bf0c18faa80 admin admin] PATH_INFO: `/v3/projects/8c0ba6694ee14ae5a6354310dc73a0b5/users/16db52b2b8724533bed11bcde781f70e/roles/6cb03785fb184ef587509b3174622f69` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:19.506072 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b6250c-78de-47f0-821f-3bf0c18faa80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c0ba6694ee14ae5a6354310dc73a0b5, user_id=16db52b2b8724533bed11bcde781f70e, role_id=6cb03785fb184ef587509b3174622f69)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:19.510665 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b6250c-78de-47f0-821f-3bf0c18faa80 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:19.538201 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 885/1798] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:35:19 2022] PUT /identity/v3/projects/8c0ba6694ee14ae5a6354310dc73a0b5/users/16db52b2b8724533bed11bcde781f70e/roles/6cb03785fb184ef587509b3174622f69 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:19.549114 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b6250c-78de-47f0-821f-3bf0c18faa80 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:19.564905 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:19.570600 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27092713-c202-40a2-9170-6068c1bd7de8 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:19.671390 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9146d933-68c3-42c7-b5ea-e5aba1ec48b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a3ed285ee4c4d04abf7daf0aeb9fb7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:19.675385 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146d933-68c3-42c7-b5ea-e5aba1ec48b4 service cinder] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:19.675964 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146d933-68c3-42c7-b5ea-e5aba1ec48b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:19.676259 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146d933-68c3-42c7-b5ea-e5aba1ec48b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:19.687470 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b6250c-78de-47f0-821f-3bf0c18faa80 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:19.695439 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:19.704062 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4ecb56-0f87-4180-94b5-d5b68594edaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:19.704760 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ecb56-0f87-4180-94b5-d5b68594edaf admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:19.705045 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ecb56-0f87-4180-94b5-d5b68594edaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:19.705353 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ecb56-0f87-4180-94b5-d5b68594edaf admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:19.706105 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4ecb56-0f87-4180-94b5-d5b68594edaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:19.707743 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4ecb56-0f87-4180-94b5-d5b68594edaf admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:19.749342 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 886/1799] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:35:19 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:35:19.751250 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4ecb56-0f87-4180-94b5-d5b68594edaf admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:19.756148 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-4f4ecb56-0f87-4180-94b5-d5b68594edaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:19.766586 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9146d933-68c3-42c7-b5ea-e5aba1ec48b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:19.768057 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9146d933-68c3-42c7-b5ea-e5aba1ec48b4 service cinder] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:19.781782 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 914/1800] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:35:19 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:35:19.782532 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df5586-4ec6-4d0a-b15a-348967d32d98 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:19.782914 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df5586-4ec6-4d0a-b15a-348967d32d98 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:19.783200 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df5586-4ec6-4d0a-b15a-348967d32d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:19.792964 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4ecb56-0f87-4180-94b5-d5b68594edaf admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:19.807701 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b611ef1-24d6-40c8-a529-4ff1e6e200c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:19.810312 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b611ef1-24d6-40c8-a529-4ff1e6e200c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:19.813349 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b611ef1-24d6-40c8-a529-4ff1e6e200c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:19.813813 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b611ef1-24d6-40c8-a529-4ff1e6e200c8 admin admin] PATH_INFO: `/v3/projects/0bc74ce9f94e4dacadd806adf2a4fd3c` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:19.815380 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b611ef1-24d6-40c8-a529-4ff1e6e200c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bc74ce9f94e4dacadd806adf2a4fd3c)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:19.820606 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b611ef1-24d6-40c8-a529-4ff1e6e200c8 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:19.821152 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-15df5586-4ec6-4d0a-b15a-348967d32d98 None None] MFA Rules not processed for user `16db52b2b8724533bed11bcde781f70e`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:19.823185 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-15df5586-4ec6-4d0a-b15a-348967d32d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:19.943896 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-7b611ef1-24d6-40c8-a529-4ff1e6e200c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bc74ce9f94e4dacadd806adf2a4fd3c', 'request_id': 'req-7b611ef1-24d6-40c8-a529-4ff1e6e200c8'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:19.955628 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-7b611ef1-24d6-40c8-a529-4ff1e6e200c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bc74ce9f94e4dacadd806adf2a4fd3c', 'request_id': 'req-7b611ef1-24d6-40c8-a529-4ff1e6e200c8'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:19.965197 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-7b611ef1-24d6-40c8-a529-4ff1e6e200c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bc74ce9f94e4dacadd806adf2a4fd3c', 'request_id': 'req-7b611ef1-24d6-40c8-a529-4ff1e6e200c8'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:19.977771 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 915/1801] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:19 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:35:19.979712 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15df5586-4ec6-4d0a-b15a-348967d32d98 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:19.991056 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-7b611ef1-24d6-40c8-a529-4ff1e6e200c8 admin admin] The token cache is being invalidate because project 0bc74ce9f94e4dacadd806adf2a4fd3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:35:19.991601 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-7b611ef1-24d6-40c8-a529-4ff1e6e200c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:19.992443 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-7b611ef1-24d6-40c8-a529-4ff1e6e200c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:19.995336 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 887/1802] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:35:19 2022] DELETE /identity/v3/projects/0bc74ce9f94e4dacadd806adf2a4fd3c => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:19.997210 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd57314-ec30-40d3-a9ca-2d6021425b50 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:19.997676 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd57314-ec30-40d3-a9ca-2d6021425b50 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:19.997966 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd57314-ec30-40d3-a9ca-2d6021425b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:20.005341 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15df5586-4ec6-4d0a-b15a-348967d32d98 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:20.031897 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-4fd57314-ec30-40d3-a9ca-2d6021425b50 None None] MFA Rules not processed for user `1827b8d35e274416b3f6adbc28691ad6`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:20.036446 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-4fd57314-ec30-40d3-a9ca-2d6021425b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:20.109632 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dfe0e2-faa4-4189-94e8-e963dc05227b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:20.110718 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dfe0e2-faa4-4189-94e8-e963dc05227b admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:20.111111 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dfe0e2-faa4-4189-94e8-e963dc05227b admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:20.111542 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dfe0e2-faa4-4189-94e8-e963dc05227b admin admin] PATH_INFO: `/v3/projects/026d368c92f04c2f92b777c4a963b933/users/6035b68ca0b44f1ea68d15e373dc9351/roles/6cb03785fb184ef587509b3174622f69` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:20.137537 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 888/1803] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:35:20.138861 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd57314-ec30-40d3-a9ca-2d6021425b50 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:20.141424 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-4fd57314-ec30-40d3-a9ca-2d6021425b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:20.155570 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dfe0e2-faa4-4189-94e8-e963dc05227b admin admin] RBAC: Authorizing `identity:create_grant(project_id=026d368c92f04c2f92b777c4a963b933, user_id=6035b68ca0b44f1ea68d15e373dc9351, role_id=6cb03785fb184ef587509b3174622f69)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:20.162933 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dfe0e2-faa4-4189-94e8-e963dc05227b admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:20.190195 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 916/1804] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:35:19 2022] PUT /identity/v3/projects/026d368c92f04c2f92b777c4a963b933/users/6035b68ca0b44f1ea68d15e373dc9351/roles/6cb03785fb184ef587509b3174622f69 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:20.191579 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dfe0e2-faa4-4189-94e8-e963dc05227b admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:20.197562 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-d7dfe0e2-faa4-4189-94e8-e963dc05227b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:20.217722 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:20.265987 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd57314-ec30-40d3-a9ca-2d6021425b50 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:20.269980 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:20.364317 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dfe0e2-faa4-4189-94e8-e963dc05227b admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:20.369495 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c5ce1-c019-4a6f-89ad-120484705e8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a3ed285ee4c4d04abf7daf0aeb9fb7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:20.369965 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c5ce1-c019-4a6f-89ad-120484705e8b service cinder] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:20.370252 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c5ce1-c019-4a6f-89ad-120484705e8b service cinder] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:20.370533 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c5ce1-c019-4a6f-89ad-120484705e8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:20.372564 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-351c5ce1-c019-4a6f-89ad-120484705e8b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:20.373627 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fb0685-703c-4763-9c7f-b326e1d86f3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a3ed285ee4c4d04abf7daf0aeb9fb7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:20.374463 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb0685-703c-4763-9c7f-b326e1d86f3f service cinder] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:20.374950 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb0685-703c-4763-9c7f-b326e1d86f3f service cinder] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:20.375419 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb0685-703c-4763-9c7f-b326e1d86f3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:20.378096 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-43fb0685-703c-4763-9c7f-b326e1d86f3f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:20.466360 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351c5ce1-c019-4a6f-89ad-120484705e8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:20.474006 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351c5ce1-c019-4a6f-89ad-120484705e8b service cinder] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:20.486574 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 917/1805] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:35:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:35:20.487601 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c5ce1-c019-4a6f-89ad-120484705e8b service cinder] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:20.489895 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-351c5ce1-c019-4a6f-89ad-120484705e8b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:20.535144 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fb0685-703c-4763-9c7f-b326e1d86f3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:20.540185 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fb0685-703c-4763-9c7f-b326e1d86f3f service cinder] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:20.578538 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 889/1806] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:35:20 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:35:20.579578 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fb0685-703c-4763-9c7f-b326e1d86f3f service cinder] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:20.582443 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-43fb0685-703c-4763-9c7f-b326e1d86f3f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:20.650343 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c5ce1-c019-4a6f-89ad-120484705e8b service cinder] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:20.660604 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eed6391-6242-496a-af16-15604c4e9375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:20.662507 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed6391-6242-496a-af16-15604c4e9375 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:20.662911 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed6391-6242-496a-af16-15604c4e9375 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:20.663706 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed6391-6242-496a-af16-15604c4e9375 admin admin] PATH_INFO: `/v3/users/c14ce27ccd4f4b409863582212916e43` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:20.665550 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eed6391-6242-496a-af16-15604c4e9375 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c14ce27ccd4f4b409863582212916e43)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:20.668479 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eed6391-6242-496a-af16-15604c4e9375 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:20.806618 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-1eed6391-6242-496a-af16-15604c4e9375 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c14ce27ccd4f4b409863582212916e43'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:20.806618 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-1eed6391-6242-496a-af16-15604c4e9375 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c14ce27ccd4f4b409863582212916e43'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:20.813905 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fb0685-703c-4763-9c7f-b326e1d86f3f service cinder] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:20.835743 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8722f84a-aabb-494c-9b37-977d666d6f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:20.838385 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-1eed6391-6242-496a-af16-15604c4e9375 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c14ce27ccd4f4b409863582212916e43'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:20.838547 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722f84a-aabb-494c-9b37-977d666d6f16 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:20.838874 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722f84a-aabb-494c-9b37-977d666d6f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:20.839164 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722f84a-aabb-494c-9b37-977d666d6f16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:20.842839 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8722f84a-aabb-494c-9b37-977d666d6f16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:20.850065 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8722f84a-aabb-494c-9b37-977d666d6f16 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:20.865854 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-1eed6391-6242-496a-af16-15604c4e9375 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c14ce27ccd4f4b409863582212916e43'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:20.870370 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:20.886321 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-1eed6391-6242-496a-af16-15604c4e9375 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c14ce27ccd4f4b409863582212916e43'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:20.901439 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 918/1807] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:35:20 2022] DELETE /identity/v3/users/c14ce27ccd4f4b409863582212916e43 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:20.903414 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 890/1808] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:35:20 2022] GET /identity/v3/roles => generated 1420 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:35:20.907567 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eed6391-6242-496a-af16-15604c4e9375 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:20.916812 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-1eed6391-6242-496a-af16-15604c4e9375 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:20.926428 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668115f-9f82-4341-87ff-a2f7d7d13be4 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:20.927087 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668115f-9f82-4341-87ff-a2f7d7d13be4 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:20.927567 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668115f-9f82-4341-87ff-a2f7d7d13be4 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:20.930062 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 891/1809] 10.222.0.26 () {54 vars in 912 bytes} [Fri Jul 1 19:35:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:35:20.937983 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4d9a4-5d47-48bd-ad05-50b74fdd0e0a None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:20.939148 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4d9a4-5d47-48bd-ad05-50b74fdd0e0a None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:20.939904 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4d9a4-5d47-48bd-ad05-50b74fdd0e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:21.009867 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-d8e4d9a4-5d47-48bd-ad05-50b74fdd0e0a None None] MFA Rules not processed for user `4557d17438a249ee8f75927449a1a059`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:21.023500 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-d8e4d9a4-5d47-48bd-ad05-50b74fdd0e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:21.028691 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eed6391-6242-496a-af16-15604c4e9375 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:21.054033 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4f5a5f-fdd8-4e56-b0ac-69c2ef3e924c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:21.055023 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4f5a5f-fdd8-4e56-b0ac-69c2ef3e924c admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:21.055411 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4f5a5f-fdd8-4e56-b0ac-69c2ef3e924c admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:21.055726 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4f5a5f-fdd8-4e56-b0ac-69c2ef3e924c admin admin] PATH_INFO: `/v3/projects/026d368c92f04c2f92b777c4a963b933/users/6035b68ca0b44f1ea68d15e373dc9351/roles/6cb03785fb184ef587509b3174622f69` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:21.069059 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4f5a5f-fdd8-4e56-b0ac-69c2ef3e924c admin admin] RBAC: Authorizing `identity:create_grant(project_id=026d368c92f04c2f92b777c4a963b933, user_id=6035b68ca0b44f1ea68d15e373dc9351, role_id=6cb03785fb184ef587509b3174622f69)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:21.072167 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4f5a5f-fdd8-4e56-b0ac-69c2ef3e924c admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:21.113664 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 919/1810] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:35:20 2022] PUT /identity/v3/projects/026d368c92f04c2f92b777c4a963b933/users/6035b68ca0b44f1ea68d15e373dc9351/roles/6cb03785fb184ef587509b3174622f69 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:21.117630 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2089764-2a17-4e57-bede-3300b2d0f1bf None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:21.119261 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2089764-2a17-4e57-bede-3300b2d0f1bf None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:21.119261 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2089764-2a17-4e57-bede-3300b2d0f1bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:21.136018 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:21.160645 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 892/1811] 10.222.0.26 () {58 vars in 1009 bytes} [Fri Jul 1 19:35:20 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:35:21.170810 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-d2089764-2a17-4e57-bede-3300b2d0f1bf None None] MFA Rules not processed for user `6035b68ca0b44f1ea68d15e373dc9351`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:21.172547 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-d2089764-2a17-4e57-bede-3300b2d0f1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:21.174126 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e4d9a4-5d47-48bd-ad05-50b74fdd0e0a None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:21.175810 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-d8e4d9a4-5d47-48bd-ad05-50b74fdd0e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:21.194630 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e4d9a4-5d47-48bd-ad05-50b74fdd0e0a None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:21.269354 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa2daa-867a-471c-83fc-ee7ad97b4cb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:21.269973 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa2daa-867a-471c-83fc-ee7ad97b4cb6 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:21.270506 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa2daa-867a-471c-83fc-ee7ad97b4cb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:21.271242 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa2daa-867a-471c-83fc-ee7ad97b4cb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:21.284945 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fa2daa-867a-471c-83fc-ee7ad97b4cb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:21.287991 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fa2daa-867a-471c-83fc-ee7ad97b4cb6 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:21.305815 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 893/1812] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:35:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 19:35:21.354533 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 920/1813] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:21 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:35:21.442147 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa2daa-867a-471c-83fc-ee7ad97b4cb6 service neutron] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:21.444430 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-96fa2daa-867a-471c-83fc-ee7ad97b4cb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:21.495391 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2089764-2a17-4e57-bede-3300b2d0f1bf None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:21.495391 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-d2089764-2a17-4e57-bede-3300b2d0f1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:21.632900 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa2daa-867a-471c-83fc-ee7ad97b4cb6 service neutron] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:21.642622 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3c5846-88d6-4f15-90d6-b26a9922858f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:21.643278 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c5846-88d6-4f15-90d6-b26a9922858f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:21.643629 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c5846-88d6-4f15-90d6-b26a9922858f admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:21.644043 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c5846-88d6-4f15-90d6-b26a9922858f admin admin] PATH_INFO: `/v3/projects/2b2212f9b0cd4c8a9559e6b00ca7b448` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:21.646872 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3c5846-88d6-4f15-90d6-b26a9922858f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b2212f9b0cd4c8a9559e6b00ca7b448)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:21.650538 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3c5846-88d6-4f15-90d6-b26a9922858f admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:21.659092 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2089764-2a17-4e57-bede-3300b2d0f1bf None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:21.663676 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadd452f-3347-4d6c-ac36-e899445e59d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a3ed285ee4c4d04abf7daf0aeb9fb7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:21.664623 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd452f-3347-4d6c-ac36-e899445e59d6 service cinder] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:21.664934 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd452f-3347-4d6c-ac36-e899445e59d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:21.665208 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd452f-3347-4d6c-ac36-e899445e59d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:21.697298 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadd452f-3347-4d6c-ac36-e899445e59d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:21.699018 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadd452f-3347-4d6c-ac36-e899445e59d6 service cinder] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:21.714949 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 921/1814] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:35:21 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 19:35:21.729960 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-2d3c5846-88d6-4f15-90d6-b26a9922858f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b2212f9b0cd4c8a9559e6b00ca7b448', 'request_id': 'req-2d3c5846-88d6-4f15-90d6-b26a9922858f'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:21.745834 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-2d3c5846-88d6-4f15-90d6-b26a9922858f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b2212f9b0cd4c8a9559e6b00ca7b448', 'request_id': 'req-2d3c5846-88d6-4f15-90d6-b26a9922858f'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:21.757608 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-2d3c5846-88d6-4f15-90d6-b26a9922858f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b2212f9b0cd4c8a9559e6b00ca7b448', 'request_id': 'req-2d3c5846-88d6-4f15-90d6-b26a9922858f'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:21.799430 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-2d3c5846-88d6-4f15-90d6-b26a9922858f admin admin] The token cache is being invalidate because project 2b2212f9b0cd4c8a9559e6b00ca7b448 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:35:21.800154 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-2d3c5846-88d6-4f15-90d6-b26a9922858f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:21.800983 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-2d3c5846-88d6-4f15-90d6-b26a9922858f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:21.804726 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 894/1815] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:35:21 2022] DELETE /identity/v3/projects/2b2212f9b0cd4c8a9559e6b00ca7b448 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:21.808404 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadd452f-3347-4d6c-ac36-e899445e59d6 service cinder] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:21.832913 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadd452f-3347-4d6c-ac36-e899445e59d6 service cinder] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:21.867757 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:INSERT=2,keystone:DELETE=1,keystone:SELECT=97 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:22.021709 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c09bae2-a32a-46c8-8ccd-ac8e4faa681e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:22.022836 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09bae2-a32a-46c8-8ccd-ac8e4faa681e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:22.023308 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09bae2-a32a-46c8-8ccd-ac8e4faa681e admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:22.023684 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09bae2-a32a-46c8-8ccd-ac8e4faa681e admin admin] PATH_INFO: `/v3/users/5753d5252e2b4bb6b4150bd6e6c978e6` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:22.033511 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c09bae2-a32a-46c8-8ccd-ac8e4faa681e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5753d5252e2b4bb6b4150bd6e6c978e6)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:22.033511 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c09bae2-a32a-46c8-8ccd-ac8e4faa681e admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:22.167551 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-6c09bae2-a32a-46c8-8ccd-ac8e4faa681e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5753d5252e2b4bb6b4150bd6e6c978e6'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:22.168669 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-6c09bae2-a32a-46c8-8ccd-ac8e4faa681e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5753d5252e2b4bb6b4150bd6e6c978e6'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:22.207623 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-6c09bae2-a32a-46c8-8ccd-ac8e4faa681e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5753d5252e2b4bb6b4150bd6e6c978e6'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:22.219834 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-6c09bae2-a32a-46c8-8ccd-ac8e4faa681e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5753d5252e2b4bb6b4150bd6e6c978e6'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:22.236181 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-6c09bae2-a32a-46c8-8ccd-ac8e4faa681e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5753d5252e2b4bb6b4150bd6e6c978e6'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:22.251337 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 922/1816] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:35:21 2022] DELETE /identity/v3/users/5753d5252e2b4bb6b4150bd6e6c978e6 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:22.713451 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3c5846-88d6-4f15-90d6-b26a9922858f admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:22.715783 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-2d3c5846-88d6-4f15-90d6-b26a9922858f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:22.772662 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c09bae2-a32a-46c8-8ccd-ac8e4faa681e admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:22.775096 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-6c09bae2-a32a-46c8-8ccd-ac8e4faa681e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:22.796574 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3c5846-88d6-4f15-90d6-b26a9922858f admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:22.848725 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:22.934343 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c09bae2-a32a-46c8-8ccd-ac8e4faa681e admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:22.941769 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b94e109-891b-4905-9c57-507d33e9b788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:22.943602 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b94e109-891b-4905-9c57-507d33e9b788 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:22.944021 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b94e109-891b-4905-9c57-507d33e9b788 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:22.944489 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b94e109-891b-4905-9c57-507d33e9b788 admin admin] PATH_INFO: `/v3/users/fd772d060fbd4ab3a6bb2f533367c0ac` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:22.946666 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b94e109-891b-4905-9c57-507d33e9b788 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd772d060fbd4ab3a6bb2f533367c0ac)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:22.949157 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d443abd-e36b-4944-919f-d47ec7a91762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:22.950682 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d443abd-e36b-4944-919f-d47ec7a91762 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:22.951226 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b94e109-891b-4905-9c57-507d33e9b788 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:22.951916 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d443abd-e36b-4944-919f-d47ec7a91762 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:22.952238 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d443abd-e36b-4944-919f-d47ec7a91762 admin admin] PATH_INFO: `/v3/projects/016b0d91d0a5492fb9f274633a6d720a` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:22.954609 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d443abd-e36b-4944-919f-d47ec7a91762 admin admin] RBAC: Authorizing `identity:delete_project(project_id=016b0d91d0a5492fb9f274633a6d720a)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:22.962779 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d443abd-e36b-4944-919f-d47ec7a91762 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:23.042317 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:23.078298 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-0b94e109-891b-4905-9c57-507d33e9b788 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd772d060fbd4ab3a6bb2f533367c0ac'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:23.079131 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-0b94e109-891b-4905-9c57-507d33e9b788 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd772d060fbd4ab3a6bb2f533367c0ac'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:23.099110 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-7d443abd-e36b-4944-919f-d47ec7a91762 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '016b0d91d0a5492fb9f274633a6d720a', 'request_id': 'req-7d443abd-e36b-4944-919f-d47ec7a91762'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:23.107248 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-0b94e109-891b-4905-9c57-507d33e9b788 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd772d060fbd4ab3a6bb2f533367c0ac'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:23.113345 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-7d443abd-e36b-4944-919f-d47ec7a91762 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '016b0d91d0a5492fb9f274633a6d720a', 'request_id': 'req-7d443abd-e36b-4944-919f-d47ec7a91762'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:23.127474 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-0b94e109-891b-4905-9c57-507d33e9b788 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd772d060fbd4ab3a6bb2f533367c0ac'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:23.129405 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-7d443abd-e36b-4944-919f-d47ec7a91762 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '016b0d91d0a5492fb9f274633a6d720a', 'request_id': 'req-7d443abd-e36b-4944-919f-d47ec7a91762'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:23.141088 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-0b94e109-891b-4905-9c57-507d33e9b788 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd772d060fbd4ab3a6bb2f533367c0ac'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:23.156469 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 923/1817] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:35:22 2022] DELETE /identity/v3/users/fd772d060fbd4ab3a6bb2f533367c0ac => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:23.161653 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d4b01-15a3-42ac-a895-3a6c446f6f62 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:23.161988 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d4b01-15a3-42ac-a895-3a6c446f6f62 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:23.162289 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d4b01-15a3-42ac-a895-3a6c446f6f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:23.171160 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-7d443abd-e36b-4944-919f-d47ec7a91762 admin admin] The token cache is being invalidate because project 016b0d91d0a5492fb9f274633a6d720a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:35:23.172995 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-7d443abd-e36b-4944-919f-d47ec7a91762 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:23.173990 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-7d443abd-e36b-4944-919f-d47ec7a91762 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:23.177883 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 895/1818] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:35:22 2022] DELETE /identity/v3/projects/016b0d91d0a5492fb9f274633a6d720a => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:23.188180 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-810d4b01-15a3-42ac-a895-3a6c446f6f62 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:23.189010 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8184c7-a052-49cc-9140-97e601681f10 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:23.189339 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8184c7-a052-49cc-9140-97e601681f10 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:23.189831 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8184c7-a052-49cc-9140-97e601681f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:23.190587 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-810d4b01-15a3-42ac-a895-3a6c446f6f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:23.211166 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-1e8184c7-a052-49cc-9140-97e601681f10 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:23.212430 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-1e8184c7-a052-49cc-9140-97e601681f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:23.287420 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 924/1819] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:35:23.298748 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d4b01-15a3-42ac-a895-3a6c446f6f62 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:23.300583 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-810d4b01-15a3-42ac-a895-3a6c446f6f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:23.348940 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 896/1820] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:35:23.369993 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ae899-1488-4010-967a-3363a2fce638 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:23.370374 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ae899-1488-4010-967a-3363a2fce638 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:23.370784 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ae899-1488-4010-967a-3363a2fce638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:23.405989 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-ab0ae899-1488-4010-967a-3363a2fce638 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:23.407796 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-ab0ae899-1488-4010-967a-3363a2fce638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:23.409140 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d4b01-15a3-42ac-a895-3a6c446f6f62 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:23.414041 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95eda07-0e5f-4e2a-af14-b4381b4853ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:23.414822 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95eda07-0e5f-4e2a-af14-b4381b4853ac service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:23.415249 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95eda07-0e5f-4e2a-af14-b4381b4853ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:23.415541 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95eda07-0e5f-4e2a-af14-b4381b4853ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:23.429749 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 897/1821] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:35:23.430036 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95eda07-0e5f-4e2a-af14-b4381b4853ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:23.431675 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95eda07-0e5f-4e2a-af14-b4381b4853ac service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:23.435034 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ae899-1488-4010-967a-3363a2fce638 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:23.448900 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 925/1822] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:35:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:35:23.451883 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ae899-1488-4010-967a-3363a2fce638 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:23.465809 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c00fdc-52d4-45a3-80f2-2479c874d0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:23.466492 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c00fdc-52d4-45a3-80f2-2479c874d0a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:23.466793 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c00fdc-52d4-45a3-80f2-2479c874d0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:23.467565 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c00fdc-52d4-45a3-80f2-2479c874d0a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:23.468308 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c00fdc-52d4-45a3-80f2-2479c874d0a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:35:23.468616 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c00fdc-52d4-45a3-80f2-2479c874d0a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:23.477251 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c00fdc-52d4-45a3-80f2-2479c874d0a2 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:23.509433 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 898/1823] 10.222.0.26 () {58 vars in 1152 bytes} [Fri Jul 1 19:35:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:35:23.510887 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95eda07-0e5f-4e2a-af14-b4381b4853ac service neutron] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:23.531979 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95eda07-0e5f-4e2a-af14-b4381b4853ac service neutron] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:23.541898 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d286f-ee56-43b1-a5ea-b0a8823219d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:23.543886 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d286f-ee56-43b1-a5ea-b0a8823219d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:23.544895 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d286f-ee56-43b1-a5ea-b0a8823219d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:23.546903 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d286f-ee56-43b1-a5ea-b0a8823219d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:23.548375 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40d286f-ee56-43b1-a5ea-b0a8823219d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:23.552117 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40d286f-ee56-43b1-a5ea-b0a8823219d3 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:23.610394 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 926/1824] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:35:23 2022] POST /identity/v3/projects => generated 379 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:35:23.611269 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c00fdc-52d4-45a3-80f2-2479c874d0a2 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:23.651379 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c00fdc-52d4-45a3-80f2-2479c874d0a2 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:23.741717 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d286f-ee56-43b1-a5ea-b0a8823219d3 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:23.744606 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-f40d286f-ee56-43b1-a5ea-b0a8823219d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:23.782911 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:23.836271 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:23.874748 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d286f-ee56-43b1-a5ea-b0a8823219d3 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:23.877334 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ee5c8-32ed-457e-a2fc-31df5c485f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:23.882127 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ee5c8-32ed-457e-a2fc-31df5c485f3e admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:23.883608 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ee5c8-32ed-457e-a2fc-31df5c485f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:23.883986 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ee5c8-32ed-457e-a2fc-31df5c485f3e admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:23.888048 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a3d4e2-b31b-4841-8e0a-772f739b8e7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a3ed285ee4c4d04abf7daf0aeb9fb7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:23.889030 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3d4e2-b31b-4841-8e0a-772f739b8e7a service cinder] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:23.889601 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3d4e2-b31b-4841-8e0a-772f739b8e7a service cinder] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:23.890044 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3d4e2-b31b-4841-8e0a-772f739b8e7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:23.890883 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2ee5c8-32ed-457e-a2fc-31df5c485f3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:23.894367 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2ee5c8-32ed-457e-a2fc-31df5c485f3e admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:23.900986 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-c1a3d4e2-b31b-4841-8e0a-772f739b8e7a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:24.003554 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 899/1825] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:35:23 2022] POST /identity/v3/users => generated 290 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:35:24.012631 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ee5c8-32ed-457e-a2fc-31df5c485f3e admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:24.039388 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ee5c8-32ed-457e-a2fc-31df5c485f3e admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:24.053862 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1dcc38-7b0e-4f41-b95f-97118397b974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:24.055962 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1dcc38-7b0e-4f41-b95f-97118397b974 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:24.056260 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1dcc38-7b0e-4f41-b95f-97118397b974 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:24.056544 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1dcc38-7b0e-4f41-b95f-97118397b974 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:24.057318 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1dcc38-7b0e-4f41-b95f-97118397b974 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:24.058967 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1dcc38-7b0e-4f41-b95f-97118397b974 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:24.067663 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a3d4e2-b31b-4841-8e0a-772f739b8e7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:24.070205 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a3d4e2-b31b-4841-8e0a-772f739b8e7a service cinder] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:24.084032 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 927/1826] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:35:23 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 19:35:24.120626 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 900/1827] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:35:24 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:35:24.124999 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a3d4e2-b31b-4841-8e0a-772f739b8e7a service cinder] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:24.145084 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a3d4e2-b31b-4841-8e0a-772f739b8e7a service cinder] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:24.172603 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a9491-a477-4033-8dfd-8353f0a9b1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:24.176658 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a9491-a477-4033-8dfd-8353f0a9b1bc admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:24.177117 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a9491-a477-4033-8dfd-8353f0a9b1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:24.178721 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a9491-a477-4033-8dfd-8353f0a9b1bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:24.181963 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375a9491-a477-4033-8dfd-8353f0a9b1bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:24.189703 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375a9491-a477-4033-8dfd-8353f0a9b1bc admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:24.214855 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 928/1828] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:35:24 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:35:24.219965 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1dcc38-7b0e-4f41-b95f-97118397b974 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:24.239385 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1dcc38-7b0e-4f41-b95f-97118397b974 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:24.262551 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa98a0c-acc9-45fb-854d-cf20b2f6b9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:24.264740 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa98a0c-acc9-45fb-854d-cf20b2f6b9f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:24.265668 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa98a0c-acc9-45fb-854d-cf20b2f6b9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:24.266591 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa98a0c-acc9-45fb-854d-cf20b2f6b9f2 admin admin] PATH_INFO: `/v3/projects/7fe35a1c6e294ab48103132138927bdf/users/a293ca8146854a3d9c3c7c3fa2e5dbbd/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:24.322757 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa98a0c-acc9-45fb-854d-cf20b2f6b9f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fe35a1c6e294ab48103132138927bdf, user_id=a293ca8146854a3d9c3c7c3fa2e5dbbd, role_id=4cbf6ec846eb4b7c8cc52e9bfd6f076f)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:24.331420 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa98a0c-acc9-45fb-854d-cf20b2f6b9f2 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:24.393287 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 901/1829] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:35:24 2022] PUT /identity/v3/projects/7fe35a1c6e294ab48103132138927bdf/users/a293ca8146854a3d9c3c7c3fa2e5dbbd/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:24.403282 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d7bc58-b5e5-4089-a552-c2e86da69700 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:24.403576 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d7bc58-b5e5-4089-a552-c2e86da69700 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:24.403859 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d7bc58-b5e5-4089-a552-c2e86da69700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:24.475555 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-e2d7bc58-b5e5-4089-a552-c2e86da69700 None None] MFA Rules not processed for user `a293ca8146854a3d9c3c7c3fa2e5dbbd`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:24.476815 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-e2d7bc58-b5e5-4089-a552-c2e86da69700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:24.698302 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 929/1830] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:35:24.702902 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa98a0c-acc9-45fb-854d-cf20b2f6b9f2 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:24.953369 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa98a0c-acc9-45fb-854d-cf20b2f6b9f2 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:24.970400 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c966ac7-9ac6-42b4-a63a-61cf0b97bb11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:24.972267 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c966ac7-9ac6-42b4-a63a-61cf0b97bb11 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:24.973166 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c966ac7-9ac6-42b4-a63a-61cf0b97bb11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:24.974198 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c966ac7-9ac6-42b4-a63a-61cf0b97bb11 admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:24.976387 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c966ac7-9ac6-42b4-a63a-61cf0b97bb11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:24.981342 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c966ac7-9ac6-42b4-a63a-61cf0b97bb11 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:25.042857 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d7bc58-b5e5-4089-a552-c2e86da69700 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:25.046502 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-e2d7bc58-b5e5-4089-a552-c2e86da69700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:25.061430 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 902/1831] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:35:24 2022] POST /identity/v3/projects => generated 381 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:35:25.065281 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c966ac7-9ac6-42b4-a63a-61cf0b97bb11 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:25.075991 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d7bc58-b5e5-4089-a552-c2e86da69700 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:25.339452 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92831f1e-c4e4-443d-a2fb-bf022e02c2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:25.342482 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92831f1e-c4e4-443d-a2fb-bf022e02c2bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:25.343054 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92831f1e-c4e4-443d-a2fb-bf022e02c2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:25.343416 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c966ac7-9ac6-42b4-a63a-61cf0b97bb11 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:25.343879 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92831f1e-c4e4-443d-a2fb-bf022e02c2bc admin admin] PATH_INFO: `/v3/projects/3c927d015c78419bb30a069d3444e9a7` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:25.350830 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92831f1e-c4e4-443d-a2fb-bf022e02c2bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c927d015c78419bb30a069d3444e9a7)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:25.351920 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212de0c8-a404-4595-946f-d930557b50f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:25.352875 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212de0c8-a404-4595-946f-d930557b50f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:25.353308 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212de0c8-a404-4595-946f-d930557b50f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:25.353703 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212de0c8-a404-4595-946f-d930557b50f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:25.354482 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212de0c8-a404-4595-946f-d930557b50f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:25.354710 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92831f1e-c4e4-443d-a2fb-bf022e02c2bc admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:25.357353 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212de0c8-a404-4595-946f-d930557b50f5 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:25.361746 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:25.390660 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 903/1832] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:35:25 2022] POST /identity/v3/users => generated 297 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:35:25.396594 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212de0c8-a404-4595-946f-d930557b50f5 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:25.414565 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:25.432794 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212de0c8-a404-4595-946f-d930557b50f5 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:25.474218 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-92831f1e-c4e4-443d-a2fb-bf022e02c2bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c927d015c78419bb30a069d3444e9a7', 'request_id': 'req-92831f1e-c4e4-443d-a2fb-bf022e02c2bc'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:25.499489 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-92831f1e-c4e4-443d-a2fb-bf022e02c2bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c927d015c78419bb30a069d3444e9a7', 'request_id': 'req-92831f1e-c4e4-443d-a2fb-bf022e02c2bc'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:25.513480 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-92831f1e-c4e4-443d-a2fb-bf022e02c2bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c927d015c78419bb30a069d3444e9a7', 'request_id': 'req-92831f1e-c4e4-443d-a2fb-bf022e02c2bc'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:25.550673 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-92831f1e-c4e4-443d-a2fb-bf022e02c2bc admin admin] The token cache is being invalidate because project 3c927d015c78419bb30a069d3444e9a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:35:25.551249 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-92831f1e-c4e4-443d-a2fb-bf022e02c2bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:25.554343 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-92831f1e-c4e4-443d-a2fb-bf022e02c2bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:25.559201 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 930/1833] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:35:25 2022] DELETE /identity/v3/projects/3c927d015c78419bb30a069d3444e9a7 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 19:35:25.567553 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92831f1e-c4e4-443d-a2fb-bf022e02c2bc admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:25.570041 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-92831f1e-c4e4-443d-a2fb-bf022e02c2bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:25.622428 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe66f3-4914-419f-966c-46f0355f7b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:25.623426 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe66f3-4914-419f-966c-46f0355f7b30 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:25.625156 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe66f3-4914-419f-966c-46f0355f7b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:25.625608 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe66f3-4914-419f-966c-46f0355f7b30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:25.629186 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfe66f3-4914-419f-966c-46f0355f7b30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:25.634500 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfe66f3-4914-419f-966c-46f0355f7b30 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:25.664112 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 904/1834] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:35:25 2022] GET /identity/v3/roles => generated 1420 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:35:25.669474 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe66f3-4914-419f-966c-46f0355f7b30 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:25.675233 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-acfe66f3-4914-419f-966c-46f0355f7b30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:25.699598 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe66f3-4914-419f-966c-46f0355f7b30 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:25.719533 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1033ac-64fa-4e6d-aaf1-f06ddd2cb24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:25.720454 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1033ac-64fa-4e6d-aaf1-f06ddd2cb24c admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:25.720748 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1033ac-64fa-4e6d-aaf1-f06ddd2cb24c admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:25.721034 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1033ac-64fa-4e6d-aaf1-f06ddd2cb24c admin admin] PATH_INFO: `/v3/projects/5b10dd0e76884d5f920d8adc0a5af705/users/134bd69d01b9489781fa85e4a5e45339/roles/6cb03785fb184ef587509b3174622f69` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:25.744756 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92831f1e-c4e4-443d-a2fb-bf022e02c2bc admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:25.755299 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71acd620-9fe4-4e2e-bc7e-e24a30864276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:25.757417 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71acd620-9fe4-4e2e-bc7e-e24a30864276 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:25.758236 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71acd620-9fe4-4e2e-bc7e-e24a30864276 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:25.759557 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71acd620-9fe4-4e2e-bc7e-e24a30864276 admin admin] PATH_INFO: `/v3/users/6035b68ca0b44f1ea68d15e373dc9351` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:25.762709 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71acd620-9fe4-4e2e-bc7e-e24a30864276 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6035b68ca0b44f1ea68d15e373dc9351)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:25.767293 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71acd620-9fe4-4e2e-bc7e-e24a30864276 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:25.771849 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1033ac-64fa-4e6d-aaf1-f06ddd2cb24c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b10dd0e76884d5f920d8adc0a5af705, user_id=134bd69d01b9489781fa85e4a5e45339, role_id=6cb03785fb184ef587509b3174622f69)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:25.778031 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1033ac-64fa-4e6d-aaf1-f06ddd2cb24c admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:25.820075 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 905/1835] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:35:25 2022] PUT /identity/v3/projects/5b10dd0e76884d5f920d8adc0a5af705/users/134bd69d01b9489781fa85e4a5e45339/roles/6cb03785fb184ef587509b3174622f69 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:25.820976 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1033ac-64fa-4e6d-aaf1-f06ddd2cb24c admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:25.918767 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-71acd620-9fe4-4e2e-bc7e-e24a30864276 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6035b68ca0b44f1ea68d15e373dc9351'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:25.921123 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-71acd620-9fe4-4e2e-bc7e-e24a30864276 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6035b68ca0b44f1ea68d15e373dc9351'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:25.974082 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-71acd620-9fe4-4e2e-bc7e-e24a30864276 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6035b68ca0b44f1ea68d15e373dc9351'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:26.000360 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-71acd620-9fe4-4e2e-bc7e-e24a30864276 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6035b68ca0b44f1ea68d15e373dc9351'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:26.031895 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-71acd620-9fe4-4e2e-bc7e-e24a30864276 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6035b68ca0b44f1ea68d15e373dc9351'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:26.048172 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 931/1836] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:35:25 2022] DELETE /identity/v3/users/6035b68ca0b44f1ea68d15e373dc9351 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:26.061946 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1033ac-64fa-4e6d-aaf1-f06ddd2cb24c admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:26.218258 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0c777-8441-4ada-845d-eca015ea7d23 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:26.219306 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0c777-8441-4ada-845d-eca015ea7d23 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:26.220882 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0c777-8441-4ada-845d-eca015ea7d23 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:26.225699 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 932/1837] 10.222.0.26 () {54 vars in 921 bytes} [Fri Jul 1 19:35:26 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:35:26.262483 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5e90b-f4b6-46d5-9292-32fae544b697 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:26.263484 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5e90b-f4b6-46d5-9292-32fae544b697 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:26.264674 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5e90b-f4b6-46d5-9292-32fae544b697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:26.302195 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a032fc-8392-4526-873e-da402634408d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:26.303501 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a032fc-8392-4526-873e-da402634408d admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:26.303883 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a032fc-8392-4526-873e-da402634408d admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:26.304273 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a032fc-8392-4526-873e-da402634408d admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:26.317661 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a032fc-8392-4526-873e-da402634408d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:26.323557 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a032fc-8392-4526-873e-da402634408d admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:26.338703 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-5ca5e90b-f4b6-46d5-9292-32fae544b697 None None] MFA Rules not processed for user `13fd76fc7dd1410b9cde5adbaa6cb2e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:26.340597 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-5ca5e90b-f4b6-46d5-9292-32fae544b697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:26.380312 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 906/1838] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:35:25 2022] GET /identity/v3/roles => generated 1420 bytes in 559 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 19:35:26.385060 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:26.389566 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a032fc-8392-4526-873e-da402634408d admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:26.398077 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-08a032fc-8392-4526-873e-da402634408d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:26.458823 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a032fc-8392-4526-873e-da402634408d admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:26.473103 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d6f7e3-d8da-4bef-9c77-8329d68c6eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:26.475231 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d6f7e3-d8da-4bef-9c77-8329d68c6eb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:26.477320 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d6f7e3-d8da-4bef-9c77-8329d68c6eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:26.478527 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d6f7e3-d8da-4bef-9c77-8329d68c6eb3 admin admin] PATH_INFO: `/v3/projects/5b10dd0e76884d5f920d8adc0a5af705/users/134bd69d01b9489781fa85e4a5e45339/roles/6cb03785fb184ef587509b3174622f69` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:26.487927 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d6f7e3-d8da-4bef-9c77-8329d68c6eb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b10dd0e76884d5f920d8adc0a5af705, user_id=134bd69d01b9489781fa85e4a5e45339, role_id=6cb03785fb184ef587509b3174622f69)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:26.496343 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d6f7e3-d8da-4bef-9c77-8329d68c6eb3 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:26.551712 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 907/1839] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:35:26 2022] PUT /identity/v3/projects/5b10dd0e76884d5f920d8adc0a5af705/users/134bd69d01b9489781fa85e4a5e45339/roles/6cb03785fb184ef587509b3174622f69 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:26.566413 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36509fb-b52f-4a43-ac0e-10a2cdf49f20 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:26.568128 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36509fb-b52f-4a43-ac0e-10a2cdf49f20 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:26.569217 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36509fb-b52f-4a43-ac0e-10a2cdf49f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:26.604354 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:26.648633 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 933/1840] 10.222.0.26 () {58 vars in 1018 bytes} [Fri Jul 1 19:35:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:35:26.657953 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-d36509fb-b52f-4a43-ac0e-10a2cdf49f20 None None] MFA Rules not processed for user `134bd69d01b9489781fa85e4a5e45339`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:26.660774 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-d36509fb-b52f-4a43-ac0e-10a2cdf49f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:26.803904 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 908/1841] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:26 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:35:26.818460 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca5e90b-f4b6-46d5-9292-32fae544b697 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:26.820739 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-5ca5e90b-f4b6-46d5-9292-32fae544b697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:26.824917 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36509fb-b52f-4a43-ac0e-10a2cdf49f20 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:26.828509 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-d36509fb-b52f-4a43-ac0e-10a2cdf49f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:26.977519 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca5e90b-f4b6-46d5-9292-32fae544b697 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:27.070282 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b83ef8-0f70-4c90-a872-3e36fc60c092 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a3ed285ee4c4d04abf7daf0aeb9fb7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:27.071562 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b83ef8-0f70-4c90-a872-3e36fc60c092 service cinder] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:27.071981 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b83ef8-0f70-4c90-a872-3e36fc60c092 service cinder] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:27.072369 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b83ef8-0f70-4c90-a872-3e36fc60c092 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:27.100788 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b83ef8-0f70-4c90-a872-3e36fc60c092 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:27.104062 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b83ef8-0f70-4c90-a872-3e36fc60c092 service cinder] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:27.138406 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 934/1842] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:35:26 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 19:35:27.171318 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36509fb-b52f-4a43-ac0e-10a2cdf49f20 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:27.179397 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc221663-04dd-4946-91ac-bac4e92da597 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13fd76fc7dd1410b9cde5adbaa6cb2e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:27.180462 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc221663-04dd-4946-91ac-bac4e92da597 service nova] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:27.180754 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc221663-04dd-4946-91ac-bac4e92da597 service nova] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:27.181092 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc221663-04dd-4946-91ac-bac4e92da597 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:27.194097 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc221663-04dd-4946-91ac-bac4e92da597 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:27.195794 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc221663-04dd-4946-91ac-bac4e92da597 service nova] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:27.220469 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 909/1843] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:35:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:35:27.415420 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b83ef8-0f70-4c90-a872-3e36fc60c092 service cinder] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:27.416934 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-50b83ef8-0f70-4c90-a872-3e36fc60c092 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:27.551292 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b83ef8-0f70-4c90-a872-3e36fc60c092 service cinder] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:27.557874 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2badfea0-36d8-4b35-a047-f400b8440293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:27.558520 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2badfea0-36d8-4b35-a047-f400b8440293 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:27.558868 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2badfea0-36d8-4b35-a047-f400b8440293 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:27.559150 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2badfea0-36d8-4b35-a047-f400b8440293 admin admin] PATH_INFO: `/v3/projects/026d368c92f04c2f92b777c4a963b933` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:27.562380 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2badfea0-36d8-4b35-a047-f400b8440293 admin admin] RBAC: Authorizing `identity:delete_project(project_id=026d368c92f04c2f92b777c4a963b933)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:27.566574 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2badfea0-36d8-4b35-a047-f400b8440293 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:27.570426 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:27.678953 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-2badfea0-36d8-4b35-a047-f400b8440293 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '026d368c92f04c2f92b777c4a963b933', 'request_id': 'req-2badfea0-36d8-4b35-a047-f400b8440293'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:27.688506 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-2badfea0-36d8-4b35-a047-f400b8440293 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '026d368c92f04c2f92b777c4a963b933', 'request_id': 'req-2badfea0-36d8-4b35-a047-f400b8440293'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:27.697646 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-2badfea0-36d8-4b35-a047-f400b8440293 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '026d368c92f04c2f92b777c4a963b933', 'request_id': 'req-2badfea0-36d8-4b35-a047-f400b8440293'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:27.728721 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-2badfea0-36d8-4b35-a047-f400b8440293 admin admin] The token cache is being invalidate because project 026d368c92f04c2f92b777c4a963b933 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:35:27.728721 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-2badfea0-36d8-4b35-a047-f400b8440293 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:27.731138 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-2badfea0-36d8-4b35-a047-f400b8440293 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:27.736678 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 935/1844] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:35:27 2022] DELETE /identity/v3/projects/026d368c92f04c2f92b777c4a963b933 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:27.741815 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b8bba-8334-4900-b9b7-1a6aa86eb148 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:27.742128 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b8bba-8334-4900-b9b7-1a6aa86eb148 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:27.742912 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b8bba-8334-4900-b9b7-1a6aa86eb148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:27.786241 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-758b8bba-8334-4900-b9b7-1a6aa86eb148 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:27.793032 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-758b8bba-8334-4900-b9b7-1a6aa86eb148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:28.038788 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 910/1845] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:35:28.055100 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76442ed8-f550-4d97-9f23-b4af1b7ad034 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:28.055958 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76442ed8-f550-4d97-9f23-b4af1b7ad034 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:28.055958 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76442ed8-f550-4d97-9f23-b4af1b7ad034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:28.119595 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-76442ed8-f550-4d97-9f23-b4af1b7ad034 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:28.126980 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-76442ed8-f550-4d97-9f23-b4af1b7ad034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:28.147883 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 936/1846] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:35:28.152497 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758b8bba-8334-4900-b9b7-1a6aa86eb148 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:28.165757 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758b8bba-8334-4900-b9b7-1a6aa86eb148 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:28.178728 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a296439-e675-45d7-8dcf-6f9407b2d191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:28.179420 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a296439-e675-45d7-8dcf-6f9407b2d191 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:28.179706 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a296439-e675-45d7-8dcf-6f9407b2d191 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:28.179991 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a296439-e675-45d7-8dcf-6f9407b2d191 admin admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:28.180737 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a296439-e675-45d7-8dcf-6f9407b2d191 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:35:28.181051 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a296439-e675-45d7-8dcf-6f9407b2d191 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:28.182809 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a296439-e675-45d7-8dcf-6f9407b2d191 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:28.214212 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 911/1847] 10.222.0.26 () {58 vars in 1152 bytes} [Fri Jul 1 19:35:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:35:28.226835 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76442ed8-f550-4d97-9f23-b4af1b7ad034 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:28.237619 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76442ed8-f550-4d97-9f23-b4af1b7ad034 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:28.245577 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a4fe50-d257-4173-ac95-b31ac976cfa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:28.246939 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4fe50-d257-4173-ac95-b31ac976cfa0 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:28.247528 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4fe50-d257-4173-ac95-b31ac976cfa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:28.248687 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4fe50-d257-4173-ac95-b31ac976cfa0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:28.252765 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a4fe50-d257-4173-ac95-b31ac976cfa0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:28.255268 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a4fe50-d257-4173-ac95-b31ac976cfa0 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:28.320454 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 937/1848] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:35:28 2022] POST /identity/v3/projects => generated 363 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:35:28.324974 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a296439-e675-45d7-8dcf-6f9407b2d191 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:28.337111 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:28.349278 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a296439-e675-45d7-8dcf-6f9407b2d191 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:28.514923 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921759c4-3673-4c51-afc8-7da64128334e None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:28.515220 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921759c4-3673-4c51-afc8-7da64128334e None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:28.515528 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921759c4-3673-4c51-afc8-7da64128334e None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:28.517578 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 938/1849] 10.222.0.26 () {54 vars in 921 bytes} [Fri Jul 1 19:35:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 19:35:28.535498 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62782fd-f54f-4991-b463-40b11c45fb96 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:28.535928 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62782fd-f54f-4991-b463-40b11c45fb96 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:28.536063 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62782fd-f54f-4991-b463-40b11c45fb96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:28.540253 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d07669b-626a-4d0a-abc4-1dabed1333e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:28.541098 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d07669b-626a-4d0a-abc4-1dabed1333e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:28.541802 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d07669b-626a-4d0a-abc4-1dabed1333e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:28.543102 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d07669b-626a-4d0a-abc4-1dabed1333e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:28.544179 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d07669b-626a-4d0a-abc4-1dabed1333e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:28.557975 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d07669b-626a-4d0a-abc4-1dabed1333e9 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:28.585117 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-b62782fd-f54f-4991-b463-40b11c45fb96 None None] MFA Rules not processed for user `13fd76fc7dd1410b9cde5adbaa6cb2e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:28.586587 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-b62782fd-f54f-4991-b463-40b11c45fb96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:28.653937 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 912/1850] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:35:28 2022] POST /identity/v3/users => generated 282 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:35:28.658855 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d07669b-626a-4d0a-abc4-1dabed1333e9 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:28.684670 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d07669b-626a-4d0a-abc4-1dabed1333e9 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:28.712478 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3b4105-b3ee-4fb6-b4e9-577b23f84c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:28.713221 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b4105-b3ee-4fb6-b4e9-577b23f84c3b admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:28.713669 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b4105-b3ee-4fb6-b4e9-577b23f84c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:28.718104 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b4105-b3ee-4fb6-b4e9-577b23f84c3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:28.722767 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3b4105-b3ee-4fb6-b4e9-577b23f84c3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:28.734500 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3b4105-b3ee-4fb6-b4e9-577b23f84c3b admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:28.780124 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 913/1851] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:35:28 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:35:28.783899 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3b4105-b3ee-4fb6-b4e9-577b23f84c3b admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:28.787062 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-df3b4105-b3ee-4fb6-b4e9-577b23f84c3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:28.803877 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3b4105-b3ee-4fb6-b4e9-577b23f84c3b admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:28.819903 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643e6f39-49a9-4bc5-8e55-4c3a161f4ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:28.819903 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e6f39-49a9-4bc5-8e55-4c3a161f4ba6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:28.820450 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 939/1852] 10.222.0.26 () {58 vars in 1018 bytes} [Fri Jul 1 19:35:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:35:28.820542 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e6f39-49a9-4bc5-8e55-4c3a161f4ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:28.820542 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e6f39-49a9-4bc5-8e55-4c3a161f4ba6 admin admin] PATH_INFO: `/v3/users/a293ca8146854a3d9c3c7c3fa2e5dbbd` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:28.820699 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62782fd-f54f-4991-b463-40b11c45fb96 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:28.820780 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643e6f39-49a9-4bc5-8e55-4c3a161f4ba6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a293ca8146854a3d9c3c7c3fa2e5dbbd)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:28.824016 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643e6f39-49a9-4bc5-8e55-4c3a161f4ba6 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:28.855593 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62782fd-f54f-4991-b463-40b11c45fb96 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:28.870895 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4446c045-eece-4dba-a85e-0187d56f11a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:28.871737 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4446c045-eece-4dba-a85e-0187d56f11a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:28.872196 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4446c045-eece-4dba-a85e-0187d56f11a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:28.872546 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4446c045-eece-4dba-a85e-0187d56f11a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:28.873888 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4446c045-eece-4dba-a85e-0187d56f11a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:28.875821 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4446c045-eece-4dba-a85e-0187d56f11a7 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:28.897530 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 940/1853] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:35:28 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:35:28.906510 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4446c045-eece-4dba-a85e-0187d56f11a7 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:28.925846 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4446c045-eece-4dba-a85e-0187d56f11a7 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:28.931771 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-643e6f39-49a9-4bc5-8e55-4c3a161f4ba6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a293ca8146854a3d9c3c7c3fa2e5dbbd'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:28.933739 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-643e6f39-49a9-4bc5-8e55-4c3a161f4ba6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a293ca8146854a3d9c3c7c3fa2e5dbbd'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:28.950912 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-643e6f39-49a9-4bc5-8e55-4c3a161f4ba6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a293ca8146854a3d9c3c7c3fa2e5dbbd'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:28.954655 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52575eeb-d284-4070-b96c-3eb5a41e7b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:28.955586 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52575eeb-d284-4070-b96c-3eb5a41e7b9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:28.955881 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52575eeb-d284-4070-b96c-3eb5a41e7b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:28.961137 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52575eeb-d284-4070-b96c-3eb5a41e7b9c admin admin] PATH_INFO: `/v3/projects/08593f34cc0d4695b39678fb668fd9bf/users/f5612e11bf6a4ae2bb29c7ae25b1bdde/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:28.969619 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-643e6f39-49a9-4bc5-8e55-4c3a161f4ba6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a293ca8146854a3d9c3c7c3fa2e5dbbd'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:28.970332 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-643e6f39-49a9-4bc5-8e55-4c3a161f4ba6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a293ca8146854a3d9c3c7c3fa2e5dbbd'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:28.988426 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52575eeb-d284-4070-b96c-3eb5a41e7b9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=08593f34cc0d4695b39678fb668fd9bf, user_id=f5612e11bf6a4ae2bb29c7ae25b1bdde, role_id=4cbf6ec846eb4b7c8cc52e9bfd6f076f)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:28.991633 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52575eeb-d284-4070-b96c-3eb5a41e7b9c admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:29.022271 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 914/1854] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:35:28 2022] DELETE /identity/v3/users/a293ca8146854a3d9c3c7c3fa2e5dbbd => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:29.022271 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643e6f39-49a9-4bc5-8e55-4c3a161f4ba6 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:29.022651 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-643e6f39-49a9-4bc5-8e55-4c3a161f4ba6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:29.067955 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 941/1855] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:35:28 2022] PUT /identity/v3/projects/08593f34cc0d4695b39678fb668fd9bf/users/f5612e11bf6a4ae2bb29c7ae25b1bdde/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 19:35:29.069680 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93773ef3-88d2-41a9-97e8-1afe0a6090bf None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:29.070048 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93773ef3-88d2-41a9-97e8-1afe0a6090bf None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:29.070400 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93773ef3-88d2-41a9-97e8-1afe0a6090bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:29.098696 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-93773ef3-88d2-41a9-97e8-1afe0a6090bf None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:29.099973 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-93773ef3-88d2-41a9-97e8-1afe0a6090bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:29.101101 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:29.130725 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643e6f39-49a9-4bc5-8e55-4c3a161f4ba6 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:29.136397 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:29.217117 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 942/1856] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:35:29.219405 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f1206-6d0c-4be3-af2c-35d6eba4a32e None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:29.219938 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f1206-6d0c-4be3-af2c-35d6eba4a32e None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:29.220344 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f1206-6d0c-4be3-af2c-35d6eba4a32e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:29.231552 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d5a6e9-1cc3-40c0-b2b4-a3a938501615 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13fd76fc7dd1410b9cde5adbaa6cb2e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:29.232401 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d5a6e9-1cc3-40c0-b2b4-a3a938501615 service nova] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:29.232701 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d5a6e9-1cc3-40c0-b2b4-a3a938501615 service nova] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:29.232815 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d5a6e9-1cc3-40c0-b2b4-a3a938501615 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:29.235601 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-c2d5a6e9-1cc3-40c0-b2b4-a3a938501615 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:29.251105 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d5a6e9-1cc3-40c0-b2b4-a3a938501615 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:29.253129 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d5a6e9-1cc3-40c0-b2b4-a3a938501615 service nova] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:29.258321 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-0a4f1206-6d0c-4be3-af2c-35d6eba4a32e None None] MFA Rules not processed for user `f5612e11bf6a4ae2bb29c7ae25b1bdde`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:29.259760 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-0a4f1206-6d0c-4be3-af2c-35d6eba4a32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:29.265553 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 915/1857] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:35:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:35:29.266423 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d5a6e9-1cc3-40c0-b2b4-a3a938501615 service nova] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:29.267762 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-c2d5a6e9-1cc3-40c0-b2b4-a3a938501615 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:29.339693 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d5a6e9-1cc3-40c0-b2b4-a3a938501615 service nova] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:29.345485 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc9934-3a73-41bf-bd0d-cf8b64842a69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:29.346489 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc9934-3a73-41bf-bd0d-cf8b64842a69 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:29.346695 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc9934-3a73-41bf-bd0d-cf8b64842a69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:29.347034 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc9934-3a73-41bf-bd0d-cf8b64842a69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:29.361368 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddc9934-3a73-41bf-bd0d-cf8b64842a69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:29.363129 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddc9934-3a73-41bf-bd0d-cf8b64842a69 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:29.365757 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 943/1858] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:29 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:35:29.374974 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4f1206-6d0c-4be3-af2c-35d6eba4a32e None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:29.377103 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-0a4f1206-6d0c-4be3-af2c-35d6eba4a32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:29.379589 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 916/1859] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:35:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:35:29.396478 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4f1206-6d0c-4be3-af2c-35d6eba4a32e None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:29.404474 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcfb64b-2085-4300-852a-5ada7e9cfcc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:29.405523 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcfb64b-2085-4300-852a-5ada7e9cfcc8 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:29.405996 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcfb64b-2085-4300-852a-5ada7e9cfcc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:29.406443 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcfb64b-2085-4300-852a-5ada7e9cfcc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:29.407546 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcfb64b-2085-4300-852a-5ada7e9cfcc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:29.411075 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcfb64b-2085-4300-852a-5ada7e9cfcc8 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:29.443147 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 944/1860] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:35:29 2022] POST /identity/v3/projects => generated 361 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:35:29.449537 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc9934-3a73-41bf-bd0d-cf8b64842a69 service neutron] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:29.460562 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc9934-3a73-41bf-bd0d-cf8b64842a69 service neutron] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:29.532609 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0214792d-9194-4f40-8ba0-ddf9553fd7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:29.533334 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214792d-9194-4f40-8ba0-ddf9553fd7a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:29.533622 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214792d-9194-4f40-8ba0-ddf9553fd7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:29.536674 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214792d-9194-4f40-8ba0-ddf9553fd7a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:29.538145 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0214792d-9194-4f40-8ba0-ddf9553fd7a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:29.540333 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0214792d-9194-4f40-8ba0-ddf9553fd7a5 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:29.568272 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 917/1861] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:35:29 2022] POST /identity/v3/users => generated 287 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:35:29.572200 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcfb64b-2085-4300-852a-5ada7e9cfcc8 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:29.584601 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcfb64b-2085-4300-852a-5ada7e9cfcc8 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:29.589928 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770d30c1-6be5-427a-ba23-c1a51e4a302c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:29.590853 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d30c1-6be5-427a-ba23-c1a51e4a302c admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:29.591147 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d30c1-6be5-427a-ba23-c1a51e4a302c admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:29.591435 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d30c1-6be5-427a-ba23-c1a51e4a302c admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:29.592240 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770d30c1-6be5-427a-ba23-c1a51e4a302c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:29.594021 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770d30c1-6be5-427a-ba23-c1a51e4a302c admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:29.608054 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 945/1862] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:35:29 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:35:29.612269 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0214792d-9194-4f40-8ba0-ddf9553fd7a5 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:29.624290 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0214792d-9194-4f40-8ba0-ddf9553fd7a5 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:29.632563 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cd06e3-0aaf-486f-bd75-bb9a647cff0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:29.638640 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd06e3-0aaf-486f-bd75-bb9a647cff0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:29.640814 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd06e3-0aaf-486f-bd75-bb9a647cff0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:29.641182 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd06e3-0aaf-486f-bd75-bb9a647cff0d admin admin] PATH_INFO: `/v3/projects/fbe1e8daf1b64d988ce69ec1bb0693d3/users/a8dde2d76b1a4fefb2d27d3bf4a6829e/roles/6cb03785fb184ef587509b3174622f69` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:29.652773 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:29.663822 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cd06e3-0aaf-486f-bd75-bb9a647cff0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbe1e8daf1b64d988ce69ec1bb0693d3, user_id=a8dde2d76b1a4fefb2d27d3bf4a6829e, role_id=6cb03785fb184ef587509b3174622f69)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:29.667888 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cd06e3-0aaf-486f-bd75-bb9a647cff0d admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:29.697190 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 918/1863] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:35:29 2022] PUT /identity/v3/projects/fbe1e8daf1b64d988ce69ec1bb0693d3/users/a8dde2d76b1a4fefb2d27d3bf4a6829e/roles/6cb03785fb184ef587509b3174622f69 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 19:35:29.697557 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770d30c1-6be5-427a-ba23-c1a51e4a302c admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:29.718835 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770d30c1-6be5-427a-ba23-c1a51e4a302c admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:29.786242 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cd06e3-0aaf-486f-bd75-bb9a647cff0d admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:29.788974 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-43cd06e3-0aaf-486f-bd75-bb9a647cff0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:29.845283 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e3905d-8271-41f0-b651-5e922721bc3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:29.846493 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e3905d-8271-41f0-b651-5e922721bc3d admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:29.846493 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e3905d-8271-41f0-b651-5e922721bc3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:29.846837 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e3905d-8271-41f0-b651-5e922721bc3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:29.847704 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e3905d-8271-41f0-b651-5e922721bc3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:29.849788 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e3905d-8271-41f0-b651-5e922721bc3d admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:29.874082 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 946/1864] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:35:29 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:35:29.877207 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e3905d-8271-41f0-b651-5e922721bc3d admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:29.905108 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e3905d-8271-41f0-b651-5e922721bc3d admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:29.925660 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f45c5d-5da9-447f-a2b7-773517d8e7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:29.926837 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f45c5d-5da9-447f-a2b7-773517d8e7ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:29.927218 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f45c5d-5da9-447f-a2b7-773517d8e7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:29.927597 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f45c5d-5da9-447f-a2b7-773517d8e7ce admin admin] PATH_INFO: `/v3/projects/fbe1e8daf1b64d988ce69ec1bb0693d3/users/a8dde2d76b1a4fefb2d27d3bf4a6829e/roles/6cb03785fb184ef587509b3174622f69` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:29.943595 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f45c5d-5da9-447f-a2b7-773517d8e7ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbe1e8daf1b64d988ce69ec1bb0693d3, user_id=a8dde2d76b1a4fefb2d27d3bf4a6829e, role_id=6cb03785fb184ef587509b3174622f69)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:29.946697 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f45c5d-5da9-447f-a2b7-773517d8e7ce admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:29.958682 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:29.978174 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 947/1865] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:35:29 2022] PUT /identity/v3/projects/fbe1e8daf1b64d988ce69ec1bb0693d3/users/a8dde2d76b1a4fefb2d27d3bf4a6829e/roles/6cb03785fb184ef587509b3174622f69 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:29.985617 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cd06e3-0aaf-486f-bd75-bb9a647cff0d admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:29.991685 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d01f8-afe0-44ae-9da7-6fe01ca5fa91 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:29.991685 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d01f8-afe0-44ae-9da7-6fe01ca5fa91 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:29.991981 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d01f8-afe0-44ae-9da7-6fe01ca5fa91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:30.066419 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-d98d01f8-afe0-44ae-9da7-6fe01ca5fa91 None None] MFA Rules not processed for user `a8dde2d76b1a4fefb2d27d3bf4a6829e`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:30.068922 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-d98d01f8-afe0-44ae-9da7-6fe01ca5fa91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:30.085600 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a902c6c8-fc5b-46b0-b3c7-b0bd75e327e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:30.086481 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902c6c8-fc5b-46b0-b3c7-b0bd75e327e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:30.086769 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902c6c8-fc5b-46b0-b3c7-b0bd75e327e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:30.087049 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902c6c8-fc5b-46b0-b3c7-b0bd75e327e0 admin admin] PATH_INFO: `/v3/projects/7fe35a1c6e294ab48103132138927bdf` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:30.093338 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a902c6c8-fc5b-46b0-b3c7-b0bd75e327e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fe35a1c6e294ab48103132138927bdf)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:30.096685 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a902c6c8-fc5b-46b0-b3c7-b0bd75e327e0 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:30.204584 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-a902c6c8-fc5b-46b0-b3c7-b0bd75e327e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fe35a1c6e294ab48103132138927bdf', 'request_id': 'req-a902c6c8-fc5b-46b0-b3c7-b0bd75e327e0'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:30.218915 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-a902c6c8-fc5b-46b0-b3c7-b0bd75e327e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fe35a1c6e294ab48103132138927bdf', 'request_id': 'req-a902c6c8-fc5b-46b0-b3c7-b0bd75e327e0'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:30.226309 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-a902c6c8-fc5b-46b0-b3c7-b0bd75e327e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fe35a1c6e294ab48103132138927bdf', 'request_id': 'req-a902c6c8-fc5b-46b0-b3c7-b0bd75e327e0'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:30.246130 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 948/1866] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:29 2022] POST /identity/v3/auth/tokens => generated 3295 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:35:30.259491 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98d01f8-afe0-44ae-9da7-6fe01ca5fa91 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:30.261552 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-d98d01f8-afe0-44ae-9da7-6fe01ca5fa91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:30.266225 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-a902c6c8-fc5b-46b0-b3c7-b0bd75e327e0 admin admin] The token cache is being invalidate because project 7fe35a1c6e294ab48103132138927bdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:35:30.266741 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-a902c6c8-fc5b-46b0-b3c7-b0bd75e327e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:30.267314 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-a902c6c8-fc5b-46b0-b3c7-b0bd75e327e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:30.272813 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 919/1867] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:35:29 2022] DELETE /identity/v3/projects/7fe35a1c6e294ab48103132138927bdf => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 19:35:30.277824 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a902c6c8-fc5b-46b0-b3c7-b0bd75e327e0 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:30.279665 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-a902c6c8-fc5b-46b0-b3c7-b0bd75e327e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:30.359418 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98d01f8-afe0-44ae-9da7-6fe01ca5fa91 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:30.361142 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:30.430098 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a902c6c8-fc5b-46b0-b3c7-b0bd75e327e0 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:30.433460 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db671c3-555c-4f79-85e0-a622262eec55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:30.434764 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db671c3-555c-4f79-85e0-a622262eec55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:30.435378 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db671c3-555c-4f79-85e0-a622262eec55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:30.436586 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db671c3-555c-4f79-85e0-a622262eec55 admin admin] PATH_INFO: `/v3/users/134bd69d01b9489781fa85e4a5e45339` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:30.438325 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db671c3-555c-4f79-85e0-a622262eec55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=134bd69d01b9489781fa85e4a5e45339)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:30.441493 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db671c3-555c-4f79-85e0-a622262eec55 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:30.461161 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc06a7-bcb7-4dd2-8ddc-b2bc45b417de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a3ed285ee4c4d04abf7daf0aeb9fb7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:30.462725 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc06a7-bcb7-4dd2-8ddc-b2bc45b417de service cinder] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:30.462725 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc06a7-bcb7-4dd2-8ddc-b2bc45b417de service cinder] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:30.462725 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc06a7-bcb7-4dd2-8ddc-b2bc45b417de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:30.466610 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-3ebc06a7-bcb7-4dd2-8ddc-b2bc45b417de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:30.530836 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-8db671c3-555c-4f79-85e0-a622262eec55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '134bd69d01b9489781fa85e4a5e45339'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:30.531865 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-8db671c3-555c-4f79-85e0-a622262eec55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '134bd69d01b9489781fa85e4a5e45339'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:30.543182 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-8db671c3-555c-4f79-85e0-a622262eec55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '134bd69d01b9489781fa85e4a5e45339'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:30.550556 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:30.554006 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-8db671c3-555c-4f79-85e0-a622262eec55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '134bd69d01b9489781fa85e4a5e45339'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:30.556929 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-8db671c3-555c-4f79-85e0-a622262eec55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '134bd69d01b9489781fa85e4a5e45339'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:30.570648 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebc06a7-bcb7-4dd2-8ddc-b2bc45b417de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:30.572148 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebc06a7-bcb7-4dd2-8ddc-b2bc45b417de service cinder] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:30.583376 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 949/1868] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:35:30 2022] GET /identity/v3/auth/tokens => generated 3295 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 19:35:30.584394 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 920/1869] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:35:30 2022] DELETE /identity/v3/users/134bd69d01b9489781fa85e4a5e45339 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:31.054705 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc06a7-bcb7-4dd2-8ddc-b2bc45b417de service cinder] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:31.075178 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc06a7-bcb7-4dd2-8ddc-b2bc45b417de service cinder] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:31.163590 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4580a8-e64c-42a8-857f-08652acb297b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:31.164642 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4580a8-e64c-42a8-857f-08652acb297b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:31.164850 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4580a8-e64c-42a8-857f-08652acb297b admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:31.165138 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4580a8-e64c-42a8-857f-08652acb297b admin admin] PATH_INFO: `/v3/projects/5b10dd0e76884d5f920d8adc0a5af705` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:31.171017 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4580a8-e64c-42a8-857f-08652acb297b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b10dd0e76884d5f920d8adc0a5af705)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:31.174403 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4580a8-e64c-42a8-857f-08652acb297b admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:31.214889 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db671c3-555c-4f79-85e0-a622262eec55 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:31.217657 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-8db671c3-555c-4f79-85e0-a622262eec55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:31.241704 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db671c3-555c-4f79-85e0-a622262eec55 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:31.254197 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-af4580a8-e64c-42a8-857f-08652acb297b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b10dd0e76884d5f920d8adc0a5af705', 'request_id': 'req-af4580a8-e64c-42a8-857f-08652acb297b'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:31.269798 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-af4580a8-e64c-42a8-857f-08652acb297b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b10dd0e76884d5f920d8adc0a5af705', 'request_id': 'req-af4580a8-e64c-42a8-857f-08652acb297b'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:31.278176 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-af4580a8-e64c-42a8-857f-08652acb297b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b10dd0e76884d5f920d8adc0a5af705', 'request_id': 'req-af4580a8-e64c-42a8-857f-08652acb297b'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:31.328062 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-af4580a8-e64c-42a8-857f-08652acb297b admin admin] The token cache is being invalidate because project 5b10dd0e76884d5f920d8adc0a5af705 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:35:31.328672 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-af4580a8-e64c-42a8-857f-08652acb297b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:31.330416 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-af4580a8-e64c-42a8-857f-08652acb297b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:31.336705 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 950/1870] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:35:31 2022] DELETE /identity/v3/projects/5b10dd0e76884d5f920d8adc0a5af705 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:31.340049 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf07ab2-7b83-4ea2-9beb-be629c690dbe None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:31.340199 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf07ab2-7b83-4ea2-9beb-be629c690dbe None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:31.340638 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf07ab2-7b83-4ea2-9beb-be629c690dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:31.359716 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c4516e-b3d6-481b-8cfd-a1cb5b6fc968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:31.361621 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4516e-b3d6-481b-8cfd-a1cb5b6fc968 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:31.362048 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4516e-b3d6-481b-8cfd-a1cb5b6fc968 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:31.362465 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4516e-b3d6-481b-8cfd-a1cb5b6fc968 admin admin] PATH_INFO: `/v3/users/f5612e11bf6a4ae2bb29c7ae25b1bdde` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:31.364436 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c4516e-b3d6-481b-8cfd-a1cb5b6fc968 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5612e11bf6a4ae2bb29c7ae25b1bdde)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:31.366580 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c4516e-b3d6-481b-8cfd-a1cb5b6fc968 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:31.369940 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-9cf07ab2-7b83-4ea2-9beb-be629c690dbe None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:31.373343 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-9cf07ab2-7b83-4ea2-9beb-be629c690dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:31.397828 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 951/1871] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:35:31.399379 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce8865-7e6e-432d-b1bc-dd6c7c9c6c61 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:31.399678 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce8865-7e6e-432d-b1bc-dd6c7c9c6c61 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:31.399975 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce8865-7e6e-432d-b1bc-dd6c7c9c6c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:31.428657 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-38ce8865-7e6e-432d-b1bc-dd6c7c9c6c61 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:31.433422 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-38ce8865-7e6e-432d-b1bc-dd6c7c9c6c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:31.446365 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 952/1872] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:35:31.450421 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce8865-7e6e-432d-b1bc-dd6c7c9c6c61 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:31.464969 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce8865-7e6e-432d-b1bc-dd6c7c9c6c61 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:31.486115 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c27ddd-6ec2-4cf0-82fd-ae891ab30515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:31.487477 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c27ddd-6ec2-4cf0-82fd-ae891ab30515 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:31.489038 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:31.489729 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c27ddd-6ec2-4cf0-82fd-ae891ab30515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:31.490044 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c27ddd-6ec2-4cf0-82fd-ae891ab30515 admin admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:31.492493 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-34c4516e-b3d6-481b-8cfd-a1cb5b6fc968 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5612e11bf6a4ae2bb29c7ae25b1bdde'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:31.493668 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-34c4516e-b3d6-481b-8cfd-a1cb5b6fc968 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5612e11bf6a4ae2bb29c7ae25b1bdde'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:31.494008 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c27ddd-6ec2-4cf0-82fd-ae891ab30515 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:35:31.497016 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c27ddd-6ec2-4cf0-82fd-ae891ab30515 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:31.499651 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c27ddd-6ec2-4cf0-82fd-ae891ab30515 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:31.508543 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-34c4516e-b3d6-481b-8cfd-a1cb5b6fc968 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5612e11bf6a4ae2bb29c7ae25b1bdde'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:31.531815 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-34c4516e-b3d6-481b-8cfd-a1cb5b6fc968 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5612e11bf6a4ae2bb29c7ae25b1bdde'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:31.532895 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-34c4516e-b3d6-481b-8cfd-a1cb5b6fc968 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5612e11bf6a4ae2bb29c7ae25b1bdde'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:31.535888 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 953/1873] 10.222.0.26 () {58 vars in 1152 bytes} [Fri Jul 1 19:35:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:35:31.541260 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c27ddd-6ec2-4cf0-82fd-ae891ab30515 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:31.545539 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-a2c27ddd-6ec2-4cf0-82fd-ae891ab30515 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:31.565700 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c27ddd-6ec2-4cf0-82fd-ae891ab30515 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:31.575754 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a77b28-37a6-48ad-96f4-dcabd3e3cc7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:31.577589 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a77b28-37a6-48ad-96f4-dcabd3e3cc7f admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:31.578170 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 921/1874] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:35:31 2022] DELETE /identity/v3/users/f5612e11bf6a4ae2bb29c7ae25b1bdde => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:31.578488 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a77b28-37a6-48ad-96f4-dcabd3e3cc7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:31.578926 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a77b28-37a6-48ad-96f4-dcabd3e3cc7f admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:31.579851 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a77b28-37a6-48ad-96f4-dcabd3e3cc7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:31.581990 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a77b28-37a6-48ad-96f4-dcabd3e3cc7f admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:31.583665 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3475b7a1-52e7-430b-a9f2-86bbccc4ffb4 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:31.584040 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3475b7a1-52e7-430b-a9f2-86bbccc4ffb4 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:31.584524 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3475b7a1-52e7-430b-a9f2-86bbccc4ffb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:31.619807 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-3475b7a1-52e7-430b-a9f2-86bbccc4ffb4 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:31.625181 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-3475b7a1-52e7-430b-a9f2-86bbccc4ffb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:31.656444 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 954/1875] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:35:31 2022] POST /identity/v3/projects => generated 375 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:35:31.661406 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a77b28-37a6-48ad-96f4-dcabd3e3cc7f admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:31.719494 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:31.780949 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a77b28-37a6-48ad-96f4-dcabd3e3cc7f admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:31.783295 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 922/1876] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:35:31.789512 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3475b7a1-52e7-430b-a9f2-86bbccc4ffb4 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:31.791127 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-3475b7a1-52e7-430b-a9f2-86bbccc4ffb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:31.796589 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d42ae-3e2e-4e4d-84b8-52f44321c304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:31.800033 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d42ae-3e2e-4e4d-84b8-52f44321c304 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:31.801374 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d42ae-3e2e-4e4d-84b8-52f44321c304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:31.802121 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d42ae-3e2e-4e4d-84b8-52f44321c304 admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:31.805302 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5d42ae-3e2e-4e4d-84b8-52f44321c304 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:31.809576 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5d42ae-3e2e-4e4d-84b8-52f44321c304 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:31.867726 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 955/1877] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:35:31 2022] POST /identity/v3/users => generated 288 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:35:31.869801 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d42ae-3e2e-4e4d-84b8-52f44321c304 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:31.887456 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d42ae-3e2e-4e4d-84b8-52f44321c304 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:31.895970 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11f9c6c-55c3-4854-ac74-d871e9c725b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:31.896850 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f9c6c-55c3-4854-ac74-d871e9c725b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:31.897213 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f9c6c-55c3-4854-ac74-d871e9c725b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:31.897635 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f9c6c-55c3-4854-ac74-d871e9c725b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:31.898976 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11f9c6c-55c3-4854-ac74-d871e9c725b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:31.900868 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11f9c6c-55c3-4854-ac74-d871e9c725b3 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:31.927460 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 956/1878] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:35:31 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:35:31.938471 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11f9c6c-55c3-4854-ac74-d871e9c725b3 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:31.963246 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11f9c6c-55c3-4854-ac74-d871e9c725b3 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:31.964490 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3475b7a1-52e7-430b-a9f2-86bbccc4ffb4 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:31.973559 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e555791-096a-4b3f-90d9-d890aacde04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:31.974254 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e555791-096a-4b3f-90d9-d890aacde04e admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:31.975568 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e555791-096a-4b3f-90d9-d890aacde04e admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:31.975693 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e555791-096a-4b3f-90d9-d890aacde04e admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:31.980082 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e555791-096a-4b3f-90d9-d890aacde04e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:31.981916 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e555791-096a-4b3f-90d9-d890aacde04e admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:32.012583 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 957/1879] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:35:31 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:35:32.013635 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e555791-096a-4b3f-90d9-d890aacde04e admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:32.029790 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e555791-096a-4b3f-90d9-d890aacde04e admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:32.038244 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece5ba1-78e9-4879-a22b-27854fcbb57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:32.039580 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece5ba1-78e9-4879-a22b-27854fcbb57d admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:32.040528 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece5ba1-78e9-4879-a22b-27854fcbb57d admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:32.040528 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece5ba1-78e9-4879-a22b-27854fcbb57d admin admin] PATH_INFO: `/v3/projects/3f3c7e4dbcbc4c4b94c1ce660a7fe00d/users/9fcc6d1075494a89b04f65159a9036cc/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:32.054829 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c91b18-8ac7-4cb1-98ef-0a6cb06d0cad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:32.056609 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c91b18-8ac7-4cb1-98ef-0a6cb06d0cad service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:32.057125 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c91b18-8ac7-4cb1-98ef-0a6cb06d0cad service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:32.057513 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c91b18-8ac7-4cb1-98ef-0a6cb06d0cad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:32.065867 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dece5ba1-78e9-4879-a22b-27854fcbb57d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f3c7e4dbcbc4c4b94c1ce660a7fe00d, user_id=9fcc6d1075494a89b04f65159a9036cc, role_id=4cbf6ec846eb4b7c8cc52e9bfd6f076f)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:32.069552 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dece5ba1-78e9-4879-a22b-27854fcbb57d admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:32.077026 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c91b18-8ac7-4cb1-98ef-0a6cb06d0cad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:32.077026 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c91b18-8ac7-4cb1-98ef-0a6cb06d0cad service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:32.085853 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 923/1880] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:35:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:35:32.103199 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 958/1881] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:35:32 2022] PUT /identity/v3/projects/3f3c7e4dbcbc4c4b94c1ce660a7fe00d/users/9fcc6d1075494a89b04f65159a9036cc/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:32.125639 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf118262-c4bc-48e5-9dbf-8451bc7bdb16 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:32.125868 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf118262-c4bc-48e5-9dbf-8451bc7bdb16 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:32.126173 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf118262-c4bc-48e5-9dbf-8451bc7bdb16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:32.160103 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-cf118262-c4bc-48e5-9dbf-8451bc7bdb16 None None] MFA Rules not processed for user `9fcc6d1075494a89b04f65159a9036cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:32.161117 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-cf118262-c4bc-48e5-9dbf-8451bc7bdb16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:32.178670 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:32.260111 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 924/1882] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:35:32.276808 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece5ba1-78e9-4879-a22b-27854fcbb57d admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:32.282702 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-dece5ba1-78e9-4879-a22b-27854fcbb57d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:32.462074 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece5ba1-78e9-4879-a22b-27854fcbb57d admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:32.479187 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff6f40-1d7b-4579-80dc-527c9278bc6d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bbcb2463f9c46ddaaa247e4876aca48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:32.483410 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff6f40-1d7b-4579-80dc-527c9278bc6d service glance] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:32.484195 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff6f40-1d7b-4579-80dc-527c9278bc6d service glance] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:32.484656 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff6f40-1d7b-4579-80dc-527c9278bc6d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:32.519945 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fff6f40-1d7b-4579-80dc-527c9278bc6d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:32.521872 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fff6f40-1d7b-4579-80dc-527c9278bc6d service glance] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:32.544634 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 959/1883] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:35:32 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:35:32.832235 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf118262-c4bc-48e5-9dbf-8451bc7bdb16 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:32.834134 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-cf118262-c4bc-48e5-9dbf-8451bc7bdb16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:32.992627 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf118262-c4bc-48e5-9dbf-8451bc7bdb16 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:33.011766 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b193d8-ab55-49af-a449-f2a211c973ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:33.013863 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b193d8-ab55-49af-a449-f2a211c973ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:33.014386 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b193d8-ab55-49af-a449-f2a211c973ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:33.015022 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b193d8-ab55-49af-a449-f2a211c973ab admin admin] PATH_INFO: `/v3/projects/08593f34cc0d4695b39678fb668fd9bf` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:33.023070 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b193d8-ab55-49af-a449-f2a211c973ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=08593f34cc0d4695b39678fb668fd9bf)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:33.024326 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b193d8-ab55-49af-a449-f2a211c973ab admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:33.131047 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-66b193d8-ab55-49af-a449-f2a211c973ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08593f34cc0d4695b39678fb668fd9bf', 'request_id': 'req-66b193d8-ab55-49af-a449-f2a211c973ab'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:33.139078 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-66b193d8-ab55-49af-a449-f2a211c973ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08593f34cc0d4695b39678fb668fd9bf', 'request_id': 'req-66b193d8-ab55-49af-a449-f2a211c973ab'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:33.152134 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-66b193d8-ab55-49af-a449-f2a211c973ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08593f34cc0d4695b39678fb668fd9bf', 'request_id': 'req-66b193d8-ab55-49af-a449-f2a211c973ab'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:33.176596 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-66b193d8-ab55-49af-a449-f2a211c973ab admin admin] The token cache is being invalidate because project 08593f34cc0d4695b39678fb668fd9bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:35:33.177385 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-66b193d8-ab55-49af-a449-f2a211c973ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:33.178741 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-66b193d8-ab55-49af-a449-f2a211c973ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:33.182619 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 925/1884] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:35:32 2022] DELETE /identity/v3/projects/08593f34cc0d4695b39678fb668fd9bf => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:33.187531 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff6f40-1d7b-4579-80dc-527c9278bc6d service glance] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:33.202725 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff6f40-1d7b-4579-80dc-527c9278bc6d service glance] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:33.331766 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100b3afb-09ad-4e59-ab8a-99cfb6acdf1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:33.333653 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b3afb-09ad-4e59-ab8a-99cfb6acdf1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:33.334143 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b3afb-09ad-4e59-ab8a-99cfb6acdf1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:33.334806 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b3afb-09ad-4e59-ab8a-99cfb6acdf1d admin admin] PATH_INFO: `/v3/users/a8dde2d76b1a4fefb2d27d3bf4a6829e` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:33.336999 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100b3afb-09ad-4e59-ab8a-99cfb6acdf1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8dde2d76b1a4fefb2d27d3bf4a6829e)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:33.340705 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100b3afb-09ad-4e59-ab8a-99cfb6acdf1d admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:33.369429 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:33.411565 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-100b3afb-09ad-4e59-ab8a-99cfb6acdf1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8dde2d76b1a4fefb2d27d3bf4a6829e'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:33.412234 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-100b3afb-09ad-4e59-ab8a-99cfb6acdf1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8dde2d76b1a4fefb2d27d3bf4a6829e'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:33.426574 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-100b3afb-09ad-4e59-ab8a-99cfb6acdf1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8dde2d76b1a4fefb2d27d3bf4a6829e'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:33.435270 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-100b3afb-09ad-4e59-ab8a-99cfb6acdf1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8dde2d76b1a4fefb2d27d3bf4a6829e'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:33.449906 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-100b3afb-09ad-4e59-ab8a-99cfb6acdf1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8dde2d76b1a4fefb2d27d3bf4a6829e'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:33.460609 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 960/1885] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:35:33 2022] DELETE /identity/v3/users/a8dde2d76b1a4fefb2d27d3bf4a6829e => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:33.973581 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b193d8-ab55-49af-a449-f2a211c973ab admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:33.976225 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-66b193d8-ab55-49af-a449-f2a211c973ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:33.998562 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b193d8-ab55-49af-a449-f2a211c973ab admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:34.132819 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:34.167604 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36427e7b-2f52-4115-9406-9aa7de6e6466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:34.168659 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36427e7b-2f52-4115-9406-9aa7de6e6466 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:34.169054 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36427e7b-2f52-4115-9406-9aa7de6e6466 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:34.169427 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36427e7b-2f52-4115-9406-9aa7de6e6466 admin admin] PATH_INFO: `/v3/projects/fbe1e8daf1b64d988ce69ec1bb0693d3` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:34.174284 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36427e7b-2f52-4115-9406-9aa7de6e6466 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbe1e8daf1b64d988ce69ec1bb0693d3)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:34.177988 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36427e7b-2f52-4115-9406-9aa7de6e6466 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:34.311282 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-36427e7b-2f52-4115-9406-9aa7de6e6466 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbe1e8daf1b64d988ce69ec1bb0693d3', 'request_id': 'req-36427e7b-2f52-4115-9406-9aa7de6e6466'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:34.346331 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-36427e7b-2f52-4115-9406-9aa7de6e6466 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbe1e8daf1b64d988ce69ec1bb0693d3', 'request_id': 'req-36427e7b-2f52-4115-9406-9aa7de6e6466'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:34.361999 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-36427e7b-2f52-4115-9406-9aa7de6e6466 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbe1e8daf1b64d988ce69ec1bb0693d3', 'request_id': 'req-36427e7b-2f52-4115-9406-9aa7de6e6466'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:34.394009 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-36427e7b-2f52-4115-9406-9aa7de6e6466 admin admin] The token cache is being invalidate because project fbe1e8daf1b64d988ce69ec1bb0693d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:35:34.394413 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-36427e7b-2f52-4115-9406-9aa7de6e6466 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:34.398310 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-36427e7b-2f52-4115-9406-9aa7de6e6466 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:34.402658 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 926/1886] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:35:33 2022] DELETE /identity/v3/projects/fbe1e8daf1b64d988ce69ec1bb0693d3 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:34.407806 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ece6b8e-70c2-4518-9590-f9de6501f460 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:34.408418 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ece6b8e-70c2-4518-9590-f9de6501f460 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:34.408517 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ece6b8e-70c2-4518-9590-f9de6501f460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:34.448924 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-8ece6b8e-70c2-4518-9590-f9de6501f460 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:34.450487 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-8ece6b8e-70c2-4518-9590-f9de6501f460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:34.550904 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 961/1887] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:35:34.553894 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d8de7-1184-42c0-be47-6efff959e607 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:34.554256 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d8de7-1184-42c0-be47-6efff959e607 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:34.554672 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d8de7-1184-42c0-be47-6efff959e607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:34.576644 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-661d8de7-1184-42c0-be47-6efff959e607 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:34.578055 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-661d8de7-1184-42c0-be47-6efff959e607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:34.586428 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 927/1888] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:35:34.590981 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ece6b8e-70c2-4518-9590-f9de6501f460 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:34.603333 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ece6b8e-70c2-4518-9590-f9de6501f460 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:34.612933 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9901ab-4588-4497-a804-50f5600850ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:34.613814 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9901ab-4588-4497-a804-50f5600850ad admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:34.614347 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9901ab-4588-4497-a804-50f5600850ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:34.614753 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9901ab-4588-4497-a804-50f5600850ad admin admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:34.615945 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9901ab-4588-4497-a804-50f5600850ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:35:34.616463 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9901ab-4588-4497-a804-50f5600850ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:34.619145 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9901ab-4588-4497-a804-50f5600850ad admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:34.638825 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 962/1889] 10.222.0.26 () {58 vars in 1152 bytes} [Fri Jul 1 19:35:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:35:34.643900 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661d8de7-1184-42c0-be47-6efff959e607 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:34.653826 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661d8de7-1184-42c0-be47-6efff959e607 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:34.660121 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ebf325-67fe-40a6-8c35-d7b5eeae0206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:34.660802 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ebf325-67fe-40a6-8c35-d7b5eeae0206 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:34.661089 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ebf325-67fe-40a6-8c35-d7b5eeae0206 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:34.661437 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ebf325-67fe-40a6-8c35-d7b5eeae0206 admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:34.662149 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ebf325-67fe-40a6-8c35-d7b5eeae0206 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:34.664213 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ebf325-67fe-40a6-8c35-d7b5eeae0206 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:34.705295 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 928/1890] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:35:34 2022] POST /identity/v3/projects => generated 369 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:35:34.706796 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9901ab-4588-4497-a804-50f5600850ad admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:34.717856 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9901ab-4588-4497-a804-50f5600850ad admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:34.799462 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040a765e-25ca-4c4d-9814-3b5b874c4d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:34.800370 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a765e-25ca-4c4d-9814-3b5b874c4d42 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:34.800762 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a765e-25ca-4c4d-9814-3b5b874c4d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:34.801153 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a765e-25ca-4c4d-9814-3b5b874c4d42 admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:34.802120 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040a765e-25ca-4c4d-9814-3b5b874c4d42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:34.804291 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040a765e-25ca-4c4d-9814-3b5b874c4d42 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:34.832890 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 963/1891] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:35:34 2022] POST /identity/v3/users => generated 285 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:35:34.834205 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ebf325-67fe-40a6-8c35-d7b5eeae0206 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:34.849827 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ebf325-67fe-40a6-8c35-d7b5eeae0206 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:34.860111 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf33eb4-5a87-4958-9f89-e273fb9a1f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:34.861318 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf33eb4-5a87-4958-9f89-e273fb9a1f2c admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:34.861811 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf33eb4-5a87-4958-9f89-e273fb9a1f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:34.862291 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf33eb4-5a87-4958-9f89-e273fb9a1f2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:34.863464 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf33eb4-5a87-4958-9f89-e273fb9a1f2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:34.865560 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf33eb4-5a87-4958-9f89-e273fb9a1f2c admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:34.880022 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 929/1892] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:35:34 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:35:34.882918 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040a765e-25ca-4c4d-9814-3b5b874c4d42 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:34.901906 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040a765e-25ca-4c4d-9814-3b5b874c4d42 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:34.908796 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc29605-c09f-47af-97ac-0f4dbb6640c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:34.909613 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc29605-c09f-47af-97ac-0f4dbb6640c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:34.909902 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc29605-c09f-47af-97ac-0f4dbb6640c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:34.910204 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc29605-c09f-47af-97ac-0f4dbb6640c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:34.910958 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc29605-c09f-47af-97ac-0f4dbb6640c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:34.912604 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc29605-c09f-47af-97ac-0f4dbb6640c6 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:34.928891 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 964/1893] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:35:34 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:35:34.930467 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf33eb4-5a87-4958-9f89-e273fb9a1f2c admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:34.943146 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf33eb4-5a87-4958-9f89-e273fb9a1f2c admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:34.949557 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a3700f-ff4f-4963-b281-5a17240a67b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:34.951607 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a3700f-ff4f-4963-b281-5a17240a67b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:34.951607 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a3700f-ff4f-4963-b281-5a17240a67b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:34.956321 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a3700f-ff4f-4963-b281-5a17240a67b0 admin admin] PATH_INFO: `/v3/projects/d3f21287cf7f4c51b57c687deaac3ce3/users/db879b9e894c4399ae109b65238cc4b8/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:34.974867 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a3700f-ff4f-4963-b281-5a17240a67b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3f21287cf7f4c51b57c687deaac3ce3, user_id=db879b9e894c4399ae109b65238cc4b8, role_id=4cbf6ec846eb4b7c8cc52e9bfd6f076f)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:34.978695 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a3700f-ff4f-4963-b281-5a17240a67b0 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:34.994668 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 930/1894] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:35:34 2022] PUT /identity/v3/projects/d3f21287cf7f4c51b57c687deaac3ce3/users/db879b9e894c4399ae109b65238cc4b8/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:35.005785 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15952e-091d-4adc-84fb-2abb673bcbb7 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:35.006136 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15952e-091d-4adc-84fb-2abb673bcbb7 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:35.006423 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15952e-091d-4adc-84fb-2abb673bcbb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:35.014919 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:35.039064 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-ef15952e-091d-4adc-84fb-2abb673bcbb7 None None] MFA Rules not processed for user `db879b9e894c4399ae109b65238cc4b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:35.040622 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-ef15952e-091d-4adc-84fb-2abb673bcbb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:35.125210 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 965/1895] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:35 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:35:35.130434 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a3700f-ff4f-4963-b281-5a17240a67b0 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:35.212042 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a3700f-ff4f-4963-b281-5a17240a67b0 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:35.221473 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e042dab-d556-44a3-92d6-7e90b9198278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:35.222158 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e042dab-d556-44a3-92d6-7e90b9198278 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:35.222443 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e042dab-d556-44a3-92d6-7e90b9198278 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:35.222723 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e042dab-d556-44a3-92d6-7e90b9198278 admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:35.223467 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e042dab-d556-44a3-92d6-7e90b9198278 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:35.225490 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e042dab-d556-44a3-92d6-7e90b9198278 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:35.241097 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:35.261449 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 931/1896] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:35:35 2022] POST /identity/v3/projects => generated 369 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 19:35:35.265832 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef15952e-091d-4adc-84fb-2abb673bcbb7 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:35.277894 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef15952e-091d-4adc-84fb-2abb673bcbb7 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:35.348512 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d4faf8-0716-4e5b-92b2-bc5d257bdd83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:35.349207 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d4faf8-0716-4e5b-92b2-bc5d257bdd83 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:35.349520 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d4faf8-0716-4e5b-92b2-bc5d257bdd83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:35.349797 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d4faf8-0716-4e5b-92b2-bc5d257bdd83 admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:35.350502 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d4faf8-0716-4e5b-92b2-bc5d257bdd83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:35.352456 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d4faf8-0716-4e5b-92b2-bc5d257bdd83 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:35.387126 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 966/1897] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:35:35 2022] POST /identity/v3/users => generated 291 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:35:35.391901 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e042dab-d556-44a3-92d6-7e90b9198278 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:35.405782 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e042dab-d556-44a3-92d6-7e90b9198278 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:35.423271 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b26ce96-e6cb-4922-86c3-af24217763e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:35.424142 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b26ce96-e6cb-4922-86c3-af24217763e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:35.427067 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b26ce96-e6cb-4922-86c3-af24217763e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:35.427538 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b26ce96-e6cb-4922-86c3-af24217763e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:35.432628 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b26ce96-e6cb-4922-86c3-af24217763e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:35.434397 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b26ce96-e6cb-4922-86c3-af24217763e2 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:35.463329 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 932/1898] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:35:35 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 19:35:35.469050 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d4faf8-0716-4e5b-92b2-bc5d257bdd83 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:35.505607 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d4faf8-0716-4e5b-92b2-bc5d257bdd83 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:35.512464 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ca922f-0f7c-4ebd-918e-13f2390af11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:35.514366 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca922f-0f7c-4ebd-918e-13f2390af11d admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:35.514661 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca922f-0f7c-4ebd-918e-13f2390af11d admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:35.515875 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca922f-0f7c-4ebd-918e-13f2390af11d admin admin] PATH_INFO: `/v3/projects/3a96507b25be46408def68f65fc7de33/users/7ed0698058d24d9182b18284cd44ac2f/roles/6cb03785fb184ef587509b3174622f69` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:35.535433 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ca922f-0f7c-4ebd-918e-13f2390af11d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a96507b25be46408def68f65fc7de33, user_id=7ed0698058d24d9182b18284cd44ac2f, role_id=6cb03785fb184ef587509b3174622f69)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:35.538764 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ca922f-0f7c-4ebd-918e-13f2390af11d admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:35.566945 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 967/1899] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:35:35 2022] PUT /identity/v3/projects/3a96507b25be46408def68f65fc7de33/users/7ed0698058d24d9182b18284cd44ac2f/roles/6cb03785fb184ef587509b3174622f69 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:35.571219 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b26ce96-e6cb-4922-86c3-af24217763e2 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:35.585527 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b26ce96-e6cb-4922-86c3-af24217763e2 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:35.687765 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d93218c-0289-41d9-a254-f3bc96a31d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:35.689060 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d93218c-0289-41d9-a254-f3bc96a31d2a admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:35.689060 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d93218c-0289-41d9-a254-f3bc96a31d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:35.689531 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d93218c-0289-41d9-a254-f3bc96a31d2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:35.690575 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d93218c-0289-41d9-a254-f3bc96a31d2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:35.692956 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d93218c-0289-41d9-a254-f3bc96a31d2a admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:35.714290 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 933/1900] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:35:35 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:35:35.715779 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ca922f-0f7c-4ebd-918e-13f2390af11d admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:35.735581 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ca922f-0f7c-4ebd-918e-13f2390af11d admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:35.741900 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7667b99e-c4cf-4d2c-9cc1-7382c8d54231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:35.742861 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7667b99e-c4cf-4d2c-9cc1-7382c8d54231 admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:35.743153 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7667b99e-c4cf-4d2c-9cc1-7382c8d54231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:35.743537 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7667b99e-c4cf-4d2c-9cc1-7382c8d54231 admin admin] PATH_INFO: `/v3/projects/3a96507b25be46408def68f65fc7de33/users/7ed0698058d24d9182b18284cd44ac2f/roles/6cb03785fb184ef587509b3174622f69` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:35.746468 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7667b99e-c4cf-4d2c-9cc1-7382c8d54231 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a96507b25be46408def68f65fc7de33, user_id=7ed0698058d24d9182b18284cd44ac2f, role_id=6cb03785fb184ef587509b3174622f69)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:35.749779 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7667b99e-c4cf-4d2c-9cc1-7382c8d54231 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:35.762209 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 968/1901] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:35:35 2022] PUT /identity/v3/projects/3a96507b25be46408def68f65fc7de33/users/7ed0698058d24d9182b18284cd44ac2f/roles/6cb03785fb184ef587509b3174622f69 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:35.783096 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca9ad3-8cc4-4306-9a62-972d281c16e3 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:35.784351 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca9ad3-8cc4-4306-9a62-972d281c16e3 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:35.784760 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca9ad3-8cc4-4306-9a62-972d281c16e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:35.850318 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-41ca9ad3-8cc4-4306-9a62-972d281c16e3 None None] MFA Rules not processed for user `7ed0698058d24d9182b18284cd44ac2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:35.851739 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-41ca9ad3-8cc4-4306-9a62-972d281c16e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:35.969554 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 934/1902] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:35 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:35:35.985646 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7667b99e-c4cf-4d2c-9cc1-7382c8d54231 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:35.991226 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-7667b99e-c4cf-4d2c-9cc1-7382c8d54231 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:36.099623 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:36.114109 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7667b99e-c4cf-4d2c-9cc1-7382c8d54231 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:36.120423 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e38a009-d871-4203-8636-38ef5b69c96b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a3ed285ee4c4d04abf7daf0aeb9fb7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:36.121935 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e38a009-d871-4203-8636-38ef5b69c96b service cinder] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:36.122339 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e38a009-d871-4203-8636-38ef5b69c96b service cinder] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:36.122726 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e38a009-d871-4203-8636-38ef5b69c96b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:36.142448 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e38a009-d871-4203-8636-38ef5b69c96b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:36.144850 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e38a009-d871-4203-8636-38ef5b69c96b service cinder] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:36.168127 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 969/1903] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:35:35 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 19:35:36.261564 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ca9ad3-8cc4-4306-9a62-972d281c16e3 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:36.276813 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ca9ad3-8cc4-4306-9a62-972d281c16e3 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:36.282901 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e01102-8848-4d1a-ab1f-aca37a8cb4dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a3ed285ee4c4d04abf7daf0aeb9fb7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:36.283768 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e01102-8848-4d1a-ab1f-aca37a8cb4dd service cinder] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:36.284054 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e01102-8848-4d1a-ab1f-aca37a8cb4dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:36.284438 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e01102-8848-4d1a-ab1f-aca37a8cb4dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:36.393192 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e01102-8848-4d1a-ab1f-aca37a8cb4dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:36.395746 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e01102-8848-4d1a-ab1f-aca37a8cb4dd service cinder] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:36.413935 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 935/1904] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:35:36 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:35:40.059046 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e38a009-d871-4203-8636-38ef5b69c96b service cinder] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:40.061199 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-1e38a009-d871-4203-8636-38ef5b69c96b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:40.228625 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e38a009-d871-4203-8636-38ef5b69c96b service cinder] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:40.237829 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ce1c87-351f-423b-aaa8-7cdc95fd1863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:40.238928 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce1c87-351f-423b-aaa8-7cdc95fd1863 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:40.239390 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce1c87-351f-423b-aaa8-7cdc95fd1863 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:40.239763 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce1c87-351f-423b-aaa8-7cdc95fd1863 admin admin] PATH_INFO: `/v3/users/41d2687e163a4c72bc52b7733df34d04` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:40.245908 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ce1c87-351f-423b-aaa8-7cdc95fd1863 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41d2687e163a4c72bc52b7733df34d04)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:40.251471 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ce1c87-351f-423b-aaa8-7cdc95fd1863 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:40.389379 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-d6ce1c87-351f-423b-aaa8-7cdc95fd1863 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41d2687e163a4c72bc52b7733df34d04'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:40.389379 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-d6ce1c87-351f-423b-aaa8-7cdc95fd1863 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41d2687e163a4c72bc52b7733df34d04'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:40.403450 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-d6ce1c87-351f-423b-aaa8-7cdc95fd1863 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41d2687e163a4c72bc52b7733df34d04'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:40.414248 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-d6ce1c87-351f-423b-aaa8-7cdc95fd1863 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41d2687e163a4c72bc52b7733df34d04'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:40.430176 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-d6ce1c87-351f-423b-aaa8-7cdc95fd1863 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41d2687e163a4c72bc52b7733df34d04'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:40.450222 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 970/1905] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:35:40 2022] DELETE /identity/v3/users/41d2687e163a4c72bc52b7733df34d04 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:40.455240 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73548c9-313d-4a98-9f04-29533c5c20bc None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:40.456133 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73548c9-313d-4a98-9f04-29533c5c20bc None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:40.456614 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73548c9-313d-4a98-9f04-29533c5c20bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:40.476696 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:40.515569 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-e73548c9-313d-4a98-9f04-29533c5c20bc None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:40.521617 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-e73548c9-313d-4a98-9f04-29533c5c20bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:40.687849 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 936/1906] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:35:40.699279 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ce1c87-351f-423b-aaa8-7cdc95fd1863 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:40.702732 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-d6ce1c87-351f-423b-aaa8-7cdc95fd1863 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:40.812974 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73548c9-313d-4a98-9f04-29533c5c20bc None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:40.814796 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-e73548c9-313d-4a98-9f04-29533c5c20bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:40.840848 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73548c9-313d-4a98-9f04-29533c5c20bc None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:40.848052 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae678d16-a8a5-444f-971d-890a162e19f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:40.849632 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ce1c87-351f-423b-aaa8-7cdc95fd1863 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:40.850153 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae678d16-a8a5-444f-971d-890a162e19f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:40.850963 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae678d16-a8a5-444f-971d-890a162e19f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:40.851355 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae678d16-a8a5-444f-971d-890a162e19f0 admin admin] PATH_INFO: `/v3/users/bcf3571d49b8438ab86baf80ac44c18a` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:40.853386 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae678d16-a8a5-444f-971d-890a162e19f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcf3571d49b8438ab86baf80ac44c18a)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:40.855820 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8303a9e9-bf25-48b0-93ec-bea96423e96d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:40.855975 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae678d16-a8a5-444f-971d-890a162e19f0 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:40.861961 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303a9e9-bf25-48b0-93ec-bea96423e96d service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:40.861961 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303a9e9-bf25-48b0-93ec-bea96423e96d service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:40.861961 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303a9e9-bf25-48b0-93ec-bea96423e96d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:40.932612 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8303a9e9-bf25-48b0-93ec-bea96423e96d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:40.934271 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8303a9e9-bf25-48b0-93ec-bea96423e96d service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:40.976872 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 971/1907] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:35:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:35:40.985284 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-ae678d16-a8a5-444f-971d-890a162e19f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcf3571d49b8438ab86baf80ac44c18a'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:40.999232 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-ae678d16-a8a5-444f-971d-890a162e19f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcf3571d49b8438ab86baf80ac44c18a'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:41.015522 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-ae678d16-a8a5-444f-971d-890a162e19f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcf3571d49b8438ab86baf80ac44c18a'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:41.039596 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-ae678d16-a8a5-444f-971d-890a162e19f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcf3571d49b8438ab86baf80ac44c18a'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:41.040329 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-ae678d16-a8a5-444f-971d-890a162e19f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcf3571d49b8438ab86baf80ac44c18a'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:41.044261 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8303a9e9-bf25-48b0-93ec-bea96423e96d service neutron] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:41.045359 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-8303a9e9-bf25-48b0-93ec-bea96423e96d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:41.084202 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8303a9e9-bf25-48b0-93ec-bea96423e96d service neutron] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:41.110308 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a5d09a-10e8-47d2-aedf-a48b00862fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:41.111586 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a5d09a-10e8-47d2-aedf-a48b00862fc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:41.112021 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a5d09a-10e8-47d2-aedf-a48b00862fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:41.112470 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a5d09a-10e8-47d2-aedf-a48b00862fc6 admin admin] PATH_INFO: `/v3/users/db879b9e894c4399ae109b65238cc4b8` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:41.113643 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 937/1908] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:35:40 2022] DELETE /identity/v3/users/bcf3571d49b8438ab86baf80ac44c18a => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:41.114681 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a5d09a-10e8-47d2-aedf-a48b00862fc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db879b9e894c4399ae109b65238cc4b8)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:41.117013 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a5d09a-10e8-47d2-aedf-a48b00862fc6 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:41.119488 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3fde87-8a16-4032-a6ed-45dbdfd6470a None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:41.119997 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3fde87-8a16-4032-a6ed-45dbdfd6470a None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:41.120427 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3fde87-8a16-4032-a6ed-45dbdfd6470a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:41.133081 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:41.168855 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-9c3fde87-8a16-4032-a6ed-45dbdfd6470a None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:41.170458 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-9c3fde87-8a16-4032-a6ed-45dbdfd6470a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:41.238595 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-c6a5d09a-10e8-47d2-aedf-a48b00862fc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db879b9e894c4399ae109b65238cc4b8'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:41.239397 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-c6a5d09a-10e8-47d2-aedf-a48b00862fc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db879b9e894c4399ae109b65238cc4b8'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:41.274630 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-c6a5d09a-10e8-47d2-aedf-a48b00862fc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db879b9e894c4399ae109b65238cc4b8'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:41.287960 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-c6a5d09a-10e8-47d2-aedf-a48b00862fc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db879b9e894c4399ae109b65238cc4b8'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:41.299305 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-c6a5d09a-10e8-47d2-aedf-a48b00862fc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db879b9e894c4399ae109b65238cc4b8'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:41.308740 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 972/1909] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:35:41 2022] DELETE /identity/v3/users/db879b9e894c4399ae109b65238cc4b8 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 19:35:41.313940 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54694004-c6e0-49da-b5fa-75c4222b190e None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:41.314470 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54694004-c6e0-49da-b5fa-75c4222b190e None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:41.314882 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54694004-c6e0-49da-b5fa-75c4222b190e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:41.343332 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 938/1910] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:35:41.350505 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-54694004-c6e0-49da-b5fa-75c4222b190e None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:41.352667 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-54694004-c6e0-49da-b5fa-75c4222b190e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:41.405336 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3fde87-8a16-4032-a6ed-45dbdfd6470a None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:41.408548 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-9c3fde87-8a16-4032-a6ed-45dbdfd6470a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:41.444195 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:41.506169 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3fde87-8a16-4032-a6ed-45dbdfd6470a None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:41.547248 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 973/1911] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:35:41.578333 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0aab26-dee8-4bd4-881e-9a2f856627a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:41.579199 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0aab26-dee8-4bd4-881e-9a2f856627a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:41.579470 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0aab26-dee8-4bd4-881e-9a2f856627a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:41.579837 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0aab26-dee8-4bd4-881e-9a2f856627a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:41.592181 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0aab26-dee8-4bd4-881e-9a2f856627a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:41.606560 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0aab26-dee8-4bd4-881e-9a2f856627a6 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:41.626048 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54694004-c6e0-49da-b5fa-75c4222b190e None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:41.645083 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54694004-c6e0-49da-b5fa-75c4222b190e None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:41.648794 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 939/1912] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:35:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:35:41.670157 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ad52f-00d6-4332-92e6-74bb10fa6244 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:41.670888 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ad52f-00d6-4332-92e6-74bb10fa6244 service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:41.671282 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ad52f-00d6-4332-92e6-74bb10fa6244 service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:41.671501 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ad52f-00d6-4332-92e6-74bb10fa6244 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:41.690150 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0aab26-dee8-4bd4-881e-9a2f856627a6 service neutron] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:41.691822 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-1e0aab26-dee8-4bd4-881e-9a2f856627a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:41.710685 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081ad52f-00d6-4332-92e6-74bb10fa6244 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:41.712575 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081ad52f-00d6-4332-92e6-74bb10fa6244 service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:41.720714 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0aab26-dee8-4bd4-881e-9a2f856627a6 service neutron] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:41.733174 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb8bcd8-d531-4cae-80a0-5f0eb4b36165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:41.734122 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb8bcd8-d531-4cae-80a0-5f0eb4b36165 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:41.734414 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb8bcd8-d531-4cae-80a0-5f0eb4b36165 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:41.734699 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb8bcd8-d531-4cae-80a0-5f0eb4b36165 admin admin] PATH_INFO: `/v3/projects/cee68036ea8a4edfbd6158055124e8e1` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:41.736218 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb8bcd8-d531-4cae-80a0-5f0eb4b36165 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cee68036ea8a4edfbd6158055124e8e1)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:41.738082 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 974/1913] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:35:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:35:41.738685 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb8bcd8-d531-4cae-80a0-5f0eb4b36165 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:41.823782 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-abb8bcd8-d531-4cae-80a0-5f0eb4b36165 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cee68036ea8a4edfbd6158055124e8e1', 'request_id': 'req-abb8bcd8-d531-4cae-80a0-5f0eb4b36165'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:41.832587 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-abb8bcd8-d531-4cae-80a0-5f0eb4b36165 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cee68036ea8a4edfbd6158055124e8e1', 'request_id': 'req-abb8bcd8-d531-4cae-80a0-5f0eb4b36165'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:41.839207 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-abb8bcd8-d531-4cae-80a0-5f0eb4b36165 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cee68036ea8a4edfbd6158055124e8e1', 'request_id': 'req-abb8bcd8-d531-4cae-80a0-5f0eb4b36165'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:41.864597 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-abb8bcd8-d531-4cae-80a0-5f0eb4b36165 admin admin] The token cache is being invalidate because project cee68036ea8a4edfbd6158055124e8e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:35:41.865047 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-abb8bcd8-d531-4cae-80a0-5f0eb4b36165 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:41.865831 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-abb8bcd8-d531-4cae-80a0-5f0eb4b36165 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:41.881812 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 940/1914] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:35:41 2022] DELETE /identity/v3/projects/cee68036ea8a4edfbd6158055124e8e1 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:41.883034 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ad52f-00d6-4332-92e6-74bb10fa6244 service neutron] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:41.900531 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ad52f-00d6-4332-92e6-74bb10fa6244 service neutron] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:42.039718 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96670036-5190-486e-bf76-f229c607a15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:42.041460 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96670036-5190-486e-bf76-f229c607a15f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:42.042221 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96670036-5190-486e-bf76-f229c607a15f admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:42.042820 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96670036-5190-486e-bf76-f229c607a15f admin admin] PATH_INFO: `/v3/users/16db52b2b8724533bed11bcde781f70e` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:42.046070 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96670036-5190-486e-bf76-f229c607a15f admin admin] RBAC: Authorizing `identity:delete_user(user_id=16db52b2b8724533bed11bcde781f70e)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:42.049831 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96670036-5190-486e-bf76-f229c607a15f admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:42.069636 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:42.122244 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-96670036-5190-486e-bf76-f229c607a15f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16db52b2b8724533bed11bcde781f70e'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:42.123347 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-96670036-5190-486e-bf76-f229c607a15f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16db52b2b8724533bed11bcde781f70e'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:42.139543 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-96670036-5190-486e-bf76-f229c607a15f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16db52b2b8724533bed11bcde781f70e'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:42.149790 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-96670036-5190-486e-bf76-f229c607a15f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16db52b2b8724533bed11bcde781f70e'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:42.162908 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-96670036-5190-486e-bf76-f229c607a15f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16db52b2b8724533bed11bcde781f70e'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:42.174319 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 975/1915] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:35:41 2022] DELETE /identity/v3/users/16db52b2b8724533bed11bcde781f70e => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:42.392609 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb8bcd8-d531-4cae-80a0-5f0eb4b36165 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:42.394293 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-abb8bcd8-d531-4cae-80a0-5f0eb4b36165 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:42.421879 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb8bcd8-d531-4cae-80a0-5f0eb4b36165 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:42.500348 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:42.508423 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eccc6ca-480c-4d67-a84a-ffb8a0969085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:42.510190 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eccc6ca-480c-4d67-a84a-ffb8a0969085 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:42.510716 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eccc6ca-480c-4d67-a84a-ffb8a0969085 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:42.511520 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eccc6ca-480c-4d67-a84a-ffb8a0969085 admin admin] PATH_INFO: `/v3/projects/d614ef8724cb4f33adf286f869d5ce19` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:42.513937 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eccc6ca-480c-4d67-a84a-ffb8a0969085 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d614ef8724cb4f33adf286f869d5ce19)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:42.515941 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eccc6ca-480c-4d67-a84a-ffb8a0969085 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:42.648164 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-5eccc6ca-480c-4d67-a84a-ffb8a0969085 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd614ef8724cb4f33adf286f869d5ce19', 'request_id': 'req-5eccc6ca-480c-4d67-a84a-ffb8a0969085'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:42.664316 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-5eccc6ca-480c-4d67-a84a-ffb8a0969085 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd614ef8724cb4f33adf286f869d5ce19', 'request_id': 'req-5eccc6ca-480c-4d67-a84a-ffb8a0969085'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:42.679247 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-5eccc6ca-480c-4d67-a84a-ffb8a0969085 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd614ef8724cb4f33adf286f869d5ce19', 'request_id': 'req-5eccc6ca-480c-4d67-a84a-ffb8a0969085'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:42.703114 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-5eccc6ca-480c-4d67-a84a-ffb8a0969085 admin admin] The token cache is being invalidate because project d614ef8724cb4f33adf286f869d5ce19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:35:42.704172 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-5eccc6ca-480c-4d67-a84a-ffb8a0969085 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:42.705649 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-5eccc6ca-480c-4d67-a84a-ffb8a0969085 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:42.707873 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 941/1916] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:35:42 2022] DELETE /identity/v3/projects/d614ef8724cb4f33adf286f869d5ce19 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:42.712234 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96670036-5190-486e-bf76-f229c607a15f admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:42.714429 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-96670036-5190-486e-bf76-f229c607a15f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:42.732670 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eccc6ca-480c-4d67-a84a-ffb8a0969085 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:42.734883 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-5eccc6ca-480c-4d67-a84a-ffb8a0969085 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:42.738000 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96670036-5190-486e-bf76-f229c607a15f admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:42.847366 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acdcdbc-1171-4579-9fcd-f9bea742743f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:42.848008 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eccc6ca-480c-4d67-a84a-ffb8a0969085 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:42.849799 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acdcdbc-1171-4579-9fcd-f9bea742743f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:42.850292 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acdcdbc-1171-4579-9fcd-f9bea742743f admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:42.850754 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acdcdbc-1171-4579-9fcd-f9bea742743f admin admin] PATH_INFO: `/v3/users/5cf00d949df54cbdad79af08b1103aae` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:42.852455 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acdcdbc-1171-4579-9fcd-f9bea742743f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cf00d949df54cbdad79af08b1103aae)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:42.853177 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26bbe0-3646-4553-b940-ad900c4c69a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:42.854172 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26bbe0-3646-4553-b940-ad900c4c69a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:42.854465 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26bbe0-3646-4553-b940-ad900c4c69a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:42.854752 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26bbe0-3646-4553-b940-ad900c4c69a6 admin admin] PATH_INFO: `/v3/projects/d3f21287cf7f4c51b57c687deaac3ce3` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:42.855434 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acdcdbc-1171-4579-9fcd-f9bea742743f admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:42.856007 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c26bbe0-3646-4553-b940-ad900c4c69a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3f21287cf7f4c51b57c687deaac3ce3)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:42.858667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c26bbe0-3646-4553-b940-ad900c4c69a6 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:42.936461 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-4acdcdbc-1171-4579-9fcd-f9bea742743f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cf00d949df54cbdad79af08b1103aae'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:42.936461 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-4acdcdbc-1171-4579-9fcd-f9bea742743f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cf00d949df54cbdad79af08b1103aae'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:42.944066 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-3c26bbe0-3646-4553-b940-ad900c4c69a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3f21287cf7f4c51b57c687deaac3ce3', 'request_id': 'req-3c26bbe0-3646-4553-b940-ad900c4c69a6'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:42.958172 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-4acdcdbc-1171-4579-9fcd-f9bea742743f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cf00d949df54cbdad79af08b1103aae'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:42.959501 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-3c26bbe0-3646-4553-b940-ad900c4c69a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3f21287cf7f4c51b57c687deaac3ce3', 'request_id': 'req-3c26bbe0-3646-4553-b940-ad900c4c69a6'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:42.973428 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-3c26bbe0-3646-4553-b940-ad900c4c69a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3f21287cf7f4c51b57c687deaac3ce3', 'request_id': 'req-3c26bbe0-3646-4553-b940-ad900c4c69a6'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:42.983929 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-4acdcdbc-1171-4579-9fcd-f9bea742743f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cf00d949df54cbdad79af08b1103aae'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:42.995646 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-4acdcdbc-1171-4579-9fcd-f9bea742743f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cf00d949df54cbdad79af08b1103aae'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:43.014256 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-3c26bbe0-3646-4553-b940-ad900c4c69a6 admin admin] The token cache is being invalidate because project d3f21287cf7f4c51b57c687deaac3ce3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:35:43.014560 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-3c26bbe0-3646-4553-b940-ad900c4c69a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:43.018878 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-3c26bbe0-3646-4553-b940-ad900c4c69a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:43.021380 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 976/1917] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:35:42 2022] DELETE /identity/v3/users/5cf00d949df54cbdad79af08b1103aae => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:43.022457 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 942/1918] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:35:42 2022] DELETE /identity/v3/projects/d3f21287cf7f4c51b57c687deaac3ce3 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 19:35:43.026950 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acdcdbc-1171-4579-9fcd-f9bea742743f admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:43.032478 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-4acdcdbc-1171-4579-9fcd-f9bea742743f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:43.059390 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:43.186386 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acdcdbc-1171-4579-9fcd-f9bea742743f admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:43.197104 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c75755-be91-4b72-aac0-7d3d3ed208df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:43.198043 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c75755-be91-4b72-aac0-7d3d3ed208df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:43.202527 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c75755-be91-4b72-aac0-7d3d3ed208df admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:43.203046 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c75755-be91-4b72-aac0-7d3d3ed208df admin admin] PATH_INFO: `/v3/users/7ed0698058d24d9182b18284cd44ac2f` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:43.205002 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c75755-be91-4b72-aac0-7d3d3ed208df admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ed0698058d24d9182b18284cd44ac2f)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:43.207061 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c75755-be91-4b72-aac0-7d3d3ed208df admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:43.304004 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-83c75755-be91-4b72-aac0-7d3d3ed208df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ed0698058d24d9182b18284cd44ac2f'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:43.305008 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-83c75755-be91-4b72-aac0-7d3d3ed208df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ed0698058d24d9182b18284cd44ac2f'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:43.337094 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-83c75755-be91-4b72-aac0-7d3d3ed208df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ed0698058d24d9182b18284cd44ac2f'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:43.363750 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-83c75755-be91-4b72-aac0-7d3d3ed208df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ed0698058d24d9182b18284cd44ac2f'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:43.396946 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-83c75755-be91-4b72-aac0-7d3d3ed208df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ed0698058d24d9182b18284cd44ac2f'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:43.411178 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 977/1919] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:35:43 2022] DELETE /identity/v3/users/7ed0698058d24d9182b18284cd44ac2f => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:43.423325 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26bbe0-3646-4553-b940-ad900c4c69a6 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:43.427948 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-3c26bbe0-3646-4553-b940-ad900c4c69a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:43.482968 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:43.584904 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26bbe0-3646-4553-b940-ad900c4c69a6 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:43.737434 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de79f74-bfbd-433a-95d4-58b55156f1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:43.738651 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de79f74-bfbd-433a-95d4-58b55156f1fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:43.738844 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de79f74-bfbd-433a-95d4-58b55156f1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:43.739117 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de79f74-bfbd-433a-95d4-58b55156f1fd admin admin] PATH_INFO: `/v3/projects/8c0ba6694ee14ae5a6354310dc73a0b5` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:43.744390 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de79f74-bfbd-433a-95d4-58b55156f1fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c0ba6694ee14ae5a6354310dc73a0b5)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:43.749399 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de79f74-bfbd-433a-95d4-58b55156f1fd admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:43.805982 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c75755-be91-4b72-aac0-7d3d3ed208df admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:43.808124 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-83c75755-be91-4b72-aac0-7d3d3ed208df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:43.832429 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c75755-be91-4b72-aac0-7d3d3ed208df admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:43.855657 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fa2943-5218-406b-8c69-663d483af930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:43.856616 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa2943-5218-406b-8c69-663d483af930 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:43.859395 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa2943-5218-406b-8c69-663d483af930 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:43.860009 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa2943-5218-406b-8c69-663d483af930 admin admin] PATH_INFO: `/v3/projects/9d674429146b4da28686edd5bec6d750` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:43.862198 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fa2943-5218-406b-8c69-663d483af930 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d674429146b4da28686edd5bec6d750)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:43.864756 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fa2943-5218-406b-8c69-663d483af930 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:43.900073 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-2de79f74-bfbd-433a-95d4-58b55156f1fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c0ba6694ee14ae5a6354310dc73a0b5', 'request_id': 'req-2de79f74-bfbd-433a-95d4-58b55156f1fd'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:43.916538 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-2de79f74-bfbd-433a-95d4-58b55156f1fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c0ba6694ee14ae5a6354310dc73a0b5', 'request_id': 'req-2de79f74-bfbd-433a-95d4-58b55156f1fd'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:43.940780 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-2de79f74-bfbd-433a-95d4-58b55156f1fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c0ba6694ee14ae5a6354310dc73a0b5', 'request_id': 'req-2de79f74-bfbd-433a-95d4-58b55156f1fd'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:43.971868 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-2de79f74-bfbd-433a-95d4-58b55156f1fd admin admin] The token cache is being invalidate because project 8c0ba6694ee14ae5a6354310dc73a0b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:35:43.972376 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-2de79f74-bfbd-433a-95d4-58b55156f1fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:43.978653 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-2de79f74-bfbd-433a-95d4-58b55156f1fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:43.986303 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 943/1920] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:35:43 2022] DELETE /identity/v3/projects/8c0ba6694ee14ae5a6354310dc73a0b5 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:43.988236 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-65fa2943-5218-406b-8c69-663d483af930 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d674429146b4da28686edd5bec6d750', 'request_id': 'req-65fa2943-5218-406b-8c69-663d483af930'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:43.991854 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e667762-83c0-49fe-9628-b5738913c82b None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:43.993501 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e667762-83c0-49fe-9628-b5738913c82b None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:43.994241 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e667762-83c0-49fe-9628-b5738913c82b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:44.007639 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-65fa2943-5218-406b-8c69-663d483af930 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d674429146b4da28686edd5bec6d750', 'request_id': 'req-65fa2943-5218-406b-8c69-663d483af930'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:44.025451 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-65fa2943-5218-406b-8c69-663d483af930 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d674429146b4da28686edd5bec6d750', 'request_id': 'req-65fa2943-5218-406b-8c69-663d483af930'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:44.038429 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-8e667762-83c0-49fe-9628-b5738913c82b None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:44.040909 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-8e667762-83c0-49fe-9628-b5738913c82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:44.057760 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-65fa2943-5218-406b-8c69-663d483af930 admin admin] The token cache is being invalidate because project 9d674429146b4da28686edd5bec6d750 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:35:44.059470 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-65fa2943-5218-406b-8c69-663d483af930 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:44.062821 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-65fa2943-5218-406b-8c69-663d483af930 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:44.065526 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 978/1921] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:35:43 2022] DELETE /identity/v3/projects/9d674429146b4da28686edd5bec6d750 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:44.072771 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24edb0d1-c23b-454f-b813-a464c6573561 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:44.073205 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24edb0d1-c23b-454f-b813-a464c6573561 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:44.073680 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24edb0d1-c23b-454f-b813-a464c6573561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:44.105120 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-24edb0d1-c23b-454f-b813-a464c6573561 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:44.106444 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-24edb0d1-c23b-454f-b813-a464c6573561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:44.114343 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:44.185578 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:44.223319 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 944/1922] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:35:44.231458 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 979/1923] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:35:44.232878 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873452ab-b799-4b5d-8855-b5587efd87d4 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:44.233301 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873452ab-b799-4b5d-8855-b5587efd87d4 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:44.233708 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873452ab-b799-4b5d-8855-b5587efd87d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:44.241090 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f27dfd-39e0-4194-ac58-8ff6941c7a60 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:44.241651 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f27dfd-39e0-4194-ac58-8ff6941c7a60 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:44.242112 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f27dfd-39e0-4194-ac58-8ff6941c7a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:44.278134 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-f1f27dfd-39e0-4194-ac58-8ff6941c7a60 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:44.279946 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-f1f27dfd-39e0-4194-ac58-8ff6941c7a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:44.299422 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 980/1924] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:35:44.303774 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f27dfd-39e0-4194-ac58-8ff6941c7a60 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:44.321195 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f27dfd-39e0-4194-ac58-8ff6941c7a60 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:44.339380 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385060f8-3ff6-45c4-8964-1482570b5bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:44.340090 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385060f8-3ff6-45c4-8964-1482570b5bd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:44.340379 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385060f8-3ff6-45c4-8964-1482570b5bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:44.340660 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385060f8-3ff6-45c4-8964-1482570b5bd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:44.347025 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385060f8-3ff6-45c4-8964-1482570b5bd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:35:44.347406 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385060f8-3ff6-45c4-8964-1482570b5bd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:44.349133 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385060f8-3ff6-45c4-8964-1482570b5bd1 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:44.385094 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 981/1925] 10.222.0.26 () {58 vars in 1152 bytes} [Fri Jul 1 19:35:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:35:44.389639 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385060f8-3ff6-45c4-8964-1482570b5bd1 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:44.406849 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385060f8-3ff6-45c4-8964-1482570b5bd1 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:44.430510 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c26b15-52af-4046-8953-e5d305bae69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:44.431351 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c26b15-52af-4046-8953-e5d305bae69e admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:44.431761 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c26b15-52af-4046-8953-e5d305bae69e admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:44.432113 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c26b15-52af-4046-8953-e5d305bae69e admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:44.434096 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c26b15-52af-4046-8953-e5d305bae69e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:44.436538 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c26b15-52af-4046-8953-e5d305bae69e admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:44.464434 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-873452ab-b799-4b5d-8855-b5587efd87d4 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:44.465746 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-873452ab-b799-4b5d-8855-b5587efd87d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:44.482215 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 945/1926] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:35:44.485560 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873452ab-b799-4b5d-8855-b5587efd87d4 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:44.507345 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 982/1927] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:35:44 2022] POST /identity/v3/projects => generated 387 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 19:35:44.508345 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c26b15-52af-4046-8953-e5d305bae69e admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:44.511716 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873452ab-b799-4b5d-8855-b5587efd87d4 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:44.512802 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-06c26b15-52af-4046-8953-e5d305bae69e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:44.623855 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f974f-4ca1-48c8-be35-bee3a7c9bd68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:44.624535 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f974f-4ca1-48c8-be35-bee3a7c9bd68 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:44.626091 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f974f-4ca1-48c8-be35-bee3a7c9bd68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:44.626207 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f974f-4ca1-48c8-be35-bee3a7c9bd68 admin admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:44.629442 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957f974f-4ca1-48c8-be35-bee3a7c9bd68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:35:44.629442 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957f974f-4ca1-48c8-be35-bee3a7c9bd68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:44.632214 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957f974f-4ca1-48c8-be35-bee3a7c9bd68 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:44.658870 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 946/1928] 10.222.0.26 () {58 vars in 1152 bytes} [Fri Jul 1 19:35:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:35:44.659386 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c26b15-52af-4046-8953-e5d305bae69e admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:44.659499 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f974f-4ca1-48c8-be35-bee3a7c9bd68 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:44.672913 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f974f-4ca1-48c8-be35-bee3a7c9bd68 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:44.676095 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd8fde8-27b3-4bfe-be11-3bd68e18d533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:44.677320 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd8fde8-27b3-4bfe-be11-3bd68e18d533 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:44.677614 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd8fde8-27b3-4bfe-be11-3bd68e18d533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:44.677954 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd8fde8-27b3-4bfe-be11-3bd68e18d533 admin admin] PATH_INFO: `/v3/projects/3a96507b25be46408def68f65fc7de33` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:44.679423 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd8fde8-27b3-4bfe-be11-3bd68e18d533 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a96507b25be46408def68f65fc7de33)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:44.680895 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8166a0a5-325e-41b5-af54-d9eaf0dfe20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:44.684584 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8166a0a5-325e-41b5-af54-d9eaf0dfe20f admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:44.684584 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8166a0a5-325e-41b5-af54-d9eaf0dfe20f admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:44.684584 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8166a0a5-325e-41b5-af54-d9eaf0dfe20f admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:44.684584 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8166a0a5-325e-41b5-af54-d9eaf0dfe20f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:44.687939 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd8fde8-27b3-4bfe-be11-3bd68e18d533 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:44.703987 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8166a0a5-325e-41b5-af54-d9eaf0dfe20f admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:44.784972 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 947/1929] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:35:44 2022] POST /identity/v3/users => generated 294 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:35:44.784972 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8166a0a5-325e-41b5-af54-d9eaf0dfe20f admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:44.805023 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-7cd8fde8-27b3-4bfe-be11-3bd68e18d533 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a96507b25be46408def68f65fc7de33', 'request_id': 'req-7cd8fde8-27b3-4bfe-be11-3bd68e18d533'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:44.806752 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8166a0a5-325e-41b5-af54-d9eaf0dfe20f admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:44.812743 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-7cd8fde8-27b3-4bfe-be11-3bd68e18d533 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a96507b25be46408def68f65fc7de33', 'request_id': 'req-7cd8fde8-27b3-4bfe-be11-3bd68e18d533'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:44.833138 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-7cd8fde8-27b3-4bfe-be11-3bd68e18d533 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a96507b25be46408def68f65fc7de33', 'request_id': 'req-7cd8fde8-27b3-4bfe-be11-3bd68e18d533'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:44.854264 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:44.867893 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-7cd8fde8-27b3-4bfe-be11-3bd68e18d533 admin admin] The token cache is being invalidate because project 3a96507b25be46408def68f65fc7de33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:35:44.869954 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-7cd8fde8-27b3-4bfe-be11-3bd68e18d533 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:44.873530 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-7cd8fde8-27b3-4bfe-be11-3bd68e18d533 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:44.874951 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 983/1930] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:35:44 2022] DELETE /identity/v3/projects/3a96507b25be46408def68f65fc7de33 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:44.876080 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd8fde8-27b3-4bfe-be11-3bd68e18d533 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:44.877717 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-7cd8fde8-27b3-4bfe-be11-3bd68e18d533 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:44.969297 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d46d9b-27cd-4416-932b-3840d05ef2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:44.969297 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d46d9b-27cd-4416-932b-3840d05ef2ea admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:44.969598 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d46d9b-27cd-4416-932b-3840d05ef2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:44.969971 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d46d9b-27cd-4416-932b-3840d05ef2ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:44.972606 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d46d9b-27cd-4416-932b-3840d05ef2ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:44.974404 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d46d9b-27cd-4416-932b-3840d05ef2ea admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:45.053133 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd8fde8-27b3-4bfe-be11-3bd68e18d533 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:45.057184 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 948/1931] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:35:44 2022] POST /identity/v3/projects => generated 381 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:35:45.057184 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab506286-fa41-465e-9244-e7e5a3dd1ccc None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:45.057184 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab506286-fa41-465e-9244-e7e5a3dd1ccc None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:45.057184 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab506286-fa41-465e-9244-e7e5a3dd1ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:45.106293 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-ab506286-fa41-465e-9244-e7e5a3dd1ccc None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:45.106293 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-ab506286-fa41-465e-9244-e7e5a3dd1ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:45.231319 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe2be0a-8f08-4b7d-a2f6-e52883b76f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:45.232064 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe2be0a-8f08-4b7d-a2f6-e52883b76f9a admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:45.232640 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe2be0a-8f08-4b7d-a2f6-e52883b76f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:45.235741 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:45.235956 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe2be0a-8f08-4b7d-a2f6-e52883b76f9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:45.237306 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe2be0a-8f08-4b7d-a2f6-e52883b76f9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:45.239018 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe2be0a-8f08-4b7d-a2f6-e52883b76f9a admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:45.256402 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 984/1932] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:35:44 2022] GET /identity/v3/roles => generated 1420 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:35:45.258234 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe2be0a-8f08-4b7d-a2f6-e52883b76f9a admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:45.262789 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-bbe2be0a-8f08-4b7d-a2f6-e52883b76f9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:45.276976 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 949/1933] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:35:45.278003 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab506286-fa41-465e-9244-e7e5a3dd1ccc None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:45.281391 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe2be0a-8f08-4b7d-a2f6-e52883b76f9a admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:45.297387 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0297c67b-90c8-4b5d-a5aa-ec30a5479a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:45.298791 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0297c67b-90c8-4b5d-a5aa-ec30a5479a95 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:45.299332 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0297c67b-90c8-4b5d-a5aa-ec30a5479a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:45.299867 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0297c67b-90c8-4b5d-a5aa-ec30a5479a95 admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:45.300777 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0297c67b-90c8-4b5d-a5aa-ec30a5479a95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:45.304223 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0297c67b-90c8-4b5d-a5aa-ec30a5479a95 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:45.309197 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab506286-fa41-465e-9244-e7e5a3dd1ccc None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:45.318240 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2ad588-4039-4010-9af6-a5332be56b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:45.321225 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2ad588-4039-4010-9af6-a5332be56b47 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:45.321601 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2ad588-4039-4010-9af6-a5332be56b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:45.321830 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2ad588-4039-4010-9af6-a5332be56b47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:45.322795 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2ad588-4039-4010-9af6-a5332be56b47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:45.324885 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2ad588-4039-4010-9af6-a5332be56b47 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:45.367941 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 985/1934] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:35:45 2022] POST /identity/v3/users => generated 291 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:35:45.368177 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 950/1935] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:35:45 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:35:45.368742 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4a41e-7eb2-41f6-b98e-d663a3d58fac None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:45.368984 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4a41e-7eb2-41f6-b98e-d663a3d58fac None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:45.369211 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4a41e-7eb2-41f6-b98e-d663a3d58fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:45.371662 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2ad588-4039-4010-9af6-a5332be56b47 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:45.397086 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2ad588-4039-4010-9af6-a5332be56b47 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:45.417650 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-5ad4a41e-7eb2-41f6-b98e-d663a3d58fac None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:45.418307 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b5011-40b3-4fa9-8ac6-24bc69715919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:45.418995 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-5ad4a41e-7eb2-41f6-b98e-d663a3d58fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:45.419262 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b5011-40b3-4fa9-8ac6-24bc69715919 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:45.420177 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b5011-40b3-4fa9-8ac6-24bc69715919 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:45.420491 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b5011-40b3-4fa9-8ac6-24bc69715919 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:45.421660 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8b5011-40b3-4fa9-8ac6-24bc69715919 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:45.424740 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8b5011-40b3-4fa9-8ac6-24bc69715919 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:45.448521 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 986/1936] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:35:45.448521 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad4a41e-7eb2-41f6-b98e-d663a3d58fac None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:45.454043 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 951/1937] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:35:45 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:35:45.455086 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b5011-40b3-4fa9-8ac6-24bc69715919 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:45.471225 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad4a41e-7eb2-41f6-b98e-d663a3d58fac None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:45.494160 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b9a79b-11d6-4c04-affe-d173c097371a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:45.495207 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b5011-40b3-4fa9-8ac6-24bc69715919 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:45.495352 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9a79b-11d6-4c04-affe-d173c097371a admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:45.495554 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9a79b-11d6-4c04-affe-d173c097371a admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:45.495846 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9a79b-11d6-4c04-affe-d173c097371a admin admin] PATH_INFO: `/v3/projects/2dd9c1a452db475fb92e05b1be70016f/users/c3e7353fd5344d29be8f929d6d3a1836/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:45.513909 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6314b5-cd36-4c00-bf45-0968ba3e511b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:45.514590 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6314b5-cd36-4c00-bf45-0968ba3e511b admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:45.514879 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6314b5-cd36-4c00-bf45-0968ba3e511b admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:45.515158 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6314b5-cd36-4c00-bf45-0968ba3e511b admin admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:45.515905 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6314b5-cd36-4c00-bf45-0968ba3e511b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:35:45.516219 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6314b5-cd36-4c00-bf45-0968ba3e511b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:45.518737 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6314b5-cd36-4c00-bf45-0968ba3e511b admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:45.522726 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b9a79b-11d6-4c04-affe-d173c097371a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dd9c1a452db475fb92e05b1be70016f, user_id=c3e7353fd5344d29be8f929d6d3a1836, role_id=4cbf6ec846eb4b7c8cc52e9bfd6f076f)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:45.528427 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b9a79b-11d6-4c04-affe-d173c097371a admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:45.534544 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 952/1938] 10.222.0.26 () {58 vars in 1152 bytes} [Fri Jul 1 19:35:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:35:45.535623 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6314b5-cd36-4c00-bf45-0968ba3e511b admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:45.553992 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 987/1939] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:35:45 2022] PUT /identity/v3/projects/2dd9c1a452db475fb92e05b1be70016f/users/c3e7353fd5344d29be8f929d6d3a1836/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:45.555105 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b9a79b-11d6-4c04-affe-d173c097371a admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:45.564722 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6314b5-cd36-4c00-bf45-0968ba3e511b admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:45.671173 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:45.679756 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b9a79b-11d6-4c04-affe-d173c097371a admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:45.680122 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce783bbc-4a60-4545-8cff-c123d98625ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:45.680669 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce783bbc-4a60-4545-8cff-c123d98625ae admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:45.680969 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce783bbc-4a60-4545-8cff-c123d98625ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:45.681302 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce783bbc-4a60-4545-8cff-c123d98625ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:45.682154 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce783bbc-4a60-4545-8cff-c123d98625ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:45.684377 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce783bbc-4a60-4545-8cff-c123d98625ae admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:45.690745 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34816ba-fb90-4c41-b4a7-2a24601eb996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:45.691820 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34816ba-fb90-4c41-b4a7-2a24601eb996 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:45.692922 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34816ba-fb90-4c41-b4a7-2a24601eb996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:45.693864 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34816ba-fb90-4c41-b4a7-2a24601eb996 admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:45.694778 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34816ba-fb90-4c41-b4a7-2a24601eb996 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:45.697941 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34816ba-fb90-4c41-b4a7-2a24601eb996 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:45.699105 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 953/1940] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:35:45 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:35:45.701398 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b6d9cc-0d17-492d-820d-16cd1d6c15b1 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:45.701398 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b6d9cc-0d17-492d-820d-16cd1d6c15b1 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:45.701669 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b6d9cc-0d17-492d-820d-16cd1d6c15b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:45.747676 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-f3b6d9cc-0d17-492d-820d-16cd1d6c15b1 None None] MFA Rules not processed for user `c3e7353fd5344d29be8f929d6d3a1836`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:45.749261 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-f3b6d9cc-0d17-492d-820d-16cd1d6c15b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:45.757945 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 988/1941] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:35:45 2022] POST /identity/v3/projects => generated 377 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:35:45.757945 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34816ba-fb90-4c41-b4a7-2a24601eb996 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:45.847782 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 954/1942] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:35:45.847782 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b6d9cc-0d17-492d-820d-16cd1d6c15b1 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:45.869378 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34816ba-fb90-4c41-b4a7-2a24601eb996 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:45.879418 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d8268b-d6f7-4ac9-91dd-333fe83b60ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:45.881841 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d8268b-d6f7-4ac9-91dd-333fe83b60ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:45.881841 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d8268b-d6f7-4ac9-91dd-333fe83b60ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:45.882128 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d8268b-d6f7-4ac9-91dd-333fe83b60ba admin admin] PATH_INFO: `/v3/projects/25f2ba8788454e0fbf2ea434e37f685f/users/f0b9fe6206a14201b33186977088d6f0/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:45.906866 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d8268b-d6f7-4ac9-91dd-333fe83b60ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=25f2ba8788454e0fbf2ea434e37f685f, user_id=f0b9fe6206a14201b33186977088d6f0, role_id=4cbf6ec846eb4b7c8cc52e9bfd6f076f)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:45.909786 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d8268b-d6f7-4ac9-91dd-333fe83b60ba admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:45.925411 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:45.943409 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 989/1943] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:35:45 2022] PUT /identity/v3/projects/25f2ba8788454e0fbf2ea434e37f685f/users/f0b9fe6206a14201b33186977088d6f0/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:45.943409 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d8268b-d6f7-4ac9-91dd-333fe83b60ba admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:45.969129 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b6d9cc-0d17-492d-820d-16cd1d6c15b1 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:46.011835 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d8268b-d6f7-4ac9-91dd-333fe83b60ba admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:46.023676 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83631858-4492-434b-a4f0-3334307797c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:46.024350 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83631858-4492-434b-a4f0-3334307797c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:46.024635 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83631858-4492-434b-a4f0-3334307797c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:46.025133 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83631858-4492-434b-a4f0-3334307797c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:46.025898 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83631858-4492-434b-a4f0-3334307797c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:46.027833 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83631858-4492-434b-a4f0-3334307797c4 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:46.073810 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed37afb-5788-49f0-9cc0-f22ac50997e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:46.074567 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed37afb-5788-49f0-9cc0-f22ac50997e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:46.074880 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed37afb-5788-49f0-9cc0-f22ac50997e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:46.075269 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed37afb-5788-49f0-9cc0-f22ac50997e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:46.076823 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed37afb-5788-49f0-9cc0-f22ac50997e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:46.080385 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed37afb-5788-49f0-9cc0-f22ac50997e8 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:46.094595 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 990/1944] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:35:45 2022] POST /identity/v3/projects => generated 385 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:35:46.096290 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a81289-9cc4-4310-ba98-dbc30b156fc4 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:46.096623 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a81289-9cc4-4310-ba98-dbc30b156fc4 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:46.097000 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a81289-9cc4-4310-ba98-dbc30b156fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:46.110324 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 955/1945] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:35:45 2022] POST /identity/v3/users => generated 289 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:35:46.110755 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed37afb-5788-49f0-9cc0-f22ac50997e8 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:46.121121 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed37afb-5788-49f0-9cc0-f22ac50997e8 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:46.155837 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-05a81289-9cc4-4310-ba98-dbc30b156fc4 None None] MFA Rules not processed for user `f0b9fe6206a14201b33186977088d6f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:46.157122 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-05a81289-9cc4-4310-ba98-dbc30b156fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:46.212799 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56db420-b7b2-4d03-94bd-99290b468c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:46.213534 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56db420-b7b2-4d03-94bd-99290b468c72 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:46.214018 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56db420-b7b2-4d03-94bd-99290b468c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:46.214288 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56db420-b7b2-4d03-94bd-99290b468c72 admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:46.215081 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56db420-b7b2-4d03-94bd-99290b468c72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:46.217688 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56db420-b7b2-4d03-94bd-99290b468c72 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:46.225993 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:46.244778 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 956/1946] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:35:46 2022] POST /identity/v3/users => generated 299 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:35:46.246743 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56db420-b7b2-4d03-94bd-99290b468c72 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:46.266862 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56db420-b7b2-4d03-94bd-99290b468c72 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:46.272035 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef8db9f-df0e-44b2-9b5c-ec68ddb9ba64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:46.272930 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8db9f-df0e-44b2-9b5c-ec68ddb9ba64 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:46.273038 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8db9f-df0e-44b2-9b5c-ec68ddb9ba64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:46.273304 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8db9f-df0e-44b2-9b5c-ec68ddb9ba64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:46.274223 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef8db9f-df0e-44b2-9b5c-ec68ddb9ba64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:46.275868 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef8db9f-df0e-44b2-9b5c-ec68ddb9ba64 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:46.286163 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 991/1947] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:35:46.293435 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a81289-9cc4-4310-ba98-dbc30b156fc4 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:46.300838 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 957/1948] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:35:46 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:35:46.301858 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef8db9f-df0e-44b2-9b5c-ec68ddb9ba64 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:46.311620 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a81289-9cc4-4310-ba98-dbc30b156fc4 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:46.314772 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef8db9f-df0e-44b2-9b5c-ec68ddb9ba64 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:46.316841 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf287e5-4dec-402d-ab70-5cab87844057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:46.317562 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf287e5-4dec-402d-ab70-5cab87844057 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:46.318442 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf287e5-4dec-402d-ab70-5cab87844057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:46.318745 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf287e5-4dec-402d-ab70-5cab87844057 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:46.321559 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef0e700-e5a2-47eb-9690-7ef042ea374d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:46.322270 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0e700-e5a2-47eb-9690-7ef042ea374d admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:46.322532 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0e700-e5a2-47eb-9690-7ef042ea374d admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:46.322965 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0e700-e5a2-47eb-9690-7ef042ea374d admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:46.323851 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef0e700-e5a2-47eb-9690-7ef042ea374d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:46.326545 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef0e700-e5a2-47eb-9690-7ef042ea374d admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:46.326709 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf287e5-4dec-402d-ab70-5cab87844057 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:46.328199 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf287e5-4dec-402d-ab70-5cab87844057 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:46.351810 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 992/1949] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:35:46 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:35:46.352651 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf287e5-4dec-402d-ab70-5cab87844057 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:46.368067 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf287e5-4dec-402d-ab70-5cab87844057 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:46.375453 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc30211e-439e-460a-99b3-e909b14c127c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:46.376253 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30211e-439e-460a-99b3-e909b14c127c admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:46.376556 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30211e-439e-460a-99b3-e909b14c127c admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:46.376839 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30211e-439e-460a-99b3-e909b14c127c admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:46.377817 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc30211e-439e-460a-99b3-e909b14c127c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:46.379463 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc30211e-439e-460a-99b3-e909b14c127c admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:46.392434 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 958/1950] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:35:46 2022] POST /identity/v3/projects => generated 381 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:35:46.394588 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef0e700-e5a2-47eb-9690-7ef042ea374d admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:46.400757 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 993/1951] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:35:46 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:35:46.402096 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc30211e-439e-460a-99b3-e909b14c127c admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:46.413933 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc30211e-439e-460a-99b3-e909b14c127c admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:46.484502 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:46.553286 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef0e700-e5a2-47eb-9690-7ef042ea374d admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:46.562812 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af36b5c7-bc2a-4ba6-9f65-b8bec2858034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:46.563909 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36b5c7-bc2a-4ba6-9f65-b8bec2858034 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:46.564198 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36b5c7-bc2a-4ba6-9f65-b8bec2858034 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:46.564596 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36b5c7-bc2a-4ba6-9f65-b8bec2858034 admin admin] PATH_INFO: `/v3/projects/e9b5b4dbe6ed4631b5818ded8ca2d5f3/users/82b1b77a267f4680a49bdcc9d7bda876/roles/6cb03785fb184ef587509b3174622f69` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:46.579762 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e6c4c0-a3cf-4fe0-89d5-33b15bb8c384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:46.580450 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e6c4c0-a3cf-4fe0-89d5-33b15bb8c384 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:46.580737 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e6c4c0-a3cf-4fe0-89d5-33b15bb8c384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:46.581021 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e6c4c0-a3cf-4fe0-89d5-33b15bb8c384 admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:46.581919 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e6c4c0-a3cf-4fe0-89d5-33b15bb8c384 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:46.589883 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e6c4c0-a3cf-4fe0-89d5-33b15bb8c384 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:46.595060 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af36b5c7-bc2a-4ba6-9f65-b8bec2858034 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9b5b4dbe6ed4631b5818ded8ca2d5f3, user_id=82b1b77a267f4680a49bdcc9d7bda876, role_id=6cb03785fb184ef587509b3174622f69)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:46.598350 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af36b5c7-bc2a-4ba6-9f65-b8bec2858034 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:46.649111 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 959/1952] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:35:46 2022] PUT /identity/v3/projects/e9b5b4dbe6ed4631b5818ded8ca2d5f3/users/82b1b77a267f4680a49bdcc9d7bda876/roles/6cb03785fb184ef587509b3174622f69 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:46.651501 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af36b5c7-bc2a-4ba6-9f65-b8bec2858034 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:46.653883 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 994/1953] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:35:46 2022] POST /identity/v3/users => generated 297 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:35:46.655645 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e6c4c0-a3cf-4fe0-89d5-33b15bb8c384 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:46.680163 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e6c4c0-a3cf-4fe0-89d5-33b15bb8c384 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:46.788397 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a2a341-2b09-4ae8-bc38-44d519576093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:46.789669 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2a341-2b09-4ae8-bc38-44d519576093 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:46.790167 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2a341-2b09-4ae8-bc38-44d519576093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:46.790649 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2a341-2b09-4ae8-bc38-44d519576093 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:46.791617 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a2a341-2b09-4ae8-bc38-44d519576093 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:46.795016 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a2a341-2b09-4ae8-bc38-44d519576093 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:46.818080 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 995/1954] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:35:46 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:35:46.820486 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a2a341-2b09-4ae8-bc38-44d519576093 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:46.822965 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af36b5c7-bc2a-4ba6-9f65-b8bec2858034 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:46.837001 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd4f092-01dd-40a7-917d-3033ceeaaa33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:46.838085 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4f092-01dd-40a7-917d-3033ceeaaa33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:46.838470 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4f092-01dd-40a7-917d-3033ceeaaa33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:46.838842 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4f092-01dd-40a7-917d-3033ceeaaa33 admin admin] PATH_INFO: `/v3/projects/e5b3762ec87444d2beb64b974e590a50/users/a69dd44711b348aaa3e36ce1af760857/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:46.840166 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a2a341-2b09-4ae8-bc38-44d519576093 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:46.853428 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49db9bec-b493-483e-99e9-771be1ac877b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:46.854615 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db9bec-b493-483e-99e9-771be1ac877b admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:46.855132 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db9bec-b493-483e-99e9-771be1ac877b admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:46.855308 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db9bec-b493-483e-99e9-771be1ac877b admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:46.857875 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49db9bec-b493-483e-99e9-771be1ac877b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:46.859553 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49db9bec-b493-483e-99e9-771be1ac877b admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:46.878113 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 996/1955] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:35:46 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:35:46.879176 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd4f092-01dd-40a7-917d-3033ceeaaa33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5b3762ec87444d2beb64b974e590a50, user_id=a69dd44711b348aaa3e36ce1af760857, role_id=4cbf6ec846eb4b7c8cc52e9bfd6f076f)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:46.879329 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49db9bec-b493-483e-99e9-771be1ac877b admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:46.882110 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd4f092-01dd-40a7-917d-3033ceeaaa33 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:46.895293 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49db9bec-b493-483e-99e9-771be1ac877b admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:46.902719 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980daf36-26e2-4a4d-818d-340615c53bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:46.904358 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980daf36-26e2-4a4d-818d-340615c53bb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:46.904555 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980daf36-26e2-4a4d-818d-340615c53bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:46.904841 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980daf36-26e2-4a4d-818d-340615c53bb3 admin admin] PATH_INFO: `/v3/projects/e9b5b4dbe6ed4631b5818ded8ca2d5f3/users/82b1b77a267f4680a49bdcc9d7bda876/roles/6cb03785fb184ef587509b3174622f69` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:46.915560 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980daf36-26e2-4a4d-818d-340615c53bb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9b5b4dbe6ed4631b5818ded8ca2d5f3, user_id=82b1b77a267f4680a49bdcc9d7bda876, role_id=6cb03785fb184ef587509b3174622f69)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:46.918904 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 960/1956] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:35:46 2022] PUT /identity/v3/projects/e5b3762ec87444d2beb64b974e590a50/users/a69dd44711b348aaa3e36ce1af760857/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:46.919797 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd4f092-01dd-40a7-917d-3033ceeaaa33 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:46.920615 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980daf36-26e2-4a4d-818d-340615c53bb3 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:46.940312 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 997/1957] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:35:46 2022] PUT /identity/v3/projects/e9b5b4dbe6ed4631b5818ded8ca2d5f3/users/82b1b77a267f4680a49bdcc9d7bda876/roles/6cb03785fb184ef587509b3174622f69 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:46.953219 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58edd15-2037-4d38-be01-890f781b3f83 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:46.953609 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58edd15-2037-4d38-be01-890f781b3f83 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:46.954072 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58edd15-2037-4d38-be01-890f781b3f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:46.997897 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-f58edd15-2037-4d38-be01-890f781b3f83 None None] MFA Rules not processed for user `a69dd44711b348aaa3e36ce1af760857`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:47.002465 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-f58edd15-2037-4d38-be01-890f781b3f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:47.014290 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:47.038145 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd4f092-01dd-40a7-917d-3033ceeaaa33 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:47.112941 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:47.132002 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 998/1958] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:35:47.134381 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe74953-c808-4504-b153-22b89d204ba6 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:47.139174 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe74953-c808-4504-b153-22b89d204ba6 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:47.139921 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe74953-c808-4504-b153-22b89d204ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:47.148865 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc88daf-7bb9-42f9-80d0-b396faeda4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:47.150400 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc88daf-7bb9-42f9-80d0-b396faeda4b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:47.150886 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc88daf-7bb9-42f9-80d0-b396faeda4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:47.152984 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc88daf-7bb9-42f9-80d0-b396faeda4b1 admin admin] PATH_INFO: `/v3/projects/41f9126564424d0dbda08c5166739cef/users/123c2556fb3944aca5b6093fe32b698a/roles/6cb03785fb184ef587509b3174622f69` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:47.197409 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc88daf-7bb9-42f9-80d0-b396faeda4b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41f9126564424d0dbda08c5166739cef, user_id=123c2556fb3944aca5b6093fe32b698a, role_id=6cb03785fb184ef587509b3174622f69)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:47.208637 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc88daf-7bb9-42f9-80d0-b396faeda4b1 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:47.221035 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-fbe74953-c808-4504-b153-22b89d204ba6 None None] MFA Rules not processed for user `82b1b77a267f4680a49bdcc9d7bda876`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:47.222605 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-fbe74953-c808-4504-b153-22b89d204ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:47.243010 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 961/1959] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:35:46 2022] PUT /identity/v3/projects/41f9126564424d0dbda08c5166739cef/users/123c2556fb3944aca5b6093fe32b698a/roles/6cb03785fb184ef587509b3174622f69 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:47.243010 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc88daf-7bb9-42f9-80d0-b396faeda4b1 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:47.360793 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc88daf-7bb9-42f9-80d0-b396faeda4b1 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:47.382798 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f9b0aa-54da-4990-8c8d-00e7def14ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:47.383639 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f9b0aa-54da-4990-8c8d-00e7def14ef6 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:47.385317 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f9b0aa-54da-4990-8c8d-00e7def14ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:47.385709 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f9b0aa-54da-4990-8c8d-00e7def14ef6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:47.388076 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f9b0aa-54da-4990-8c8d-00e7def14ef6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:47.402692 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f9b0aa-54da-4990-8c8d-00e7def14ef6 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:47.421206 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 999/1960] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:47 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:35:47.428654 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe74953-c808-4504-b153-22b89d204ba6 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:47.459615 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe74953-c808-4504-b153-22b89d204ba6 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:47.469440 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 962/1961] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:35:47 2022] POST /identity/v3/projects => generated 377 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:35:47.474058 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f9b0aa-54da-4990-8c8d-00e7def14ef6 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:47.476601 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b35a12-b3b0-43d5-9567-f33865bbc461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:47.477321 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b35a12-b3b0-43d5-9567-f33865bbc461 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:47.477616 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b35a12-b3b0-43d5-9567-f33865bbc461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:47.477891 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b35a12-b3b0-43d5-9567-f33865bbc461 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:47.478777 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b35a12-b3b0-43d5-9567-f33865bbc461 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:47.479541 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-59f9b0aa-54da-4990-8c8d-00e7def14ef6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:47.480587 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b35a12-b3b0-43d5-9567-f33865bbc461 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:47.508880 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1000/1962] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:35:47 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:35:47.510015 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b35a12-b3b0-43d5-9567-f33865bbc461 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:47.521512 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b35a12-b3b0-43d5-9567-f33865bbc461 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:47.621210 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f9b0aa-54da-4990-8c8d-00e7def14ef6 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:47.642729 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14567b27-1656-4852-9530-b56a03827742 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a3ed285ee4c4d04abf7daf0aeb9fb7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:47.643481 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14567b27-1656-4852-9530-b56a03827742 service cinder] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:47.643916 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14567b27-1656-4852-9530-b56a03827742 service cinder] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:47.644209 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14567b27-1656-4852-9530-b56a03827742 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:47.678466 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af8955a-220f-4e5a-b58d-a5cdcdb34da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:47.679460 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8955a-220f-4e5a-b58d-a5cdcdb34da4 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:47.679895 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8955a-220f-4e5a-b58d-a5cdcdb34da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:47.680601 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8955a-220f-4e5a-b58d-a5cdcdb34da4 admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:47.681752 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af8955a-220f-4e5a-b58d-a5cdcdb34da4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:47.684065 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af8955a-220f-4e5a-b58d-a5cdcdb34da4 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:47.712124 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1001/1963] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:35:47 2022] POST /identity/v3/users => generated 289 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:35:47.713477 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af8955a-220f-4e5a-b58d-a5cdcdb34da4 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:47.726304 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af8955a-220f-4e5a-b58d-a5cdcdb34da4 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:47.741685 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e6885f-d1dc-4933-aa74-aeb491d1a577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:47.741685 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e6885f-d1dc-4933-aa74-aeb491d1a577 admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:47.741685 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e6885f-d1dc-4933-aa74-aeb491d1a577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:47.741685 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e6885f-d1dc-4933-aa74-aeb491d1a577 admin admin] PATH_INFO: `/v3/projects/41f9126564424d0dbda08c5166739cef/users/123c2556fb3944aca5b6093fe32b698a/roles/6cb03785fb184ef587509b3174622f69` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:47.742966 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e6885f-d1dc-4933-aa74-aeb491d1a577 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41f9126564424d0dbda08c5166739cef, user_id=123c2556fb3944aca5b6093fe32b698a, role_id=6cb03785fb184ef587509b3174622f69)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:47.745221 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e6885f-d1dc-4933-aa74-aeb491d1a577 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:47.753075 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:47.757219 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14567b27-1656-4852-9530-b56a03827742 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:47.760915 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14567b27-1656-4852-9530-b56a03827742 service cinder] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:47.772785 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1002/1964] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:35:47 2022] PUT /identity/v3/projects/41f9126564424d0dbda08c5166739cef/users/123c2556fb3944aca5b6093fe32b698a/roles/6cb03785fb184ef587509b3174622f69 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:47.772785 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e6885f-d1dc-4933-aa74-aeb491d1a577 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:47.793418 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 963/1965] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:35:47 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:35:47.797430 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2672fe64-0446-4df5-a01e-23f249f4916a None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:47.797741 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2672fe64-0446-4df5-a01e-23f249f4916a None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:47.798201 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2672fe64-0446-4df5-a01e-23f249f4916a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:47.823875 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:47.863897 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-2672fe64-0446-4df5-a01e-23f249f4916a None None] MFA Rules not processed for user `123c2556fb3944aca5b6093fe32b698a`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:47.865333 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-2672fe64-0446-4df5-a01e-23f249f4916a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:47.897815 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e6885f-d1dc-4933-aa74-aeb491d1a577 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:47.904619 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0241d0-41ee-4094-b34b-a1a1b145e456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:47.905595 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0241d0-41ee-4094-b34b-a1a1b145e456 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:47.905963 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0241d0-41ee-4094-b34b-a1a1b145e456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:47.906315 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0241d0-41ee-4094-b34b-a1a1b145e456 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:47.907782 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0241d0-41ee-4094-b34b-a1a1b145e456 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:47.909343 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0241d0-41ee-4094-b34b-a1a1b145e456 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:47.926180 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1003/1966] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:35:47 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:35:47.930630 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0241d0-41ee-4094-b34b-a1a1b145e456 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:47.944260 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0241d0-41ee-4094-b34b-a1a1b145e456 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:47.952625 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59051899-e9eb-4a8e-bfdb-5eda952192de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:47.954751 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59051899-e9eb-4a8e-bfdb-5eda952192de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:47.955162 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59051899-e9eb-4a8e-bfdb-5eda952192de admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:47.955483 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59051899-e9eb-4a8e-bfdb-5eda952192de admin admin] PATH_INFO: `/v3/users/c3e7353fd5344d29be8f929d6d3a1836` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:47.957377 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59051899-e9eb-4a8e-bfdb-5eda952192de admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3e7353fd5344d29be8f929d6d3a1836)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:47.959498 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59051899-e9eb-4a8e-bfdb-5eda952192de admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:48.034997 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 964/1967] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:47 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:35:48.036828 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2672fe64-0446-4df5-a01e-23f249f4916a None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:48.045254 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-59051899-e9eb-4a8e-bfdb-5eda952192de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3e7353fd5344d29be8f929d6d3a1836'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:48.046183 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-59051899-e9eb-4a8e-bfdb-5eda952192de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3e7353fd5344d29be8f929d6d3a1836'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:48.060395 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2672fe64-0446-4df5-a01e-23f249f4916a None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:48.065263 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-59051899-e9eb-4a8e-bfdb-5eda952192de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3e7353fd5344d29be8f929d6d3a1836'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:48.070649 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc1f5ea-2975-4e2d-8a7b-bec05aced506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:48.071763 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1f5ea-2975-4e2d-8a7b-bec05aced506 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:48.072387 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1f5ea-2975-4e2d-8a7b-bec05aced506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:48.073341 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1f5ea-2975-4e2d-8a7b-bec05aced506 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:48.075564 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc1f5ea-2975-4e2d-8a7b-bec05aced506 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:48.078830 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc1f5ea-2975-4e2d-8a7b-bec05aced506 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:48.080442 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-59051899-e9eb-4a8e-bfdb-5eda952192de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3e7353fd5344d29be8f929d6d3a1836'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:48.091747 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-59051899-e9eb-4a8e-bfdb-5eda952192de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3e7353fd5344d29be8f929d6d3a1836'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:48.097266 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 965/1968] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:35:48 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:35:48.098304 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc1f5ea-2975-4e2d-8a7b-bec05aced506 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:48.100059 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-dbc1f5ea-2975-4e2d-8a7b-bec05aced506 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:48.103422 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1004/1969] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:35:47 2022] DELETE /identity/v3/users/c3e7353fd5344d29be8f929d6d3a1836 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:48.104717 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59051899-e9eb-4a8e-bfdb-5eda952192de admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:48.106894 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-59051899-e9eb-4a8e-bfdb-5eda952192de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:48.189251 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc1f5ea-2975-4e2d-8a7b-bec05aced506 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:48.214710 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59051899-e9eb-4a8e-bfdb-5eda952192de admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:48.224320 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ae07fe-4a6c-4add-aed8-8ff6ede61468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:48.226494 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae07fe-4a6c-4add-aed8-8ff6ede61468 admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:48.227762 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae07fe-4a6c-4add-aed8-8ff6ede61468 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:48.228061 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae07fe-4a6c-4add-aed8-8ff6ede61468 admin admin] PATH_INFO: `/v3/projects/5e9f37b745b8421c8d57ea44604845a4/users/ba1a04284676439d941b25de16c46199/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:48.252171 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:48.258512 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ae07fe-4a6c-4add-aed8-8ff6ede61468 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e9f37b745b8421c8d57ea44604845a4, user_id=ba1a04284676439d941b25de16c46199, role_id=4cbf6ec846eb4b7c8cc52e9bfd6f076f)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:48.263414 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ae07fe-4a6c-4add-aed8-8ff6ede61468 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:48.271918 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce62f5-b8d0-4120-a918-b61681733158 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a3ed285ee4c4d04abf7daf0aeb9fb7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:48.272934 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce62f5-b8d0-4120-a918-b61681733158 service cinder] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:48.273568 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce62f5-b8d0-4120-a918-b61681733158 service cinder] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:48.274045 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce62f5-b8d0-4120-a918-b61681733158 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:48.281010 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-a9ce62f5-b8d0-4120-a918-b61681733158 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:48.292234 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1005/1970] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:35:48 2022] PUT /identity/v3/projects/5e9f37b745b8421c8d57ea44604845a4/users/ba1a04284676439d941b25de16c46199/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:48.298782 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb209a-cf43-464b-8da3-481abb82d760 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:48.299215 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb209a-cf43-464b-8da3-481abb82d760 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:48.299880 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb209a-cf43-464b-8da3-481abb82d760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:48.330910 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-c1fb209a-cf43-464b-8da3-481abb82d760 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:48.332253 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-c1fb209a-cf43-464b-8da3-481abb82d760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:48.375806 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:48.407064 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ce62f5-b8d0-4120-a918-b61681733158 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:48.409037 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ce62f5-b8d0-4120-a918-b61681733158 service cinder] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:48.426999 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 966/1971] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:35:48 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:35:48.428710 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ce464-141b-4877-8633-2d0a8618a4c3 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:48.429099 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ce464-141b-4877-8633-2d0a8618a4c3 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:48.429582 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ce464-141b-4877-8633-2d0a8618a4c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:48.434774 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1006/1972] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:35:48.442104 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fb209a-cf43-464b-8da3-481abb82d760 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:48.443901 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-c1fb209a-cf43-464b-8da3-481abb82d760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:48.475009 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-de1ce464-141b-4877-8633-2d0a8618a4c3 None None] MFA Rules not processed for user `ba1a04284676439d941b25de16c46199`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:48.480544 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-de1ce464-141b-4877-8633-2d0a8618a4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:48.572772 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fb209a-cf43-464b-8da3-481abb82d760 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:48.588424 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea618de-9254-4b6d-8c28-f21f01000915 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:48.589395 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea618de-9254-4b6d-8c28-f21f01000915 service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:48.590814 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea618de-9254-4b6d-8c28-f21f01000915 service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:48.592851 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea618de-9254-4b6d-8c28-f21f01000915 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:48.619896 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea618de-9254-4b6d-8c28-f21f01000915 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:48.621953 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea618de-9254-4b6d-8c28-f21f01000915 service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:48.648420 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1007/1973] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:35:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 19:35:48.668684 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 967/1974] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:35:48.674972 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea618de-9254-4b6d-8c28-f21f01000915 service neutron] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:48.694114 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea618de-9254-4b6d-8c28-f21f01000915 service neutron] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:48.699365 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c27644-3d22-43e8-ad63-e5792460fb0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:48.701670 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c27644-3d22-43e8-ad63-e5792460fb0a admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:48.701967 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c27644-3d22-43e8-ad63-e5792460fb0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:48.702278 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c27644-3d22-43e8-ad63-e5792460fb0a admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:48.703492 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c27644-3d22-43e8-ad63-e5792460fb0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:48.705726 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c27644-3d22-43e8-ad63-e5792460fb0a admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:48.778003 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1008/1975] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:35:48 2022] POST /identity/v3/projects => generated 379 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:35:48.779126 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ce464-141b-4877-8633-2d0a8618a4c3 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:48.812305 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ce464-141b-4877-8633-2d0a8618a4c3 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:48.975332 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c266b-1fbb-4ab9-b1b7-e93f91b30994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:48.976442 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c266b-1fbb-4ab9-b1b7-e93f91b30994 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:48.976772 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c266b-1fbb-4ab9-b1b7-e93f91b30994 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:48.985511 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c266b-1fbb-4ab9-b1b7-e93f91b30994 admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:48.986733 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34c266b-1fbb-4ab9-b1b7-e93f91b30994 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:48.989299 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34c266b-1fbb-4ab9-b1b7-e93f91b30994 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:49.041394 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 968/1976] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:35:48 2022] POST /identity/v3/users => generated 296 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:35:49.043255 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c27644-3d22-43e8-ad63-e5792460fb0a admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:49.060023 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c27644-3d22-43e8-ad63-e5792460fb0a admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:49.073862 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50307983-6175-42e0-b20b-740ffd81aa39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:49.075931 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50307983-6175-42e0-b20b-740ffd81aa39 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:49.077001 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50307983-6175-42e0-b20b-740ffd81aa39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:49.077377 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50307983-6175-42e0-b20b-740ffd81aa39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:49.078398 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50307983-6175-42e0-b20b-740ffd81aa39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:49.082557 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50307983-6175-42e0-b20b-740ffd81aa39 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:49.099892 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1009/1977] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:35:49 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:35:49.105707 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c266b-1fbb-4ab9-b1b7-e93f91b30994 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:49.122792 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c266b-1fbb-4ab9-b1b7-e93f91b30994 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:49.138666 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40183a78-e8d1-4fba-a7e9-cdd27ea1c508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:49.139641 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40183a78-e8d1-4fba-a7e9-cdd27ea1c508 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:49.139931 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40183a78-e8d1-4fba-a7e9-cdd27ea1c508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:49.140213 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40183a78-e8d1-4fba-a7e9-cdd27ea1c508 admin admin] PATH_INFO: `/v3/projects/eb5b38adbf0944629dc4217646bbadf9/users/d994be1468e8462485590d40a3d1d343/roles/6cb03785fb184ef587509b3174622f69` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:49.165727 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40183a78-e8d1-4fba-a7e9-cdd27ea1c508 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb5b38adbf0944629dc4217646bbadf9, user_id=d994be1468e8462485590d40a3d1d343, role_id=6cb03785fb184ef587509b3174622f69)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:49.177272 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40183a78-e8d1-4fba-a7e9-cdd27ea1c508 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:49.207896 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 969/1978] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:35:49 2022] PUT /identity/v3/projects/eb5b38adbf0944629dc4217646bbadf9/users/d994be1468e8462485590d40a3d1d343/roles/6cb03785fb184ef587509b3174622f69 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:49.214548 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50307983-6175-42e0-b20b-740ffd81aa39 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:49.231545 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50307983-6175-42e0-b20b-740ffd81aa39 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:49.239287 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40183a78-e8d1-4fba-a7e9-cdd27ea1c508 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:49.313917 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:49.340464 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40183a78-e8d1-4fba-a7e9-cdd27ea1c508 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:49.347276 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2169e8df-14a5-4f5b-8bf3-a6def5ba72fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:49.347579 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7a4075-7f1f-44fb-b6f0-838d893d8ece tempest-VolumeQuotaClassesTest-1151108131 tempest-VolumeQuotaClassesTest-1151108131-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '123c2556fb3944aca5b6093fe32b698a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f9126564424d0dbda08c5166739cef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:49.348071 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a4075-7f1f-44fb-b6f0-838d893d8ece tempest-VolumeQuotaClassesTest-1151108131 tempest-VolumeQuotaClassesTest-1151108131-project-admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:49.348210 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169e8df-14a5-4f5b-8bf3-a6def5ba72fe admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:49.348611 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a4075-7f1f-44fb-b6f0-838d893d8ece tempest-VolumeQuotaClassesTest-1151108131 tempest-VolumeQuotaClassesTest-1151108131-project-admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:49.348742 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169e8df-14a5-4f5b-8bf3-a6def5ba72fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:49.348934 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a4075-7f1f-44fb-b6f0-838d893d8ece tempest-VolumeQuotaClassesTest-1151108131 tempest-VolumeQuotaClassesTest-1151108131-project-admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:49.349040 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169e8df-14a5-4f5b-8bf3-a6def5ba72fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:49.349868 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7a4075-7f1f-44fb-b6f0-838d893d8ece tempest-VolumeQuotaClassesTest-1151108131 tempest-VolumeQuotaClassesTest-1151108131-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:35:49.350036 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2169e8df-14a5-4f5b-8bf3-a6def5ba72fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:49.350185 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7a4075-7f1f-44fb-b6f0-838d893d8ece tempest-VolumeQuotaClassesTest-1151108131 tempest-VolumeQuotaClassesTest-1151108131-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:49.351817 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2169e8df-14a5-4f5b-8bf3-a6def5ba72fe admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:49.352025 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7a4075-7f1f-44fb-b6f0-838d893d8ece tempest-VolumeQuotaClassesTest-1151108131 tempest-VolumeQuotaClassesTest-1151108131-project-admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:49.355097 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:49.371496 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1010/1979] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:35:49 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:35:49.373411 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2169e8df-14a5-4f5b-8bf3-a6def5ba72fe admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:49.375289 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 970/1980] 10.222.0.26 () {58 vars in 1152 bytes} [Fri Jul 1 19:35:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:35:49.376498 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7a4075-7f1f-44fb-b6f0-838d893d8ece tempest-VolumeQuotaClassesTest-1151108131 tempest-VolumeQuotaClassesTest-1151108131-project-admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:49.379527 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-2169e8df-14a5-4f5b-8bf3-a6def5ba72fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:49.381103 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-fb7a4075-7f1f-44fb-b6f0-838d893d8ece tempest-VolumeQuotaClassesTest-1151108131 tempest-VolumeQuotaClassesTest-1151108131-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:49.399527 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2169e8df-14a5-4f5b-8bf3-a6def5ba72fe admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:49.402812 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7a4075-7f1f-44fb-b6f0-838d893d8ece tempest-VolumeQuotaClassesTest-1151108131 tempest-VolumeQuotaClassesTest-1151108131-project-admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:49.405924 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a3c353-fe0c-4792-9f24-5fdae8369d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:49.407160 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a3c353-fe0c-4792-9f24-5fdae8369d18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:49.407662 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a3c353-fe0c-4792-9f24-5fdae8369d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:49.408095 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a3c353-fe0c-4792-9f24-5fdae8369d18 admin admin] PATH_INFO: `/v3/projects/2dd9c1a452db475fb92e05b1be70016f` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:49.408526 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66acf78-dde4-47d9-9b89-764678d1a3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:49.409540 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66acf78-dde4-47d9-9b89-764678d1a3f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:49.410619 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66acf78-dde4-47d9-9b89-764678d1a3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:49.410751 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a3c353-fe0c-4792-9f24-5fdae8369d18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2dd9c1a452db475fb92e05b1be70016f)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:49.410833 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66acf78-dde4-47d9-9b89-764678d1a3f4 admin admin] PATH_INFO: `/v3/users/62dabefe9d844b2fbf4bb51d83ce8075` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:49.411717 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66acf78-dde4-47d9-9b89-764678d1a3f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62dabefe9d844b2fbf4bb51d83ce8075)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:49.413797 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66acf78-dde4-47d9-9b89-764678d1a3f4 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:49.414272 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a3c353-fe0c-4792-9f24-5fdae8369d18 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:49.489076 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-27a3c353-fe0c-4792-9f24-5fdae8369d18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2dd9c1a452db475fb92e05b1be70016f', 'request_id': 'req-27a3c353-fe0c-4792-9f24-5fdae8369d18'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:49.490897 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-c66acf78-dde4-47d9-9b89-764678d1a3f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62dabefe9d844b2fbf4bb51d83ce8075'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:49.493085 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-c66acf78-dde4-47d9-9b89-764678d1a3f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62dabefe9d844b2fbf4bb51d83ce8075'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:49.497835 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-27a3c353-fe0c-4792-9f24-5fdae8369d18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2dd9c1a452db475fb92e05b1be70016f', 'request_id': 'req-27a3c353-fe0c-4792-9f24-5fdae8369d18'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:49.504865 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-27a3c353-fe0c-4792-9f24-5fdae8369d18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2dd9c1a452db475fb92e05b1be70016f', 'request_id': 'req-27a3c353-fe0c-4792-9f24-5fdae8369d18'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:49.510265 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-c66acf78-dde4-47d9-9b89-764678d1a3f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62dabefe9d844b2fbf4bb51d83ce8075'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:49.522968 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-c66acf78-dde4-47d9-9b89-764678d1a3f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62dabefe9d844b2fbf4bb51d83ce8075'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:49.523377 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-27a3c353-fe0c-4792-9f24-5fdae8369d18 admin admin] The token cache is being invalidate because project 2dd9c1a452db475fb92e05b1be70016f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:35:49.523829 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-27a3c353-fe0c-4792-9f24-5fdae8369d18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:49.524642 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-27a3c353-fe0c-4792-9f24-5fdae8369d18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:49.526331 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-c66acf78-dde4-47d9-9b89-764678d1a3f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62dabefe9d844b2fbf4bb51d83ce8075'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:49.527561 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1011/1981] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:35:49 2022] DELETE /identity/v3/projects/2dd9c1a452db475fb92e05b1be70016f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:49.528498 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a3c353-fe0c-4792-9f24-5fdae8369d18 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:49.533752 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-27a3c353-fe0c-4792-9f24-5fdae8369d18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:49.567211 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 971/1982] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:35:49 2022] DELETE /identity/v3/users/62dabefe9d844b2fbf4bb51d83ce8075 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:49.567847 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66acf78-dde4-47d9-9b89-764678d1a3f4 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:49.569723 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-c66acf78-dde4-47d9-9b89-764678d1a3f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:49.613083 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a3c353-fe0c-4792-9f24-5fdae8369d18 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:49.654256 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66acf78-dde4-47d9-9b89-764678d1a3f4 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:49.659480 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c51933-e02f-4fc6-8768-f5ab95c8b0b3 tempest-VolumeQuotaClassesTest-1151108131 tempest-VolumeQuotaClassesTest-1151108131-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '123c2556fb3944aca5b6093fe32b698a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f9126564424d0dbda08c5166739cef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:49.660492 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c51933-e02f-4fc6-8768-f5ab95c8b0b3 tempest-VolumeQuotaClassesTest-1151108131 tempest-VolumeQuotaClassesTest-1151108131-project-admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:49.660791 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c51933-e02f-4fc6-8768-f5ab95c8b0b3 tempest-VolumeQuotaClassesTest-1151108131 tempest-VolumeQuotaClassesTest-1151108131-project-admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:49.661077 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c51933-e02f-4fc6-8768-f5ab95c8b0b3 tempest-VolumeQuotaClassesTest-1151108131 tempest-VolumeQuotaClassesTest-1151108131-project-admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:49.662141 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c51933-e02f-4fc6-8768-f5ab95c8b0b3 tempest-VolumeQuotaClassesTest-1151108131 tempest-VolumeQuotaClassesTest-1151108131-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:49.664943 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c51933-e02f-4fc6-8768-f5ab95c8b0b3 tempest-VolumeQuotaClassesTest-1151108131 tempest-VolumeQuotaClassesTest-1151108131-project-admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:49.686347 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4565d33-1892-4a32-b386-1a7e09cbdc9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:49.687633 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4565d33-1892-4a32-b386-1a7e09cbdc9d admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:49.688110 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4565d33-1892-4a32-b386-1a7e09cbdc9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:49.688525 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4565d33-1892-4a32-b386-1a7e09cbdc9d admin admin] PATH_INFO: `/v3/projects/eb5b38adbf0944629dc4217646bbadf9/users/d994be1468e8462485590d40a3d1d343/roles/6cb03785fb184ef587509b3174622f69` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:49.690913 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4565d33-1892-4a32-b386-1a7e09cbdc9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb5b38adbf0944629dc4217646bbadf9, user_id=d994be1468e8462485590d40a3d1d343, role_id=6cb03785fb184ef587509b3174622f69)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:49.694636 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4565d33-1892-4a32-b386-1a7e09cbdc9d admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:49.708355 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 972/1983] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:35:49 2022] POST /identity/v3/projects => generated 354 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:35:49.708355 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c51933-e02f-4fc6-8768-f5ab95c8b0b3 tempest-VolumeQuotaClassesTest-1151108131 tempest-VolumeQuotaClassesTest-1151108131-project-admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:49.708611 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-68c51933-e02f-4fc6-8768-f5ab95c8b0b3 tempest-VolumeQuotaClassesTest-1151108131 tempest-VolumeQuotaClassesTest-1151108131-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:49.708967 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1012/1984] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:35:49 2022] PUT /identity/v3/projects/eb5b38adbf0944629dc4217646bbadf9/users/d994be1468e8462485590d40a3d1d343/roles/6cb03785fb184ef587509b3174622f69 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:49.710674 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bafe68-23b4-4fff-82e7-fa8328541915 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:49.711723 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bafe68-23b4-4fff-82e7-fa8328541915 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:49.712027 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bafe68-23b4-4fff-82e7-fa8328541915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:49.742448 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-56bafe68-23b4-4fff-82e7-fa8328541915 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:49.745028 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-56bafe68-23b4-4fff-82e7-fa8328541915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:49.786953 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:49.788843 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:49.868752 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c51933-e02f-4fc6-8768-f5ab95c8b0b3 tempest-VolumeQuotaClassesTest-1151108131 tempest-VolumeQuotaClassesTest-1151108131-project-admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:49.894367 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a49abb-a206-4dfe-8572-5462c9b387d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:49.894587 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1013/1985] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:35:49.894671 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a49abb-a206-4dfe-8572-5462c9b387d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:49.895117 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a49abb-a206-4dfe-8572-5462c9b387d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:49.896056 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bafe68-23b4-4fff-82e7-fa8328541915 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:49.896166 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a49abb-a206-4dfe-8572-5462c9b387d9 admin admin] PATH_INFO: `/v3/users/82b1b77a267f4680a49bdcc9d7bda876` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:49.898233 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a49abb-a206-4dfe-8572-5462c9b387d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82b1b77a267f4680a49bdcc9d7bda876)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:49.898353 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-56bafe68-23b4-4fff-82e7-fa8328541915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:49.901990 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a49abb-a206-4dfe-8572-5462c9b387d9 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:49.979138 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-a3a49abb-a206-4dfe-8572-5462c9b387d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82b1b77a267f4680a49bdcc9d7bda876'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:49.981624 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-a3a49abb-a206-4dfe-8572-5462c9b387d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82b1b77a267f4680a49bdcc9d7bda876'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:49.998625 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-a3a49abb-a206-4dfe-8572-5462c9b387d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82b1b77a267f4680a49bdcc9d7bda876'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:50.012294 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bafe68-23b4-4fff-82e7-fa8328541915 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:50.016894 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-a3a49abb-a206-4dfe-8572-5462c9b387d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82b1b77a267f4680a49bdcc9d7bda876'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:50.018003 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-a3a49abb-a206-4dfe-8572-5462c9b387d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82b1b77a267f4680a49bdcc9d7bda876'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:50.021080 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd81ad8-a4ff-4ea7-a5fb-9356b4eb4d87 tempest-VolumeQuotaClassesTest-1151108131 tempest-VolumeQuotaClassesTest-1151108131-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '123c2556fb3944aca5b6093fe32b698a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f9126564424d0dbda08c5166739cef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:50.022106 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd81ad8-a4ff-4ea7-a5fb-9356b4eb4d87 tempest-VolumeQuotaClassesTest-1151108131 tempest-VolumeQuotaClassesTest-1151108131-project-admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:50.022565 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd81ad8-a4ff-4ea7-a5fb-9356b4eb4d87 tempest-VolumeQuotaClassesTest-1151108131 tempest-VolumeQuotaClassesTest-1151108131-project-admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:50.022947 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd81ad8-a4ff-4ea7-a5fb-9356b4eb4d87 tempest-VolumeQuotaClassesTest-1151108131 tempest-VolumeQuotaClassesTest-1151108131-project-admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:50.023834 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd81ad8-a4ff-4ea7-a5fb-9356b4eb4d87 tempest-VolumeQuotaClassesTest-1151108131 tempest-VolumeQuotaClassesTest-1151108131-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:35:50.025500 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd81ad8-a4ff-4ea7-a5fb-9356b4eb4d87 tempest-VolumeQuotaClassesTest-1151108131 tempest-VolumeQuotaClassesTest-1151108131-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:50.027504 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd81ad8-a4ff-4ea7-a5fb-9356b4eb4d87 tempest-VolumeQuotaClassesTest-1151108131 tempest-VolumeQuotaClassesTest-1151108131-project-admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:50.047830 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1014/1986] 10.222.0.26 () {58 vars in 1152 bytes} [Fri Jul 1 19:35:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:35:50.048960 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b6013e-1651-4323-bedf-b797f4ca3b57 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:50.049384 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b6013e-1651-4323-bedf-b797f4ca3b57 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:50.049873 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b6013e-1651-4323-bedf-b797f4ca3b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:50.054038 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 973/1987] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:35:49 2022] DELETE /identity/v3/users/82b1b77a267f4680a49bdcc9d7bda876 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:50.055528 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a49abb-a206-4dfe-8572-5462c9b387d9 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:50.057454 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-a3a49abb-a206-4dfe-8572-5462c9b387d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:50.151106 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-61b6013e-1651-4323-bedf-b797f4ca3b57 None None] MFA Rules not processed for user `d994be1468e8462485590d40a3d1d343`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:50.158215 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-61b6013e-1651-4323-bedf-b797f4ca3b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:50.170225 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a49abb-a206-4dfe-8572-5462c9b387d9 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:50.174422 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4cec29-9c6c-4658-9740-6869b87cc3a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:50.175171 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4cec29-9c6c-4658-9740-6869b87cc3a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:50.175459 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4cec29-9c6c-4658-9740-6869b87cc3a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:50.175739 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4cec29-9c6c-4658-9740-6869b87cc3a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:50.177789 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-3c4cec29-9c6c-4658-9740-6869b87cc3a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:50.318223 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1015/1988] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:50 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:35:50.319111 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b6013e-1651-4323-bedf-b797f4ca3b57 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:50.325222 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-61b6013e-1651-4323-bedf-b797f4ca3b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:50.333210 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4cec29-9c6c-4658-9740-6869b87cc3a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:50.336151 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4cec29-9c6c-4658-9740-6869b87cc3a4 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:50.357297 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 974/1989] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:35:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:35:50.358884 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4cec29-9c6c-4658-9740-6869b87cc3a4 service neutron] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:50.360560 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-3c4cec29-9c6c-4658-9740-6869b87cc3a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:50.366884 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:50.422278 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:50.451733 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b6013e-1651-4323-bedf-b797f4ca3b57 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:50.452250 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4cec29-9c6c-4658-9740-6869b87cc3a4 service neutron] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:50.457720 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d13d5-92d4-4d9d-a3e1-b36fca0c494c tempest-VolumeQuotaClassesTest-1151108131 tempest-VolumeQuotaClassesTest-1151108131-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '123c2556fb3944aca5b6093fe32b698a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f9126564424d0dbda08c5166739cef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:50.459004 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d13d5-92d4-4d9d-a3e1-b36fca0c494c tempest-VolumeQuotaClassesTest-1151108131 tempest-VolumeQuotaClassesTest-1151108131-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:50.459124 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b0528-149b-48d8-877f-3aa9008ba42f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a3ed285ee4c4d04abf7daf0aeb9fb7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:50.459403 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d13d5-92d4-4d9d-a3e1-b36fca0c494c tempest-VolumeQuotaClassesTest-1151108131 tempest-VolumeQuotaClassesTest-1151108131-project-admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:50.459757 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d13d5-92d4-4d9d-a3e1-b36fca0c494c tempest-VolumeQuotaClassesTest-1151108131 tempest-VolumeQuotaClassesTest-1151108131-project-admin] PATH_INFO: `/v3/projects/92378ae6f9934143a05c78202bab376d` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:50.459961 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b0528-149b-48d8-877f-3aa9008ba42f service cinder] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:50.460368 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b0528-149b-48d8-877f-3aa9008ba42f service cinder] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:50.460750 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b0528-149b-48d8-877f-3aa9008ba42f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:50.461925 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981d13d5-92d4-4d9d-a3e1-b36fca0c494c tempest-VolumeQuotaClassesTest-1151108131 tempest-VolumeQuotaClassesTest-1151108131-project-admin] RBAC: Authorizing `identity:delete_project(project_id=92378ae6f9934143a05c78202bab376d)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:50.464185 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981d13d5-92d4-4d9d-a3e1-b36fca0c494c tempest-VolumeQuotaClassesTest-1151108131 tempest-VolumeQuotaClassesTest-1151108131-project-admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:50.475952 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826b0528-149b-48d8-877f-3aa9008ba42f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:50.478313 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826b0528-149b-48d8-877f-3aa9008ba42f service cinder] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:50.496613 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 975/1990] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:35:50 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:35:50.549946 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-981d13d5-92d4-4d9d-a3e1-b36fca0c494c tempest-VolumeQuotaClassesTest-1151108131 tempest-VolumeQuotaClassesTest-1151108131-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92378ae6f9934143a05c78202bab376d', 'request_id': 'req-981d13d5-92d4-4d9d-a3e1-b36fca0c494c'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:50.562863 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-981d13d5-92d4-4d9d-a3e1-b36fca0c494c tempest-VolumeQuotaClassesTest-1151108131 tempest-VolumeQuotaClassesTest-1151108131-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92378ae6f9934143a05c78202bab376d', 'request_id': 'req-981d13d5-92d4-4d9d-a3e1-b36fca0c494c'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:50.571730 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b0528-149b-48d8-877f-3aa9008ba42f service cinder] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:50.573010 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-981d13d5-92d4-4d9d-a3e1-b36fca0c494c tempest-VolumeQuotaClassesTest-1151108131 tempest-VolumeQuotaClassesTest-1151108131-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92378ae6f9934143a05c78202bab376d', 'request_id': 'req-981d13d5-92d4-4d9d-a3e1-b36fca0c494c'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:50.574380 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-826b0528-149b-48d8-877f-3aa9008ba42f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:50.595294 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b0528-149b-48d8-877f-3aa9008ba42f service cinder] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:50.633521 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-981d13d5-92d4-4d9d-a3e1-b36fca0c494c tempest-VolumeQuotaClassesTest-1151108131 tempest-VolumeQuotaClassesTest-1151108131-project-admin] The token cache is being invalidate because project 92378ae6f9934143a05c78202bab376d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:35:50.636264 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-981d13d5-92d4-4d9d-a3e1-b36fca0c494c tempest-VolumeQuotaClassesTest-1151108131 tempest-VolumeQuotaClassesTest-1151108131-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:50.638376 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-981d13d5-92d4-4d9d-a3e1-b36fca0c494c tempest-VolumeQuotaClassesTest-1151108131 tempest-VolumeQuotaClassesTest-1151108131-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:50.647089 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1016/1991] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:35:50 2022] DELETE /identity/v3/projects/92378ae6f9934143a05c78202bab376d => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:50.708798 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d13d5-92d4-4d9d-a3e1-b36fca0c494c tempest-VolumeQuotaClassesTest-1151108131 tempest-VolumeQuotaClassesTest-1151108131-project-admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:50.710624 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-981d13d5-92d4-4d9d-a3e1-b36fca0c494c tempest-VolumeQuotaClassesTest-1151108131 tempest-VolumeQuotaClassesTest-1151108131-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:50.749817 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52f647d-94a1-423d-8410-ba41577e943d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a3ed285ee4c4d04abf7daf0aeb9fb7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:50.750741 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f647d-94a1-423d-8410-ba41577e943d service cinder] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:50.751347 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f647d-94a1-423d-8410-ba41577e943d service cinder] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:50.751839 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f647d-94a1-423d-8410-ba41577e943d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:50.755132 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-d52f647d-94a1-423d-8410-ba41577e943d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:50.886495 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52f647d-94a1-423d-8410-ba41577e943d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:50.893810 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52f647d-94a1-423d-8410-ba41577e943d service cinder] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:50.917600 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 976/1992] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:35:50 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:35:50.970770 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d13d5-92d4-4d9d-a3e1-b36fca0c494c tempest-VolumeQuotaClassesTest-1151108131 tempest-VolumeQuotaClassesTest-1151108131-project-admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:50.984910 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b93a67-48df-4dc1-ad77-bbf7685a1442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:50.987696 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b93a67-48df-4dc1-ad77-bbf7685a1442 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:50.987696 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b93a67-48df-4dc1-ad77-bbf7685a1442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:50.987696 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b93a67-48df-4dc1-ad77-bbf7685a1442 admin admin] PATH_INFO: `/v3/projects/e9b5b4dbe6ed4631b5818ded8ca2d5f3` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:50.987696 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b93a67-48df-4dc1-ad77-bbf7685a1442 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9b5b4dbe6ed4631b5818ded8ca2d5f3)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:50.989808 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b93a67-48df-4dc1-ad77-bbf7685a1442 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:51.023365 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52f647d-94a1-423d-8410-ba41577e943d service cinder] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:51.024952 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-d52f647d-94a1-423d-8410-ba41577e943d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:51.078210 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52f647d-94a1-423d-8410-ba41577e943d service cinder] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:51.087296 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9da5c5-a83e-47d9-b47d-3122da631e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:51.089337 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9da5c5-a83e-47d9-b47d-3122da631e36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:51.089486 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9da5c5-a83e-47d9-b47d-3122da631e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:51.089953 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9da5c5-a83e-47d9-b47d-3122da631e36 admin admin] PATH_INFO: `/v3/projects/d881978a82424b5e9195cf1e6e81eaa4` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:51.091427 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9da5c5-a83e-47d9-b47d-3122da631e36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d881978a82424b5e9195cf1e6e81eaa4)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:51.093753 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9da5c5-a83e-47d9-b47d-3122da631e36 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:51.148220 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-93b93a67-48df-4dc1-ad77-bbf7685a1442 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9b5b4dbe6ed4631b5818ded8ca2d5f3', 'request_id': 'req-93b93a67-48df-4dc1-ad77-bbf7685a1442'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:51.165912 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-93b93a67-48df-4dc1-ad77-bbf7685a1442 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9b5b4dbe6ed4631b5818ded8ca2d5f3', 'request_id': 'req-93b93a67-48df-4dc1-ad77-bbf7685a1442'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:51.180144 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-93b93a67-48df-4dc1-ad77-bbf7685a1442 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9b5b4dbe6ed4631b5818ded8ca2d5f3', 'request_id': 'req-93b93a67-48df-4dc1-ad77-bbf7685a1442'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:51.214478 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-0b9da5c5-a83e-47d9-b47d-3122da631e36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd881978a82424b5e9195cf1e6e81eaa4', 'request_id': 'req-0b9da5c5-a83e-47d9-b47d-3122da631e36'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:51.216702 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:51.220672 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-93b93a67-48df-4dc1-ad77-bbf7685a1442 admin admin] The token cache is being invalidate because project e9b5b4dbe6ed4631b5818ded8ca2d5f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:35:51.221064 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-93b93a67-48df-4dc1-ad77-bbf7685a1442 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:51.222113 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-93b93a67-48df-4dc1-ad77-bbf7685a1442 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:51.230918 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1017/1993] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:35:50 2022] DELETE /identity/v3/projects/e9b5b4dbe6ed4631b5818ded8ca2d5f3 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:51.231160 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:51.231300 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b93a67-48df-4dc1-ad77-bbf7685a1442 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:51.235263 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-93b93a67-48df-4dc1-ad77-bbf7685a1442 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:51.235441 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-0b9da5c5-a83e-47d9-b47d-3122da631e36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd881978a82424b5e9195cf1e6e81eaa4', 'request_id': 'req-0b9da5c5-a83e-47d9-b47d-3122da631e36'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:51.250216 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-0b9da5c5-a83e-47d9-b47d-3122da631e36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd881978a82424b5e9195cf1e6e81eaa4', 'request_id': 'req-0b9da5c5-a83e-47d9-b47d-3122da631e36'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:51.270340 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-0b9da5c5-a83e-47d9-b47d-3122da631e36 admin admin] The token cache is being invalidate because project d881978a82424b5e9195cf1e6e81eaa4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:35:51.270800 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-0b9da5c5-a83e-47d9-b47d-3122da631e36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:51.271689 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-0b9da5c5-a83e-47d9-b47d-3122da631e36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:51.273990 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 977/1994] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:35:51 2022] DELETE /identity/v3/projects/d881978a82424b5e9195cf1e6e81eaa4 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 19:35:51.275587 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f3bd62-cb59-4487-8f31-6490b516d992 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:51.275970 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f3bd62-cb59-4487-8f31-6490b516d992 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:51.276348 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f3bd62-cb59-4487-8f31-6490b516d992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:51.313100 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-d0f3bd62-cb59-4487-8f31-6490b516d992 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:51.314512 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-d0f3bd62-cb59-4487-8f31-6490b516d992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:51.396813 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b93a67-48df-4dc1-ad77-bbf7685a1442 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:51.452399 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 978/1995] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:35:51.453873 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f3bd62-cb59-4487-8f31-6490b516d992 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:51.464705 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-d0f3bd62-cb59-4487-8f31-6490b516d992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:51.493839 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f3bd62-cb59-4487-8f31-6490b516d992 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:51.500878 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00da77b-8336-46b2-afe3-a81b3dd3f19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:51.502081 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00da77b-8336-46b2-afe3-a81b3dd3f19f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:51.502362 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00da77b-8336-46b2-afe3-a81b3dd3f19f admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:51.502901 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00da77b-8336-46b2-afe3-a81b3dd3f19f admin admin] PATH_INFO: `/v3/users/3ef185f0c28b40eebf3a48a657faea0d` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:51.504105 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00da77b-8336-46b2-afe3-a81b3dd3f19f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ef185f0c28b40eebf3a48a657faea0d)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:51.506205 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00da77b-8336-46b2-afe3-a81b3dd3f19f admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:51.601622 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91326a3f-1df0-4dc8-a492-963a6a611a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:51.603317 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91326a3f-1df0-4dc8-a492-963a6a611a6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:51.603675 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91326a3f-1df0-4dc8-a492-963a6a611a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:51.604027 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91326a3f-1df0-4dc8-a492-963a6a611a6b admin admin] PATH_INFO: `/v3/users/f0b9fe6206a14201b33186977088d6f0` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:51.607819 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91326a3f-1df0-4dc8-a492-963a6a611a6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0b9fe6206a14201b33186977088d6f0)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:51.610555 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91326a3f-1df0-4dc8-a492-963a6a611a6b admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:51.630621 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f00da77b-8336-46b2-afe3-a81b3dd3f19f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ef185f0c28b40eebf3a48a657faea0d'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:51.630621 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f00da77b-8336-46b2-afe3-a81b3dd3f19f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ef185f0c28b40eebf3a48a657faea0d'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:51.654361 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f00da77b-8336-46b2-afe3-a81b3dd3f19f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ef185f0c28b40eebf3a48a657faea0d'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:51.669015 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f00da77b-8336-46b2-afe3-a81b3dd3f19f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ef185f0c28b40eebf3a48a657faea0d'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:51.670524 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f00da77b-8336-46b2-afe3-a81b3dd3f19f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ef185f0c28b40eebf3a48a657faea0d'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:51.721005 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 979/1996] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:35:51 2022] DELETE /identity/v3/users/3ef185f0c28b40eebf3a48a657faea0d => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:51.721005 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7080a8d-8a53-4080-b733-116b9c88a3e2 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:51.721005 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7080a8d-8a53-4080-b733-116b9c88a3e2 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:51.721005 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7080a8d-8a53-4080-b733-116b9c88a3e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:51.756119 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-91326a3f-1df0-4dc8-a492-963a6a611a6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0b9fe6206a14201b33186977088d6f0'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:51.759765 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-91326a3f-1df0-4dc8-a492-963a6a611a6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0b9fe6206a14201b33186977088d6f0'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:51.787256 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-91326a3f-1df0-4dc8-a492-963a6a611a6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0b9fe6206a14201b33186977088d6f0'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:51.800052 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-d7080a8d-8a53-4080-b733-116b9c88a3e2 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:51.805194 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-d7080a8d-8a53-4080-b733-116b9c88a3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:51.806400 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-91326a3f-1df0-4dc8-a492-963a6a611a6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0b9fe6206a14201b33186977088d6f0'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:51.833999 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-91326a3f-1df0-4dc8-a492-963a6a611a6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0b9fe6206a14201b33186977088d6f0'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:51.853306 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1018/1997] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:35:51 2022] DELETE /identity/v3/users/f0b9fe6206a14201b33186977088d6f0 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:51.854865 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b0359-671f-4fe5-8f89-5b4ca6ab404a None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:51.855155 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b0359-671f-4fe5-8f89-5b4ca6ab404a None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:51.855434 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b0359-671f-4fe5-8f89-5b4ca6ab404a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:51.915303 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-5e7b0359-671f-4fe5-8f89-5b4ca6ab404a None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:51.920559 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-5e7b0359-671f-4fe5-8f89-5b4ca6ab404a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:51.948266 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:51.950367 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:51.993952 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 980/1998] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:35:51.998876 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7080a8d-8a53-4080-b733-116b9c88a3e2 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:52.017913 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7080a8d-8a53-4080-b733-116b9c88a3e2 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:52.067245 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1019/1999] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:35:52.087864 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7b0359-671f-4fe5-8f89-5b4ca6ab404a None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:52.090219 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-5e7b0359-671f-4fe5-8f89-5b4ca6ab404a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:52.188176 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bc6648-74f7-46a9-9f5f-9e00f354a80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:52.189526 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc6648-74f7-46a9-9f5f-9e00f354a80a admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:52.189877 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc6648-74f7-46a9-9f5f-9e00f354a80a admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:52.191436 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc6648-74f7-46a9-9f5f-9e00f354a80a admin admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:52.192251 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bc6648-74f7-46a9-9f5f-9e00f354a80a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:35:52.192563 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bc6648-74f7-46a9-9f5f-9e00f354a80a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:52.194581 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bc6648-74f7-46a9-9f5f-9e00f354a80a admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:52.210052 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7b0359-671f-4fe5-8f89-5b4ca6ab404a None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:52.217626 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04b9fcd-58c5-4ebe-927b-afa4478bf0e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:52.218236 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 981/2000] 10.222.0.26 () {58 vars in 1152 bytes} [Fri Jul 1 19:35:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:35:52.223231 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b9fcd-58c5-4ebe-927b-afa4478bf0e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:52.223753 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b9fcd-58c5-4ebe-927b-afa4478bf0e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:52.224718 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bc6648-74f7-46a9-9f5f-9e00f354a80a admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:52.225315 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b9fcd-58c5-4ebe-927b-afa4478bf0e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:52.239180 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04b9fcd-58c5-4ebe-927b-afa4478bf0e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:52.240483 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bc6648-74f7-46a9-9f5f-9e00f354a80a admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:52.241939 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04b9fcd-58c5-4ebe-927b-afa4478bf0e8 service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:52.246296 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1408f400-e40a-49ec-bebc-8a43f674c410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:52.247244 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408f400-e40a-49ec-bebc-8a43f674c410 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:52.248103 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408f400-e40a-49ec-bebc-8a43f674c410 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:52.248103 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408f400-e40a-49ec-bebc-8a43f674c410 admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:52.249113 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1408f400-e40a-49ec-bebc-8a43f674c410 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:52.251255 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1408f400-e40a-49ec-bebc-8a43f674c410 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:52.257560 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1020/2001] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:35:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 19:35:52.291531 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 982/2002] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:35:52 2022] POST /identity/v3/projects => generated 377 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:35:52.294669 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04b9fcd-58c5-4ebe-927b-afa4478bf0e8 service neutron] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:52.319772 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04b9fcd-58c5-4ebe-927b-afa4478bf0e8 service neutron] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:52.397321 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1408f400-e40a-49ec-bebc-8a43f674c410 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:52.399759 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-1408f400-e40a-49ec-bebc-8a43f674c410 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:52.474029 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67a7b1d-8902-4939-9846-89f55f3af46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:52.475464 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a7b1d-8902-4939-9846-89f55f3af46a admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:52.475755 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a7b1d-8902-4939-9846-89f55f3af46a admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:52.477521 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a7b1d-8902-4939-9846-89f55f3af46a admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:52.479090 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67a7b1d-8902-4939-9846-89f55f3af46a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:52.488622 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67a7b1d-8902-4939-9846-89f55f3af46a admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:52.518508 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1021/2003] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:35:52 2022] POST /identity/v3/users => generated 289 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:35:52.522809 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67a7b1d-8902-4939-9846-89f55f3af46a admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:52.527132 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1408f400-e40a-49ec-bebc-8a43f674c410 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:52.536111 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf49481c-6a03-42f8-b436-aef256fb6b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:52.537525 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf49481c-6a03-42f8-b436-aef256fb6b21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:52.537805 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67a7b1d-8902-4939-9846-89f55f3af46a admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:52.537938 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf49481c-6a03-42f8-b436-aef256fb6b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:52.538134 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf49481c-6a03-42f8-b436-aef256fb6b21 admin admin] PATH_INFO: `/v3/projects/11359997acc8462fa5024bf0bc8778a2` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:52.539823 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf49481c-6a03-42f8-b436-aef256fb6b21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11359997acc8462fa5024bf0bc8778a2)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:52.543179 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf49481c-6a03-42f8-b436-aef256fb6b21 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:52.544786 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22c339e-8dab-4551-bb91-9916647b7fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:52.545747 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c339e-8dab-4551-bb91-9916647b7fd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:52.546229 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c339e-8dab-4551-bb91-9916647b7fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:52.546710 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c339e-8dab-4551-bb91-9916647b7fd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:52.547530 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22c339e-8dab-4551-bb91-9916647b7fd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:52.549196 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22c339e-8dab-4551-bb91-9916647b7fd3 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:52.565555 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1022/2004] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:35:52 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:35:52.570429 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22c339e-8dab-4551-bb91-9916647b7fd3 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:52.583801 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22c339e-8dab-4551-bb91-9916647b7fd3 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:52.591451 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9308632-e424-4d82-b6e0-c1db52ae5953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:52.593168 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9308632-e424-4d82-b6e0-c1db52ae5953 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:52.593899 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9308632-e424-4d82-b6e0-c1db52ae5953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:52.594319 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9308632-e424-4d82-b6e0-c1db52ae5953 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:52.595317 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9308632-e424-4d82-b6e0-c1db52ae5953 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:52.597637 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9308632-e424-4d82-b6e0-c1db52ae5953 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:52.612454 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1023/2005] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:35:52 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:35:52.616470 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9308632-e424-4d82-b6e0-c1db52ae5953 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:52.645757 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-bf49481c-6a03-42f8-b436-aef256fb6b21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11359997acc8462fa5024bf0bc8778a2', 'request_id': 'req-bf49481c-6a03-42f8-b436-aef256fb6b21'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:52.646948 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9308632-e424-4d82-b6e0-c1db52ae5953 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:52.654351 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-bf49481c-6a03-42f8-b436-aef256fb6b21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11359997acc8462fa5024bf0bc8778a2', 'request_id': 'req-bf49481c-6a03-42f8-b436-aef256fb6b21'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:52.664518 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-bf49481c-6a03-42f8-b436-aef256fb6b21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11359997acc8462fa5024bf0bc8778a2', 'request_id': 'req-bf49481c-6a03-42f8-b436-aef256fb6b21'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:52.678471 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:52.688599 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-bf49481c-6a03-42f8-b436-aef256fb6b21 admin admin] The token cache is being invalidate because project 11359997acc8462fa5024bf0bc8778a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:35:52.689091 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-bf49481c-6a03-42f8-b436-aef256fb6b21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:52.689981 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-bf49481c-6a03-42f8-b436-aef256fb6b21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:52.692627 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 983/2006] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:35:52 2022] DELETE /identity/v3/projects/11359997acc8462fa5024bf0bc8778a2 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:52.700247 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc31a3-2aad-42ae-9b88-d57abf093c8e None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:52.701726 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc31a3-2aad-42ae-9b88-d57abf093c8e None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:52.702925 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc31a3-2aad-42ae-9b88-d57abf093c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:52.732284 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:52.757417 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-2fbc31a3-2aad-42ae-9b88-d57abf093c8e None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:52.758761 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-2fbc31a3-2aad-42ae-9b88-d57abf093c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:52.780619 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f3db27-8b33-4587-9296-b183ad6ddc0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:52.782417 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f3db27-8b33-4587-9296-b183ad6ddc0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:52.782902 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f3db27-8b33-4587-9296-b183ad6ddc0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:52.783412 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f3db27-8b33-4587-9296-b183ad6ddc0b admin admin] PATH_INFO: `/v3/projects/6f3cb40f027047f99d4910707c03f058/users/d767776be4834413852c4af5691c15aa/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:52.818500 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f3db27-8b33-4587-9296-b183ad6ddc0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f3cb40f027047f99d4910707c03f058, user_id=d767776be4834413852c4af5691c15aa, role_id=4cbf6ec846eb4b7c8cc52e9bfd6f076f)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:52.822553 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f3db27-8b33-4587-9296-b183ad6ddc0b admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:52.868243 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1024/2007] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:35:52 2022] PUT /identity/v3/projects/6f3cb40f027047f99d4910707c03f058/users/d767776be4834413852c4af5691c15aa/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:52.875849 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a06bca-e95a-479a-a8b9-76d0a400889f None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:52.876145 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a06bca-e95a-479a-a8b9-76d0a400889f None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:52.881461 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a06bca-e95a-479a-a8b9-76d0a400889f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:52.935515 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-85a06bca-e95a-479a-a8b9-76d0a400889f None None] MFA Rules not processed for user `d767776be4834413852c4af5691c15aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:52.939086 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-85a06bca-e95a-479a-a8b9-76d0a400889f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:52.959732 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 984/2008] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:35:52.961462 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbc31a3-2aad-42ae-9b88-d57abf093c8e None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:52.966145 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-2fbc31a3-2aad-42ae-9b88-d57abf093c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:53.001484 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbc31a3-2aad-42ae-9b88-d57abf093c8e None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:53.073462 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1025/2009] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:35:53.079701 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc4ca4f-f2dc-4de7-a438-55007ebf7178 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:53.080144 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc4ca4f-f2dc-4de7-a438-55007ebf7178 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:53.080274 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc4ca4f-f2dc-4de7-a438-55007ebf7178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:53.105542 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-edc4ca4f-f2dc-4de7-a438-55007ebf7178 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:53.107436 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-edc4ca4f-f2dc-4de7-a438-55007ebf7178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:53.145803 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4241090-c975-4203-80d2-c5b98e30847a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:53.146755 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4241090-c975-4203-80d2-c5b98e30847a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:53.147199 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4241090-c975-4203-80d2-c5b98e30847a admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:53.147615 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4241090-c975-4203-80d2-c5b98e30847a admin admin] PATH_INFO: `/v3/projects/25f2ba8788454e0fbf2ea434e37f685f` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:53.149687 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4241090-c975-4203-80d2-c5b98e30847a admin admin] RBAC: Authorizing `identity:delete_project(project_id=25f2ba8788454e0fbf2ea434e37f685f)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:53.152273 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4241090-c975-4203-80d2-c5b98e30847a admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:53.184047 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1026/2010] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:35:53.184778 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc4ca4f-f2dc-4de7-a438-55007ebf7178 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:53.186662 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-edc4ca4f-f2dc-4de7-a438-55007ebf7178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:53.205789 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc4ca4f-f2dc-4de7-a438-55007ebf7178 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:53.212416 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f1c53b-907a-4ba3-9cf6-4e48a6e1eebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:53.213607 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f1c53b-907a-4ba3-9cf6-4e48a6e1eebe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:53.213810 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f1c53b-907a-4ba3-9cf6-4e48a6e1eebe admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:53.213964 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f1c53b-907a-4ba3-9cf6-4e48a6e1eebe admin admin] PATH_INFO: `/v3/users/2db4b840ca744ad6975c4fb3ad5e2351` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:53.215226 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f1c53b-907a-4ba3-9cf6-4e48a6e1eebe admin admin] RBAC: Authorizing `identity:delete_user(user_id=2db4b840ca744ad6975c4fb3ad5e2351)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:53.217910 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f1c53b-907a-4ba3-9cf6-4e48a6e1eebe admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:53.238785 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-b4241090-c975-4203-80d2-c5b98e30847a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25f2ba8788454e0fbf2ea434e37f685f', 'request_id': 'req-b4241090-c975-4203-80d2-c5b98e30847a'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:53.246595 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-b4241090-c975-4203-80d2-c5b98e30847a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25f2ba8788454e0fbf2ea434e37f685f', 'request_id': 'req-b4241090-c975-4203-80d2-c5b98e30847a'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:53.254435 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-b4241090-c975-4203-80d2-c5b98e30847a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25f2ba8788454e0fbf2ea434e37f685f', 'request_id': 'req-b4241090-c975-4203-80d2-c5b98e30847a'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:53.278951 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-b4241090-c975-4203-80d2-c5b98e30847a admin admin] The token cache is being invalidate because project 25f2ba8788454e0fbf2ea434e37f685f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:35:53.279453 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-b4241090-c975-4203-80d2-c5b98e30847a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:53.280515 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-b4241090-c975-4203-80d2-c5b98e30847a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:53.286112 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 985/2011] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:35:52 2022] DELETE /identity/v3/projects/25f2ba8788454e0fbf2ea434e37f685f => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:53.286112 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4241090-c975-4203-80d2-c5b98e30847a admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:53.286811 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-b4241090-c975-4203-80d2-c5b98e30847a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:53.302010 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:53.305118 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-d8f1c53b-907a-4ba3-9cf6-4e48a6e1eebe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2db4b840ca744ad6975c4fb3ad5e2351'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:53.305869 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-d8f1c53b-907a-4ba3-9cf6-4e48a6e1eebe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2db4b840ca744ad6975c4fb3ad5e2351'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:53.331448 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-d8f1c53b-907a-4ba3-9cf6-4e48a6e1eebe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2db4b840ca744ad6975c4fb3ad5e2351'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:53.344144 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-d8f1c53b-907a-4ba3-9cf6-4e48a6e1eebe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2db4b840ca744ad6975c4fb3ad5e2351'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:53.354595 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:53.355680 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-d8f1c53b-907a-4ba3-9cf6-4e48a6e1eebe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2db4b840ca744ad6975c4fb3ad5e2351'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:53.366788 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1027/2012] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:35:53 2022] DELETE /identity/v3/users/2db4b840ca744ad6975c4fb3ad5e2351 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:53.367804 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f1c53b-907a-4ba3-9cf6-4e48a6e1eebe admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:53.374325 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-d8f1c53b-907a-4ba3-9cf6-4e48a6e1eebe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:53.414912 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4241090-c975-4203-80d2-c5b98e30847a admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:53.481109 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f1c53b-907a-4ba3-9cf6-4e48a6e1eebe admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:53.498251 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6ce779-5216-490a-a33a-6bb7309cb010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:53.498926 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ce779-5216-490a-a33a-6bb7309cb010 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:53.499211 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ce779-5216-490a-a33a-6bb7309cb010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:53.499499 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ce779-5216-490a-a33a-6bb7309cb010 admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:53.500628 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6ce779-5216-490a-a33a-6bb7309cb010 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:53.502775 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6ce779-5216-490a-a33a-6bb7309cb010 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:53.513619 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca49d7da-f2af-4a13-bcf3-9108899fd4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:53.514763 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49d7da-f2af-4a13-bcf3-9108899fd4ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:53.515146 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49d7da-f2af-4a13-bcf3-9108899fd4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:53.515642 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49d7da-f2af-4a13-bcf3-9108899fd4ff admin admin] PATH_INFO: `/v3/users/9fcc6d1075494a89b04f65159a9036cc` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:53.516936 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca49d7da-f2af-4a13-bcf3-9108899fd4ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fcc6d1075494a89b04f65159a9036cc)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:53.519455 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca49d7da-f2af-4a13-bcf3-9108899fd4ff admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:53.539099 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1028/2013] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:35:53 2022] POST /identity/v3/projects => generated 377 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:35:53.539099 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6ce779-5216-490a-a33a-6bb7309cb010 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:53.539099 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-4b6ce779-5216-490a-a33a-6bb7309cb010 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:53.587656 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-ca49d7da-f2af-4a13-bcf3-9108899fd4ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fcc6d1075494a89b04f65159a9036cc'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:53.588741 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-ca49d7da-f2af-4a13-bcf3-9108899fd4ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fcc6d1075494a89b04f65159a9036cc'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:53.598760 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-ca49d7da-f2af-4a13-bcf3-9108899fd4ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fcc6d1075494a89b04f65159a9036cc'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:53.608855 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-ca49d7da-f2af-4a13-bcf3-9108899fd4ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fcc6d1075494a89b04f65159a9036cc'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:53.609661 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-ca49d7da-f2af-4a13-bcf3-9108899fd4ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fcc6d1075494a89b04f65159a9036cc'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:53.643212 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6ce779-5216-490a-a33a-6bb7309cb010 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:53.647911 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 986/2014] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:35:53 2022] DELETE /identity/v3/users/9fcc6d1075494a89b04f65159a9036cc => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:53.648944 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca49d7da-f2af-4a13-bcf3-9108899fd4ff admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:53.650144 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f93065c-d4d1-4e91-9714-9a7c163a93ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:53.650315 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-ca49d7da-f2af-4a13-bcf3-9108899fd4ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:53.651331 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f93065c-d4d1-4e91-9714-9a7c163a93ce admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:53.651620 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f93065c-d4d1-4e91-9714-9a7c163a93ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:53.651983 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f93065c-d4d1-4e91-9714-9a7c163a93ce admin admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:53.653139 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f93065c-d4d1-4e91-9714-9a7c163a93ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:35:53.653553 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f93065c-d4d1-4e91-9714-9a7c163a93ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:53.656143 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f93065c-d4d1-4e91-9714-9a7c163a93ce admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:53.670576 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1029/2015] 10.222.0.26 () {58 vars in 1152 bytes} [Fri Jul 1 19:35:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:35:53.670889 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f93065c-d4d1-4e91-9714-9a7c163a93ce admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:53.673013 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-8f93065c-d4d1-4e91-9714-9a7c163a93ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:53.688726 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f93065c-d4d1-4e91-9714-9a7c163a93ce admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:53.724417 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:53.732560 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:53.739077 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca49d7da-f2af-4a13-bcf3-9108899fd4ff admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:53.745277 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c95bd4e-1f5f-45e6-a7e8-ef27d1ae751d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:53.746247 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c95bd4e-1f5f-45e6-a7e8-ef27d1ae751d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:53.747110 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c95bd4e-1f5f-45e6-a7e8-ef27d1ae751d admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:53.747110 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c95bd4e-1f5f-45e6-a7e8-ef27d1ae751d admin admin] PATH_INFO: `/v3/users/123c2556fb3944aca5b6093fe32b698a` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:53.748229 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c95bd4e-1f5f-45e6-a7e8-ef27d1ae751d admin admin] RBAC: Authorizing `identity:delete_user(user_id=123c2556fb3944aca5b6093fe32b698a)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:53.750312 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c95bd4e-1f5f-45e6-a7e8-ef27d1ae751d admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:53.764949 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edcb7d6-013c-4687-8d92-ea6c95ba5140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:53.765762 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edcb7d6-013c-4687-8d92-ea6c95ba5140 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:53.766051 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edcb7d6-013c-4687-8d92-ea6c95ba5140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:53.766514 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edcb7d6-013c-4687-8d92-ea6c95ba5140 admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:53.767291 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edcb7d6-013c-4687-8d92-ea6c95ba5140 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:53.769445 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edcb7d6-013c-4687-8d92-ea6c95ba5140 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:53.794962 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1030/2016] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:35:53 2022] POST /identity/v3/users => generated 295 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:35:53.794962 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edcb7d6-013c-4687-8d92-ea6c95ba5140 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:53.794962 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-9edcb7d6-013c-4687-8d92-ea6c95ba5140 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:53.807928 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-2c95bd4e-1f5f-45e6-a7e8-ef27d1ae751d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '123c2556fb3944aca5b6093fe32b698a'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:53.808592 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-2c95bd4e-1f5f-45e6-a7e8-ef27d1ae751d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '123c2556fb3944aca5b6093fe32b698a'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:53.815828 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-2c95bd4e-1f5f-45e6-a7e8-ef27d1ae751d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '123c2556fb3944aca5b6093fe32b698a'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:53.817636 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edcb7d6-013c-4687-8d92-ea6c95ba5140 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:53.823034 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1f568f-ffff-4194-b8b6-816de955a0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:53.823912 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-2c95bd4e-1f5f-45e6-a7e8-ef27d1ae751d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '123c2556fb3944aca5b6093fe32b698a'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:53.824174 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f568f-ffff-4194-b8b6-816de955a0b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:53.824483 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f568f-ffff-4194-b8b6-816de955a0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:53.824796 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-2c95bd4e-1f5f-45e6-a7e8-ef27d1ae751d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '123c2556fb3944aca5b6093fe32b698a'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:53.824991 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f568f-ffff-4194-b8b6-816de955a0b1 admin admin] PATH_INFO: `/v3/projects/ac9ba42d89ea4bcabeb630bcc12d0d39` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:53.826729 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1f568f-ffff-4194-b8b6-816de955a0b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac9ba42d89ea4bcabeb630bcc12d0d39)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:53.828676 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1f568f-ffff-4194-b8b6-816de955a0b1 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:53.848420 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 987/2017] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:35:53 2022] DELETE /identity/v3/users/123c2556fb3944aca5b6093fe32b698a => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:53.849771 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5befb8e6-9de9-43c1-a3fd-842f690ab5fa None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:53.850121 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5befb8e6-9de9-43c1-a3fd-842f690ab5fa None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:53.850420 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5befb8e6-9de9-43c1-a3fd-842f690ab5fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:53.870219 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-5befb8e6-9de9-43c1-a3fd-842f690ab5fa None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:53.871438 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-5befb8e6-9de9-43c1-a3fd-842f690ab5fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:53.890092 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-0a1f568f-ffff-4194-b8b6-816de955a0b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac9ba42d89ea4bcabeb630bcc12d0d39', 'request_id': 'req-0a1f568f-ffff-4194-b8b6-816de955a0b1'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:53.899079 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-0a1f568f-ffff-4194-b8b6-816de955a0b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac9ba42d89ea4bcabeb630bcc12d0d39', 'request_id': 'req-0a1f568f-ffff-4194-b8b6-816de955a0b1'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:53.907907 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-0a1f568f-ffff-4194-b8b6-816de955a0b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac9ba42d89ea4bcabeb630bcc12d0d39', 'request_id': 'req-0a1f568f-ffff-4194-b8b6-816de955a0b1'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:53.924124 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-0a1f568f-ffff-4194-b8b6-816de955a0b1 admin admin] The token cache is being invalidate because project ac9ba42d89ea4bcabeb630bcc12d0d39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:35:53.924372 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-0a1f568f-ffff-4194-b8b6-816de955a0b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:53.925148 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-0a1f568f-ffff-4194-b8b6-816de955a0b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:53.927481 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1031/2018] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:35:53 2022] DELETE /identity/v3/projects/ac9ba42d89ea4bcabeb630bcc12d0d39 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:53.927986 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1f568f-ffff-4194-b8b6-816de955a0b1 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:53.929747 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-0a1f568f-ffff-4194-b8b6-816de955a0b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:53.955101 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 988/2019] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:35:53.956262 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5befb8e6-9de9-43c1-a3fd-842f690ab5fa None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:53.957791 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-5befb8e6-9de9-43c1-a3fd-842f690ab5fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:53.972705 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5befb8e6-9de9-43c1-a3fd-842f690ab5fa None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:53.978345 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a49677a-15f2-44dd-8320-97a5d557e8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:53.978949 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a49677a-15f2-44dd-8320-97a5d557e8ca admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:53.979371 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a49677a-15f2-44dd-8320-97a5d557e8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:53.979733 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a49677a-15f2-44dd-8320-97a5d557e8ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:53.980590 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a49677a-15f2-44dd-8320-97a5d557e8ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:53.982331 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a49677a-15f2-44dd-8320-97a5d557e8ca admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:53.994612 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 989/2020] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:35:53 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:35:53.996025 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90999d02-d3cb-4c5f-8784-e628aefabb2c None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:53.996308 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90999d02-d3cb-4c5f-8784-e628aefabb2c None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:53.996583 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90999d02-d3cb-4c5f-8784-e628aefabb2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:54.025008 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1f568f-ffff-4194-b8b6-816de955a0b1 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:54.025229 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-90999d02-d3cb-4c5f-8784-e628aefabb2c None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:54.026714 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-90999d02-d3cb-4c5f-8784-e628aefabb2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:54.030487 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7859324-7cad-4abc-936c-b9a9216c8c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:54.031262 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7859324-7cad-4abc-936c-b9a9216c8c7b admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:54.031547 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7859324-7cad-4abc-936c-b9a9216c8c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:54.031840 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7859324-7cad-4abc-936c-b9a9216c8c7b admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:54.032532 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7859324-7cad-4abc-936c-b9a9216c8c7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:54.034869 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7859324-7cad-4abc-936c-b9a9216c8c7b admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:54.037718 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 990/2021] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:35:54.038762 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90999d02-d3cb-4c5f-8784-e628aefabb2c None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:54.044738 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-90999d02-d3cb-4c5f-8784-e628aefabb2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:54.073092 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1032/2022] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:35:53 2022] POST /identity/v3/projects => generated 367 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:35:54.074413 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7859324-7cad-4abc-936c-b9a9216c8c7b admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:54.123764 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90999d02-d3cb-4c5f-8784-e628aefabb2c None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:54.132587 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:54.140867 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:54.165889 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7859324-7cad-4abc-936c-b9a9216c8c7b admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:54.171958 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26420c7-dbe9-48a0-a551-498d021a5550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:54.172904 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26420c7-dbe9-48a0-a551-498d021a5550 admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:54.173197 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26420c7-dbe9-48a0-a551-498d021a5550 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:54.173541 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26420c7-dbe9-48a0-a551-498d021a5550 admin admin] PATH_INFO: `/v3/projects/aa22c173e795464aa58dda7e04647626/users/db969e10c05c4f72b7291fbff887cf57/roles/6cb03785fb184ef587509b3174622f69` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:54.192267 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26420c7-dbe9-48a0-a551-498d021a5550 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa22c173e795464aa58dda7e04647626, user_id=db969e10c05c4f72b7291fbff887cf57, role_id=6cb03785fb184ef587509b3174622f69)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:54.194678 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b303f1-24e2-440b-8992-ecc16dc8eb5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:54.195093 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26420c7-dbe9-48a0-a551-498d021a5550 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:54.195346 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b303f1-24e2-440b-8992-ecc16dc8eb5f service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:54.195638 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b303f1-24e2-440b-8992-ecc16dc8eb5f service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:54.195914 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b303f1-24e2-440b-8992-ecc16dc8eb5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:54.209123 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b303f1-24e2-440b-8992-ecc16dc8eb5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:54.212146 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b303f1-24e2-440b-8992-ecc16dc8eb5f service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:54.214747 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1033/2023] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:35:54 2022] PUT /identity/v3/projects/aa22c173e795464aa58dda7e04647626/users/db969e10c05c4f72b7291fbff887cf57/roles/6cb03785fb184ef587509b3174622f69 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:54.220075 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7491b-1549-4cf1-b105-5299ccfa74b1 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:54.220515 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7491b-1549-4cf1-b105-5299ccfa74b1 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:54.220895 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7491b-1549-4cf1-b105-5299ccfa74b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:54.223884 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 991/2024] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:35:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:35:54.224815 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b303f1-24e2-440b-8992-ecc16dc8eb5f service neutron] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:54.235191 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b303f1-24e2-440b-8992-ecc16dc8eb5f service neutron] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:54.244611 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-a6f7491b-1549-4cf1-b105-5299ccfa74b1 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:54.246137 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-a6f7491b-1549-4cf1-b105-5299ccfa74b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:54.319141 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32cb8dc-5eeb-4c5d-8764-0efbc23a74e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:54.320012 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32cb8dc-5eeb-4c5d-8764-0efbc23a74e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:54.320387 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32cb8dc-5eeb-4c5d-8764-0efbc23a74e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:54.320703 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32cb8dc-5eeb-4c5d-8764-0efbc23a74e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:54.321460 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32cb8dc-5eeb-4c5d-8764-0efbc23a74e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:54.323913 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32cb8dc-5eeb-4c5d-8764-0efbc23a74e5 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:54.345749 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1034/2025] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:35:54.347650 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f7491b-1549-4cf1-b105-5299ccfa74b1 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:54.351935 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-a6f7491b-1549-4cf1-b105-5299ccfa74b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:54.370336 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 992/2026] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:35:54 2022] POST /identity/v3/users => generated 284 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:35:54.370336 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32cb8dc-5eeb-4c5d-8764-0efbc23a74e5 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:54.379554 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f7491b-1549-4cf1-b105-5299ccfa74b1 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:54.381189 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32cb8dc-5eeb-4c5d-8764-0efbc23a74e5 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:54.386526 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f9d829-4fc3-4c9e-83fe-c515ea647506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:54.387504 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9d829-4fc3-4c9e-83fe-c515ea647506 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:54.387710 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5675def5-f900-46e0-a20b-287e39d6f103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:54.387895 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9d829-4fc3-4c9e-83fe-c515ea647506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:54.388133 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9d829-4fc3-4c9e-83fe-c515ea647506 admin admin] PATH_INFO: `/v3/projects/41f9126564424d0dbda08c5166739cef` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:54.388284 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5675def5-f900-46e0-a20b-287e39d6f103 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:54.388579 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5675def5-f900-46e0-a20b-287e39d6f103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:54.388791 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5675def5-f900-46e0-a20b-287e39d6f103 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:54.389663 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5675def5-f900-46e0-a20b-287e39d6f103 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:54.389911 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f9d829-4fc3-4c9e-83fe-c515ea647506 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41f9126564424d0dbda08c5166739cef)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:54.391311 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5675def5-f900-46e0-a20b-287e39d6f103 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:54.391889 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f9d829-4fc3-4c9e-83fe-c515ea647506 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:54.405782 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 993/2027] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:35:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:35:54.405782 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5675def5-f900-46e0-a20b-287e39d6f103 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:54.419653 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5675def5-f900-46e0-a20b-287e39d6f103 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:54.426603 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63780ad-7a48-42e0-ad9d-341d2a6c7cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:54.427292 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63780ad-7a48-42e0-ad9d-341d2a6c7cb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:54.428142 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63780ad-7a48-42e0-ad9d-341d2a6c7cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:54.428645 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63780ad-7a48-42e0-ad9d-341d2a6c7cb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:54.429495 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63780ad-7a48-42e0-ad9d-341d2a6c7cb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:35:54.430022 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63780ad-7a48-42e0-ad9d-341d2a6c7cb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:54.431917 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63780ad-7a48-42e0-ad9d-341d2a6c7cb1 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:54.451292 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 994/2028] 10.222.0.26 () {58 vars in 1152 bytes} [Fri Jul 1 19:35:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:35:54.452514 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63780ad-7a48-42e0-ad9d-341d2a6c7cb1 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:54.466607 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63780ad-7a48-42e0-ad9d-341d2a6c7cb1 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:54.470158 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-c5f9d829-4fc3-4c9e-83fe-c515ea647506 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41f9126564424d0dbda08c5166739cef', 'request_id': 'req-c5f9d829-4fc3-4c9e-83fe-c515ea647506'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:54.482644 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-c5f9d829-4fc3-4c9e-83fe-c515ea647506 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41f9126564424d0dbda08c5166739cef', 'request_id': 'req-c5f9d829-4fc3-4c9e-83fe-c515ea647506'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:54.493267 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-c5f9d829-4fc3-4c9e-83fe-c515ea647506 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41f9126564424d0dbda08c5166739cef', 'request_id': 'req-c5f9d829-4fc3-4c9e-83fe-c515ea647506'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:54.514025 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-c5f9d829-4fc3-4c9e-83fe-c515ea647506 admin admin] The token cache is being invalidate because project 41f9126564424d0dbda08c5166739cef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:35:54.514410 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-c5f9d829-4fc3-4c9e-83fe-c515ea647506 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:54.515228 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-c5f9d829-4fc3-4c9e-83fe-c515ea647506 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:54.517904 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1035/2029] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:35:54 2022] DELETE /identity/v3/projects/41f9126564424d0dbda08c5166739cef => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:54.519149 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f9d829-4fc3-4c9e-83fe-c515ea647506 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:54.521588 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-c5f9d829-4fc3-4c9e-83fe-c515ea647506 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:54.563392 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed856d5-91f6-41ae-a5c9-52d2558ab41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:54.563392 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed856d5-91f6-41ae-a5c9-52d2558ab41e admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:54.563392 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed856d5-91f6-41ae-a5c9-52d2558ab41e admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:54.563392 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed856d5-91f6-41ae-a5c9-52d2558ab41e admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:54.563913 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed856d5-91f6-41ae-a5c9-52d2558ab41e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:54.563913 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed856d5-91f6-41ae-a5c9-52d2558ab41e admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:54.583747 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 995/2030] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:35:54 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:35:54.584703 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed856d5-91f6-41ae-a5c9-52d2558ab41e admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:54.586886 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-aed856d5-91f6-41ae-a5c9-52d2558ab41e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:54.602980 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed856d5-91f6-41ae-a5c9-52d2558ab41e admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:54.611113 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1b9d33-4c0a-4c4a-a803-3ca811173380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:54.611794 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b9d33-4c0a-4c4a-a803-3ca811173380 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:54.612225 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b9d33-4c0a-4c4a-a803-3ca811173380 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:54.612507 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b9d33-4c0a-4c4a-a803-3ca811173380 admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:54.613211 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1b9d33-4c0a-4c4a-a803-3ca811173380 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:54.615296 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:54.616121 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1b9d33-4c0a-4c4a-a803-3ca811173380 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:54.633621 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:54.652185 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 996/2031] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:35:54 2022] POST /identity/v3/projects => generated 393 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:35:54.654477 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db5948-26fb-4f52-8a69-212d64776b1e None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:54.654915 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db5948-26fb-4f52-8a69-212d64776b1e None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:54.655212 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db5948-26fb-4f52-8a69-212d64776b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:54.667475 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f9d829-4fc3-4c9e-83fe-c515ea647506 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:54.677523 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-96db5948-26fb-4f52-8a69-212d64776b1e None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:54.679112 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-96db5948-26fb-4f52-8a69-212d64776b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:54.744160 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 997/2032] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:35:54.745098 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96db5948-26fb-4f52-8a69-212d64776b1e None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:54.751650 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-96db5948-26fb-4f52-8a69-212d64776b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:54.758843 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e68e6a-ef8b-4869-b2f7-e01288c731bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:54.760042 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e68e6a-ef8b-4869-b2f7-e01288c731bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:54.760334 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e68e6a-ef8b-4869-b2f7-e01288c731bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:54.760621 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e68e6a-ef8b-4869-b2f7-e01288c731bd admin admin] PATH_INFO: `/v3/projects/aa22c173e795464aa58dda7e04647626/users/db969e10c05c4f72b7291fbff887cf57/roles/6cb03785fb184ef587509b3174622f69` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:54.762728 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e68e6a-ef8b-4869-b2f7-e01288c731bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa22c173e795464aa58dda7e04647626, user_id=db969e10c05c4f72b7291fbff887cf57, role_id=6cb03785fb184ef587509b3174622f69)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:54.770339 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e68e6a-ef8b-4869-b2f7-e01288c731bd admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:54.770541 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96db5948-26fb-4f52-8a69-212d64776b1e None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:54.771062 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c21cb8-cab9-4e53-99b2-a1ac9ff4aab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:54.771750 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c21cb8-cab9-4e53-99b2-a1ac9ff4aab9 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:54.772243 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c21cb8-cab9-4e53-99b2-a1ac9ff4aab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:54.772367 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c21cb8-cab9-4e53-99b2-a1ac9ff4aab9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:54.773038 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c21cb8-cab9-4e53-99b2-a1ac9ff4aab9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:54.774906 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c21cb8-cab9-4e53-99b2-a1ac9ff4aab9 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:54.776512 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1036/2033] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:35:54 2022] PUT /identity/v3/projects/aa22c173e795464aa58dda7e04647626/users/db969e10c05c4f72b7291fbff887cf57/roles/6cb03785fb184ef587509b3174622f69 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:54.777388 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e68e6a-ef8b-4869-b2f7-e01288c731bd admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:54.780070 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-14e68e6a-ef8b-4869-b2f7-e01288c731bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:54.802807 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 998/2034] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:35:54 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:35:54.802807 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c21cb8-cab9-4e53-99b2-a1ac9ff4aab9 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:54.802807 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-a6c21cb8-cab9-4e53-99b2-a1ac9ff4aab9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:54.815210 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c21cb8-cab9-4e53-99b2-a1ac9ff4aab9 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:54.870120 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e68e6a-ef8b-4869-b2f7-e01288c731bd admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:54.875461 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59da77f-0e6d-4053-845e-a8fd651f5731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:54.876358 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59da77f-0e6d-4053-845e-a8fd651f5731 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:54.876643 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59da77f-0e6d-4053-845e-a8fd651f5731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:54.876926 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59da77f-0e6d-4053-845e-a8fd651f5731 admin admin] PATH_INFO: `/v3/users/a69dd44711b348aaa3e36ce1af760857` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:54.878222 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59da77f-0e6d-4053-845e-a8fd651f5731 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a69dd44711b348aaa3e36ce1af760857)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:54.880160 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59da77f-0e6d-4053-845e-a8fd651f5731 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:54.881270 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffe5099-6bc6-4540-90fc-eb4191f16e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:54.882272 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe5099-6bc6-4540-90fc-eb4191f16e22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:54.882557 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe5099-6bc6-4540-90fc-eb4191f16e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:54.883139 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe5099-6bc6-4540-90fc-eb4191f16e22 admin admin] PATH_INFO: `/v3/projects/3f3c7e4dbcbc4c4b94c1ce660a7fe00d` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:54.884031 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffe5099-6bc6-4540-90fc-eb4191f16e22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f3c7e4dbcbc4c4b94c1ce660a7fe00d)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:54.885995 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffe5099-6bc6-4540-90fc-eb4191f16e22 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:54.934866 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-cffe5099-6bc6-4540-90fc-eb4191f16e22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f3c7e4dbcbc4c4b94c1ce660a7fe00d', 'request_id': 'req-cffe5099-6bc6-4540-90fc-eb4191f16e22'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:54.938603 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-b59da77f-0e6d-4053-845e-a8fd651f5731 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a69dd44711b348aaa3e36ce1af760857'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:54.939464 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-b59da77f-0e6d-4053-845e-a8fd651f5731 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a69dd44711b348aaa3e36ce1af760857'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:54.941070 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-cffe5099-6bc6-4540-90fc-eb4191f16e22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f3c7e4dbcbc4c4b94c1ce660a7fe00d', 'request_id': 'req-cffe5099-6bc6-4540-90fc-eb4191f16e22'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:54.947816 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-cffe5099-6bc6-4540-90fc-eb4191f16e22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f3c7e4dbcbc4c4b94c1ce660a7fe00d', 'request_id': 'req-cffe5099-6bc6-4540-90fc-eb4191f16e22'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:54.960829 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-cffe5099-6bc6-4540-90fc-eb4191f16e22 admin admin] The token cache is being invalidate because project 3f3c7e4dbcbc4c4b94c1ce660a7fe00d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:35:54.961060 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-b59da77f-0e6d-4053-845e-a8fd651f5731 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a69dd44711b348aaa3e36ce1af760857'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:54.961147 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-cffe5099-6bc6-4540-90fc-eb4191f16e22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:54.961785 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-cffe5099-6bc6-4540-90fc-eb4191f16e22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:54.963392 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 999/2035] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:35:54 2022] DELETE /identity/v3/projects/3f3c7e4dbcbc4c4b94c1ce660a7fe00d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:54.964235 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffe5099-6bc6-4540-90fc-eb4191f16e22 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:54.965583 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-cffe5099-6bc6-4540-90fc-eb4191f16e22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:54.972282 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-b59da77f-0e6d-4053-845e-a8fd651f5731 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a69dd44711b348aaa3e36ce1af760857'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:54.982358 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-b59da77f-0e6d-4053-845e-a8fd651f5731 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a69dd44711b348aaa3e36ce1af760857'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:54.985860 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:54.991391 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1037/2036] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:35:54 2022] DELETE /identity/v3/users/a69dd44711b348aaa3e36ce1af760857 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:54.992746 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c4830-6271-4f1c-b91f-38025b704b51 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:54.993037 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c4830-6271-4f1c-b91f-38025b704b51 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:54.993345 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c4830-6271-4f1c-b91f-38025b704b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:55.007919 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:55.015392 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-e37c4830-6271-4f1c-b91f-38025b704b51 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:55.017420 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-e37c4830-6271-4f1c-b91f-38025b704b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:55.052196 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffe5099-6bc6-4540-90fc-eb4191f16e22 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:55.086628 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1038/2037] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:35:55.088310 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411f674-8f47-4b76-af15-e3bebf348b59 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:55.088605 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411f674-8f47-4b76-af15-e3bebf348b59 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:55.088886 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411f674-8f47-4b76-af15-e3bebf348b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:55.113335 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62edabf-8870-41a6-b210-1a460a34a8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:55.114065 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62edabf-8870-41a6-b210-1a460a34a8b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:55.114358 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62edabf-8870-41a6-b210-1a460a34a8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:55.114640 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62edabf-8870-41a6-b210-1a460a34a8b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:55.115347 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62edabf-8870-41a6-b210-1a460a34a8b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:55.117340 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62edabf-8870-41a6-b210-1a460a34a8b6 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:55.118730 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-4411f674-8f47-4b76-af15-e3bebf348b59 None None] MFA Rules not processed for user `db969e10c05c4f72b7291fbff887cf57`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:55.119996 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-4411f674-8f47-4b76-af15-e3bebf348b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:55.140344 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1000/2038] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:35:54 2022] POST /identity/v3/users => generated 297 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:35:55.141480 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62edabf-8870-41a6-b210-1a460a34a8b6 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:55.143196 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-c62edabf-8870-41a6-b210-1a460a34a8b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:55.157134 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62edabf-8870-41a6-b210-1a460a34a8b6 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:55.165447 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b0ba5b-06f5-4136-8eac-440930ce9f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:55.166155 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b0ba5b-06f5-4136-8eac-440930ce9f3a admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:55.166440 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b0ba5b-06f5-4136-8eac-440930ce9f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:55.167005 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b0ba5b-06f5-4136-8eac-440930ce9f3a admin admin] PATH_INFO: `/v3/projects/a59ec3c152af4dc1b802a941c429eb26/users/b012af7808d3412e9fc1f5cfbd6d0379/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:55.185911 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b0ba5b-06f5-4136-8eac-440930ce9f3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a59ec3c152af4dc1b802a941c429eb26, user_id=b012af7808d3412e9fc1f5cfbd6d0379, role_id=4cbf6ec846eb4b7c8cc52e9bfd6f076f)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:55.188772 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b0ba5b-06f5-4136-8eac-440930ce9f3a admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:55.200450 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1039/2039] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:55 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:35:55.201985 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd47f20-a8a1-4b39-8df2-027125ccc127 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:55.202297 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd47f20-a8a1-4b39-8df2-027125ccc127 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:55.202575 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd47f20-a8a1-4b39-8df2-027125ccc127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:55.213333 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1001/2040] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:35:55 2022] PUT /identity/v3/projects/a59ec3c152af4dc1b802a941c429eb26/users/b012af7808d3412e9fc1f5cfbd6d0379/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:55.214845 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f18d88b-b2ab-4b4a-86f3-636043c5918a None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:55.215133 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f18d88b-b2ab-4b4a-86f3-636043c5918a None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:55.215423 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f18d88b-b2ab-4b4a-86f3-636043c5918a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:55.227076 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-ecd47f20-a8a1-4b39-8df2-027125ccc127 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:55.233130 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-ecd47f20-a8a1-4b39-8df2-027125ccc127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:55.233389 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-4f18d88b-b2ab-4b4a-86f3-636043c5918a None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:55.234573 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-4f18d88b-b2ab-4b4a-86f3-636043c5918a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:55.301084 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1002/2041] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:35:55.304448 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f18d88b-b2ab-4b4a-86f3-636043c5918a None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:55.307369 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1040/2042] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:35:55.307369 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd47f20-a8a1-4b39-8df2-027125ccc127 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:55.308551 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-ecd47f20-a8a1-4b39-8df2-027125ccc127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:55.315257 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f18d88b-b2ab-4b4a-86f3-636043c5918a None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:55.320108 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd97fa-0d0b-4406-b066-ed2c40f3220b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:55.320956 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd97fa-0d0b-4406-b066-ed2c40f3220b admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:55.321277 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd97fa-0d0b-4406-b066-ed2c40f3220b admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:55.321569 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd97fa-0d0b-4406-b066-ed2c40f3220b admin admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:55.322310 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffd97fa-0d0b-4406-b066-ed2c40f3220b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:35:55.322628 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffd97fa-0d0b-4406-b066-ed2c40f3220b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:55.323088 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd47f20-a8a1-4b39-8df2-027125ccc127 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:55.324526 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffd97fa-0d0b-4406-b066-ed2c40f3220b admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:55.328123 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801f396f-2fde-4c2c-b15c-c935a360c710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:55.328715 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f396f-2fde-4c2c-b15c-c935a360c710 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:55.329003 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f396f-2fde-4c2c-b15c-c935a360c710 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:55.329312 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f396f-2fde-4c2c-b15c-c935a360c710 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:55.330063 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801f396f-2fde-4c2c-b15c-c935a360c710 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:55.331677 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801f396f-2fde-4c2c-b15c-c935a360c710 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:55.342440 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1003/2043] 10.222.0.26 () {58 vars in 1152 bytes} [Fri Jul 1 19:35:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:35:55.342440 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd97fa-0d0b-4406-b066-ed2c40f3220b admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:55.342440 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-cffd97fa-0d0b-4406-b066-ed2c40f3220b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:55.351881 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1041/2044] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:35:55 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:35:55.357881 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84c2f51-f89f-450a-9fa6-00b29dee164b None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:55.358052 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84c2f51-f89f-450a-9fa6-00b29dee164b None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:55.358362 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84c2f51-f89f-450a-9fa6-00b29dee164b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:55.363974 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:55.387762 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-c84c2f51-f89f-450a-9fa6-00b29dee164b None None] MFA Rules not processed for user `b012af7808d3412e9fc1f5cfbd6d0379`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:55.388956 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-c84c2f51-f89f-450a-9fa6-00b29dee164b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:55.398389 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:55.407925 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd97fa-0d0b-4406-b066-ed2c40f3220b admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:55.411731 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465d53c7-51a9-4e1d-bca7-ebc5ce60821f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a3ed285ee4c4d04abf7daf0aeb9fb7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:55.412416 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d53c7-51a9-4e1d-bca7-ebc5ce60821f service cinder] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:55.412857 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d53c7-51a9-4e1d-bca7-ebc5ce60821f service cinder] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:55.413141 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d53c7-51a9-4e1d-bca7-ebc5ce60821f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:55.415029 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-465d53c7-51a9-4e1d-bca7-ebc5ce60821f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:55.459501 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1042/2045] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:55 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:35:55.460807 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2714fa15-22ea-4d46-b07d-4145ee83fe37 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:55.461103 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2714fa15-22ea-4d46-b07d-4145ee83fe37 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:55.461422 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2714fa15-22ea-4d46-b07d-4145ee83fe37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:55.480653 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-2714fa15-22ea-4d46-b07d-4145ee83fe37 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:55.481989 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-2714fa15-22ea-4d46-b07d-4145ee83fe37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:55.490892 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465d53c7-51a9-4e1d-bca7-ebc5ce60821f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:55.491358 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1043/2046] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:35:55.492208 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2714fa15-22ea-4d46-b07d-4145ee83fe37 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:55.492510 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465d53c7-51a9-4e1d-bca7-ebc5ce60821f service cinder] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:55.496076 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-2714fa15-22ea-4d46-b07d-4145ee83fe37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:55.503390 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1004/2047] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:35:55 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:35:55.504243 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465d53c7-51a9-4e1d-bca7-ebc5ce60821f service cinder] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:55.515311 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465d53c7-51a9-4e1d-bca7-ebc5ce60821f service cinder] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:55.520208 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ed65b-0894-44e6-80e8-2b80917f8ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:55.520880 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ed65b-0894-44e6-80e8-2b80917f8ccf admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:55.521170 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ed65b-0894-44e6-80e8-2b80917f8ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:55.521480 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ed65b-0894-44e6-80e8-2b80917f8ccf admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:55.522188 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279ed65b-0894-44e6-80e8-2b80917f8ccf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:55.524157 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279ed65b-0894-44e6-80e8-2b80917f8ccf admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:55.557069 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1005/2048] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:35:55 2022] POST /identity/v3/projects => generated 391 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:35:55.558024 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ed65b-0894-44e6-80e8-2b80917f8ccf admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:55.565694 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2714fa15-22ea-4d46-b07d-4145ee83fe37 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:55.631772 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3df9d5-d4d8-47f7-9a35-4e6751ea1ff9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:55.632442 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3df9d5-d4d8-47f7-9a35-4e6751ea1ff9 service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:55.632959 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3df9d5-d4d8-47f7-9a35-4e6751ea1ff9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:55.633183 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3df9d5-d4d8-47f7-9a35-4e6751ea1ff9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:55.639337 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ed65b-0894-44e6-80e8-2b80917f8ccf admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:55.648604 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1135bff-0035-4cb4-8ffa-88a236d38c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:55.649336 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1135bff-0035-4cb4-8ffa-88a236d38c44 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:55.649631 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1135bff-0035-4cb4-8ffa-88a236d38c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:55.649965 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1135bff-0035-4cb4-8ffa-88a236d38c44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:55.651097 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3df9d5-d4d8-47f7-9a35-4e6751ea1ff9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:55.654584 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1135bff-0035-4cb4-8ffa-88a236d38c44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:55.654694 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3df9d5-d4d8-47f7-9a35-4e6751ea1ff9 service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:55.654772 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1135bff-0035-4cb4-8ffa-88a236d38c44 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:55.664233 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1044/2049] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:35:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:35:55.664717 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1006/2050] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:35:55 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:35:55.665079 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3df9d5-d4d8-47f7-9a35-4e6751ea1ff9 service neutron] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:55.665672 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1135bff-0035-4cb4-8ffa-88a236d38c44 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:55.679669 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3df9d5-d4d8-47f7-9a35-4e6751ea1ff9 service neutron] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:55.686102 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1135bff-0035-4cb4-8ffa-88a236d38c44 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:55.688420 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b00221b-d4ff-4477-8bbe-f127233331cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:55.691002 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b00221b-d4ff-4477-8bbe-f127233331cf admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:55.691442 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b00221b-d4ff-4477-8bbe-f127233331cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:55.691931 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdcfd3e-7485-40ef-afe4-94914aea3830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:55.692064 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b00221b-d4ff-4477-8bbe-f127233331cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:55.692840 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdcfd3e-7485-40ef-afe4-94914aea3830 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:55.693107 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b00221b-d4ff-4477-8bbe-f127233331cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:55.693219 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdcfd3e-7485-40ef-afe4-94914aea3830 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:55.693638 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdcfd3e-7485-40ef-afe4-94914aea3830 admin admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:55.694408 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdcfd3e-7485-40ef-afe4-94914aea3830 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:35:55.694771 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdcfd3e-7485-40ef-afe4-94914aea3830 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:55.696320 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b00221b-d4ff-4477-8bbe-f127233331cf admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:55.696673 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdcfd3e-7485-40ef-afe4-94914aea3830 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:55.714666 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1007/2051] 10.222.0.26 () {58 vars in 1152 bytes} [Fri Jul 1 19:35:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:35:55.715341 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdcfd3e-7485-40ef-afe4-94914aea3830 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:55.734932 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdcfd3e-7485-40ef-afe4-94914aea3830 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:55.742228 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1045/2052] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:35:55 2022] POST /identity/v3/projects => generated 369 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:35:55.743158 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b00221b-d4ff-4477-8bbe-f127233331cf admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:55.746069 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b25152f-0ae0-4562-8727-523041956072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:55.747737 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25152f-0ae0-4562-8727-523041956072 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:55.748138 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25152f-0ae0-4562-8727-523041956072 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:55.748803 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25152f-0ae0-4562-8727-523041956072 admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:55.750622 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b25152f-0ae0-4562-8727-523041956072 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:55.753676 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b25152f-0ae0-4562-8727-523041956072 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:55.784680 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1008/2053] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:35:55 2022] POST /identity/v3/users => generated 296 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:35:55.786107 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b25152f-0ae0-4562-8727-523041956072 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:55.803025 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b25152f-0ae0-4562-8727-523041956072 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:55.806291 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:55.822467 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:55.841562 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b00221b-d4ff-4477-8bbe-f127233331cf admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:55.857651 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a60bc-10b7-4cd5-ab8f-aba5c0e49966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:55.858658 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a60bc-10b7-4cd5-ab8f-aba5c0e49966 admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:55.860985 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a60bc-10b7-4cd5-ab8f-aba5c0e49966 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:55.861352 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a60bc-10b7-4cd5-ab8f-aba5c0e49966 admin admin] PATH_INFO: `/v3/projects/979d163b3c0a484b95c2dfe3248247d9/users/91c82e59af62461e85d22fc4a8269c25/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:55.881951 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13a60bc-10b7-4cd5-ab8f-aba5c0e49966 admin admin] RBAC: Authorizing `identity:create_grant(project_id=979d163b3c0a484b95c2dfe3248247d9, user_id=91c82e59af62461e85d22fc4a8269c25, role_id=4cbf6ec846eb4b7c8cc52e9bfd6f076f)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:55.891261 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13a60bc-10b7-4cd5-ab8f-aba5c0e49966 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:55.921587 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1046/2054] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:35:55 2022] PUT /identity/v3/projects/979d163b3c0a484b95c2dfe3248247d9/users/91c82e59af62461e85d22fc4a8269c25/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:55.921587 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a60bc-10b7-4cd5-ab8f-aba5c0e49966 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:55.928662 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3e1840-a6eb-4b75-8862-f88d977abe2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:55.929620 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3e1840-a6eb-4b75-8862-f88d977abe2f admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:55.930114 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3e1840-a6eb-4b75-8862-f88d977abe2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:55.930846 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3e1840-a6eb-4b75-8862-f88d977abe2f admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:55.932252 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3e1840-a6eb-4b75-8862-f88d977abe2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:55.935068 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3e1840-a6eb-4b75-8862-f88d977abe2f admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:55.992675 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1009/2055] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:35:55 2022] POST /identity/v3/projects => generated 385 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:35:55.993653 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3e1840-a6eb-4b75-8862-f88d977abe2f admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:56.039897 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a60bc-10b7-4cd5-ab8f-aba5c0e49966 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:56.096249 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3e1840-a6eb-4b75-8862-f88d977abe2f admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:56.102516 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645a7511-9f10-4d26-8e27-4a4d619c68d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:56.110601 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a7511-9f10-4d26-8e27-4a4d619c68d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:56.111004 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a7511-9f10-4d26-8e27-4a4d619c68d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:56.111414 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a7511-9f10-4d26-8e27-4a4d619c68d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:56.112381 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645a7511-9f10-4d26-8e27-4a4d619c68d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:56.114405 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645a7511-9f10-4d26-8e27-4a4d619c68d1 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:56.120649 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc28cff0-b61b-4f4f-88d1-f19cda7479ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:56.121370 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc28cff0-b61b-4f4f-88d1-f19cda7479ac admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:56.121661 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc28cff0-b61b-4f4f-88d1-f19cda7479ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:56.121947 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc28cff0-b61b-4f4f-88d1-f19cda7479ac admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:56.123285 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc28cff0-b61b-4f4f-88d1-f19cda7479ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:56.125358 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc28cff0-b61b-4f4f-88d1-f19cda7479ac admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:56.128435 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1010/2056] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:35:55 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:35:56.133007 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf68fc-cbac-441e-8eb9-7444948a111e None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:56.133407 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf68fc-cbac-441e-8eb9-7444948a111e None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:56.133720 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf68fc-cbac-441e-8eb9-7444948a111e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:56.148518 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1047/2057] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:35:55 2022] POST /identity/v3/users => generated 291 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:35:56.149412 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc28cff0-b61b-4f4f-88d1-f19cda7479ac admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:56.154126 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-eabf68fc-cbac-441e-8eb9-7444948a111e None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:56.155354 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-eabf68fc-cbac-441e-8eb9-7444948a111e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:56.160679 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc28cff0-b61b-4f4f-88d1-f19cda7479ac admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:56.163618 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1011/2058] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:35:56.164213 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf68fc-cbac-441e-8eb9-7444948a111e None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:56.165551 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-eabf68fc-cbac-441e-8eb9-7444948a111e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:56.170221 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500027fb-2ee0-43f7-82a5-c09cc178852e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:56.171031 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500027fb-2ee0-43f7-82a5-c09cc178852e admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:56.171594 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500027fb-2ee0-43f7-82a5-c09cc178852e admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:56.171977 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500027fb-2ee0-43f7-82a5-c09cc178852e admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:56.173125 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500027fb-2ee0-43f7-82a5-c09cc178852e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:56.175196 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500027fb-2ee0-43f7-82a5-c09cc178852e admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:56.178067 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf68fc-cbac-441e-8eb9-7444948a111e None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:56.182776 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98df14b6-21fc-4cc8-a262-e74934023da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:56.183648 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df14b6-21fc-4cc8-a262-e74934023da5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:56.183932 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df14b6-21fc-4cc8-a262-e74934023da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:56.184235 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df14b6-21fc-4cc8-a262-e74934023da5 admin admin] PATH_INFO: `/v3/projects/e5b3762ec87444d2beb64b974e590a50` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:56.186057 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98df14b6-21fc-4cc8-a262-e74934023da5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5b3762ec87444d2beb64b974e590a50)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:56.188098 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98df14b6-21fc-4cc8-a262-e74934023da5 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:56.198308 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1048/2059] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:35:56 2022] POST /identity/v3/users => generated 293 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:35:56.199567 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500027fb-2ee0-43f7-82a5-c09cc178852e admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:56.209899 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500027fb-2ee0-43f7-82a5-c09cc178852e admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:56.216239 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e055621-f24f-489a-8029-bc4a83044c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:56.216927 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e055621-f24f-489a-8029-bc4a83044c3e admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:56.217434 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e055621-f24f-489a-8029-bc4a83044c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:56.217729 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e055621-f24f-489a-8029-bc4a83044c3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:56.218467 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e055621-f24f-489a-8029-bc4a83044c3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:56.220104 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e055621-f24f-489a-8029-bc4a83044c3e admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:56.240422 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1049/2060] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:35:56 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:35:56.240422 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e055621-f24f-489a-8029-bc4a83044c3e admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:56.243912 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-98df14b6-21fc-4cc8-a262-e74934023da5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5b3762ec87444d2beb64b974e590a50', 'request_id': 'req-98df14b6-21fc-4cc8-a262-e74934023da5'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:56.249640 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-98df14b6-21fc-4cc8-a262-e74934023da5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5b3762ec87444d2beb64b974e590a50', 'request_id': 'req-98df14b6-21fc-4cc8-a262-e74934023da5'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:56.255249 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e055621-f24f-489a-8029-bc4a83044c3e admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:56.256447 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-98df14b6-21fc-4cc8-a262-e74934023da5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5b3762ec87444d2beb64b974e590a50', 'request_id': 'req-98df14b6-21fc-4cc8-a262-e74934023da5'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:56.271728 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-98df14b6-21fc-4cc8-a262-e74934023da5 admin admin] The token cache is being invalidate because project e5b3762ec87444d2beb64b974e590a50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:35:56.272039 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-98df14b6-21fc-4cc8-a262-e74934023da5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:56.272726 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-98df14b6-21fc-4cc8-a262-e74934023da5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:56.274375 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1012/2061] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:35:56 2022] DELETE /identity/v3/projects/e5b3762ec87444d2beb64b974e590a50 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:56.278182 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98df14b6-21fc-4cc8-a262-e74934023da5 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:56.278182 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-98df14b6-21fc-4cc8-a262-e74934023da5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:56.290885 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:56.291471 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:56.335670 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9ecc43-a491-4753-affc-bb8c4f0ff14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:56.336370 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ecc43-a491-4753-affc-bb8c4f0ff14b admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:56.336635 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ecc43-a491-4753-affc-bb8c4f0ff14b admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:56.336920 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ecc43-a491-4753-affc-bb8c4f0ff14b admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:56.337789 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9ecc43-a491-4753-affc-bb8c4f0ff14b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:56.339720 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9ecc43-a491-4753-affc-bb8c4f0ff14b admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:56.350996 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1050/2062] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:35:56 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:35:56.350996 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9ecc43-a491-4753-affc-bb8c4f0ff14b admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:56.350996 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-ed9ecc43-a491-4753-affc-bb8c4f0ff14b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:56.358140 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98df14b6-21fc-4cc8-a262-e74934023da5 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:56.361949 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd4df5-8925-4aec-811b-079400a26c96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:56.362608 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd4df5-8925-4aec-811b-079400a26c96 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:56.362893 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd4df5-8925-4aec-811b-079400a26c96 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:56.363167 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd4df5-8925-4aec-811b-079400a26c96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:56.365027 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-9abd4df5-8925-4aec-811b-079400a26c96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:56.372600 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9ecc43-a491-4753-affc-bb8c4f0ff14b admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:56.379451 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9429679d-68ab-40a0-bc6d-3b508aa94acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:56.379873 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abd4df5-8925-4aec-811b-079400a26c96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:56.380207 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429679d-68ab-40a0-bc6d-3b508aa94acc admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:56.380493 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429679d-68ab-40a0-bc6d-3b508aa94acc admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:56.380775 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429679d-68ab-40a0-bc6d-3b508aa94acc admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:56.381377 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abd4df5-8925-4aec-811b-079400a26c96 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:56.381569 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9429679d-68ab-40a0-bc6d-3b508aa94acc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:56.383213 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9429679d-68ab-40a0-bc6d-3b508aa94acc admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:56.394156 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1013/2063] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:35:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:35:56.394989 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd4df5-8925-4aec-811b-079400a26c96 service neutron] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:56.395792 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1051/2064] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:35:56 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:35:56.396391 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-9abd4df5-8925-4aec-811b-079400a26c96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:56.396769 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9429679d-68ab-40a0-bc6d-3b508aa94acc admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:56.398556 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-9429679d-68ab-40a0-bc6d-3b508aa94acc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:56.409831 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd4df5-8925-4aec-811b-079400a26c96 service neutron] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:56.412007 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9429679d-68ab-40a0-bc6d-3b508aa94acc admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:56.415196 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c19ce63-46ba-447f-9d9f-ef9be15ff35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:56.416260 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19ce63-46ba-447f-9d9f-ef9be15ff35d admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:56.417276 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19ce63-46ba-447f-9d9f-ef9be15ff35d admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:56.417579 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19ce63-46ba-447f-9d9f-ef9be15ff35d admin admin] PATH_INFO: `/v3/projects/9ee850090ce249ee8c1b940588559917/users/a5073880326c41f7be9d275d96d89c97/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:56.418800 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8967c050-2a1b-4c5f-8f04-f12e9b27923b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:56.419884 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8967c050-2a1b-4c5f-8f04-f12e9b27923b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:56.420543 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8967c050-2a1b-4c5f-8f04-f12e9b27923b admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:56.420873 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8967c050-2a1b-4c5f-8f04-f12e9b27923b admin admin] PATH_INFO: `/v3/users/ba1a04284676439d941b25de16c46199` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:56.423718 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8967c050-2a1b-4c5f-8f04-f12e9b27923b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba1a04284676439d941b25de16c46199)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:56.426564 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8967c050-2a1b-4c5f-8f04-f12e9b27923b admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:56.440086 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c19ce63-46ba-447f-9d9f-ef9be15ff35d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ee850090ce249ee8c1b940588559917, user_id=a5073880326c41f7be9d275d96d89c97, role_id=4cbf6ec846eb4b7c8cc52e9bfd6f076f)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:56.443134 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c19ce63-46ba-447f-9d9f-ef9be15ff35d admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:56.462974 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1014/2065] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:35:56 2022] PUT /identity/v3/projects/9ee850090ce249ee8c1b940588559917/users/a5073880326c41f7be9d275d96d89c97/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:56.463806 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c19ce63-46ba-447f-9d9f-ef9be15ff35d admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:56.475653 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-2c19ce63-46ba-447f-9d9f-ef9be15ff35d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:56.492946 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-8967c050-2a1b-4c5f-8f04-f12e9b27923b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba1a04284676439d941b25de16c46199'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:56.494260 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-8967c050-2a1b-4c5f-8f04-f12e9b27923b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba1a04284676439d941b25de16c46199'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:56.516884 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-8967c050-2a1b-4c5f-8f04-f12e9b27923b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba1a04284676439d941b25de16c46199'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:56.527272 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-8967c050-2a1b-4c5f-8f04-f12e9b27923b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba1a04284676439d941b25de16c46199'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:56.541812 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-8967c050-2a1b-4c5f-8f04-f12e9b27923b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba1a04284676439d941b25de16c46199'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:56.550446 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1052/2066] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:35:56 2022] DELETE /identity/v3/users/ba1a04284676439d941b25de16c46199 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:56.551498 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8967c050-2a1b-4c5f-8f04-f12e9b27923b admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:56.552904 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-8967c050-2a1b-4c5f-8f04-f12e9b27923b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:56.574702 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c19ce63-46ba-447f-9d9f-ef9be15ff35d admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:56.676347 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec0b32c-3833-4a01-b875-a5793964eb50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:56.677727 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec0b32c-3833-4a01-b875-a5793964eb50 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:56.678126 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec0b32c-3833-4a01-b875-a5793964eb50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:56.678605 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec0b32c-3833-4a01-b875-a5793964eb50 admin admin] PATH_INFO: `/v3/projects/cf163b4663c9480e863469eae3b033d1/users/afe074a9aaa14146b8521d8454c1a674/roles/6cb03785fb184ef587509b3174622f69` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:56.704598 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8967c050-2a1b-4c5f-8f04-f12e9b27923b admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:56.705486 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec0b32c-3833-4a01-b875-a5793964eb50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf163b4663c9480e863469eae3b033d1, user_id=afe074a9aaa14146b8521d8454c1a674, role_id=6cb03785fb184ef587509b3174622f69)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:56.709160 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec0b32c-3833-4a01-b875-a5793964eb50 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:56.709438 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a24ff3-1ab5-4e15-a72e-e239832d1b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:56.710447 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a24ff3-1ab5-4e15-a72e-e239832d1b59 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:56.710883 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a24ff3-1ab5-4e15-a72e-e239832d1b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:56.711359 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a24ff3-1ab5-4e15-a72e-e239832d1b59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:56.712266 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a24ff3-1ab5-4e15-a72e-e239832d1b59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:56.714908 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a24ff3-1ab5-4e15-a72e-e239832d1b59 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:56.729602 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1015/2067] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:35:56 2022] PUT /identity/v3/projects/cf163b4663c9480e863469eae3b033d1/users/afe074a9aaa14146b8521d8454c1a674/roles/6cb03785fb184ef587509b3174622f69 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:56.731224 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d93310e-b2ee-434f-84ee-fc720a82bbbd None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:56.731224 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d93310e-b2ee-434f-84ee-fc720a82bbbd None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:56.732337 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d93310e-b2ee-434f-84ee-fc720a82bbbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:56.735021 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1053/2068] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:35:56 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:35:56.736321 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a24ff3-1ab5-4e15-a72e-e239832d1b59 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:56.738871 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-e8a24ff3-1ab5-4e15-a72e-e239832d1b59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:56.755822 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a24ff3-1ab5-4e15-a72e-e239832d1b59 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:56.774623 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-7d93310e-b2ee-434f-84ee-fc720a82bbbd None None] MFA Rules not processed for user `a5073880326c41f7be9d275d96d89c97`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:56.776090 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-7d93310e-b2ee-434f-84ee-fc720a82bbbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:56.787308 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:56.818644 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:56.865946 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da060f47-028c-4ff6-a5bd-61cf3640234f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:56.867535 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da060f47-028c-4ff6-a5bd-61cf3640234f admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:56.868261 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da060f47-028c-4ff6-a5bd-61cf3640234f admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:56.868261 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da060f47-028c-4ff6-a5bd-61cf3640234f admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:56.869211 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da060f47-028c-4ff6-a5bd-61cf3640234f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:56.871084 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da060f47-028c-4ff6-a5bd-61cf3640234f admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:56.885340 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1054/2069] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:35:56 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:35:56.886314 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da060f47-028c-4ff6-a5bd-61cf3640234f admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:56.898544 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da060f47-028c-4ff6-a5bd-61cf3640234f admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:56.906805 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a3d8a9-98bf-4b5a-9698-7e4f0b373704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:56.908168 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3d8a9-98bf-4b5a-9698-7e4f0b373704 admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:56.908168 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3d8a9-98bf-4b5a-9698-7e4f0b373704 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:56.909384 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3d8a9-98bf-4b5a-9698-7e4f0b373704 admin admin] PATH_INFO: `/v3/projects/75e92d9300d74e61a63b76247c623781/users/cc6f1ab66fea41dc9c9f92c827b0cb75/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:56.939478 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a3d8a9-98bf-4b5a-9698-7e4f0b373704 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75e92d9300d74e61a63b76247c623781, user_id=cc6f1ab66fea41dc9c9f92c827b0cb75, role_id=4cbf6ec846eb4b7c8cc52e9bfd6f076f)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:56.942928 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a3d8a9-98bf-4b5a-9698-7e4f0b373704 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:56.943793 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1016/2070] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:56 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:35:56.944768 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d93310e-b2ee-434f-84ee-fc720a82bbbd None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:56.961400 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d93310e-b2ee-434f-84ee-fc720a82bbbd None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:56.981028 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1055/2071] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:35:56 2022] PUT /identity/v3/projects/75e92d9300d74e61a63b76247c623781/users/cc6f1ab66fea41dc9c9f92c827b0cb75/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:56.983541 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a3d8a9-98bf-4b5a-9698-7e4f0b373704 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:56.986262 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-45a3d8a9-98bf-4b5a-9698-7e4f0b373704 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:57.051449 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa71900a-d290-4b6b-9057-9e9600b31ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:57.052837 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71900a-d290-4b6b-9057-9e9600b31ddf admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:57.054088 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71900a-d290-4b6b-9057-9e9600b31ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:57.054373 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71900a-d290-4b6b-9057-9e9600b31ddf admin admin] PATH_INFO: `/v3/projects/cf163b4663c9480e863469eae3b033d1/users/afe074a9aaa14146b8521d8454c1a674/roles/6cb03785fb184ef587509b3174622f69` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:57.056546 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa71900a-d290-4b6b-9057-9e9600b31ddf admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf163b4663c9480e863469eae3b033d1, user_id=afe074a9aaa14146b8521d8454c1a674, role_id=6cb03785fb184ef587509b3174622f69)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:57.059901 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa71900a-d290-4b6b-9057-9e9600b31ddf admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:57.078999 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a3d8a9-98bf-4b5a-9698-7e4f0b373704 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:57.081340 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1017/2072] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:35:56 2022] PUT /identity/v3/projects/cf163b4663c9480e863469eae3b033d1/users/afe074a9aaa14146b8521d8454c1a674/roles/6cb03785fb184ef587509b3174622f69 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:57.082537 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa71900a-d290-4b6b-9057-9e9600b31ddf admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:57.084767 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-aa71900a-d290-4b6b-9057-9e9600b31ddf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:57.171329 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa71900a-d290-4b6b-9057-9e9600b31ddf admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:57.176874 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25fa553-c083-46dc-a50a-80a3ce7aacd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:57.177802 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25fa553-c083-46dc-a50a-80a3ce7aacd4 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:57.178185 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25fa553-c083-46dc-a50a-80a3ce7aacd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:57.178465 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25fa553-c083-46dc-a50a-80a3ce7aacd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:57.179540 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25fa553-c083-46dc-a50a-80a3ce7aacd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:57.179679 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e374f7-a019-4847-a3ad-a56bd0b44e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:57.180596 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e374f7-a019-4847-a3ad-a56bd0b44e8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:57.180949 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e374f7-a019-4847-a3ad-a56bd0b44e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:57.181318 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e374f7-a019-4847-a3ad-a56bd0b44e8b admin admin] PATH_INFO: `/v3/projects/5e9f37b745b8421c8d57ea44604845a4` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:57.182230 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25fa553-c083-46dc-a50a-80a3ce7aacd4 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:57.182950 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e374f7-a019-4847-a3ad-a56bd0b44e8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e9f37b745b8421c8d57ea44604845a4)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:57.184976 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e374f7-a019-4847-a3ad-a56bd0b44e8b admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:57.218993 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1018/2073] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:35:57 2022] POST /identity/v3/projects => generated 391 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:35:57.218993 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa0e7d1-0aca-4645-9ec3-e12a954ec6f9 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:57.218993 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa0e7d1-0aca-4645-9ec3-e12a954ec6f9 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:57.218993 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa0e7d1-0aca-4645-9ec3-e12a954ec6f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:57.248528 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-0aa0e7d1-0aca-4645-9ec3-e12a954ec6f9 None None] MFA Rules not processed for user `cc6f1ab66fea41dc9c9f92c827b0cb75`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:57.249812 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-0aa0e7d1-0aca-4645-9ec3-e12a954ec6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:57.251036 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:57.253158 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-a2e374f7-a019-4847-a3ad-a56bd0b44e8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e9f37b745b8421c8d57ea44604845a4', 'request_id': 'req-a2e374f7-a019-4847-a3ad-a56bd0b44e8b'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:57.265160 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-a2e374f7-a019-4847-a3ad-a56bd0b44e8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e9f37b745b8421c8d57ea44604845a4', 'request_id': 'req-a2e374f7-a019-4847-a3ad-a56bd0b44e8b'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:57.272706 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:57.287321 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-a2e374f7-a019-4847-a3ad-a56bd0b44e8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e9f37b745b8421c8d57ea44604845a4', 'request_id': 'req-a2e374f7-a019-4847-a3ad-a56bd0b44e8b'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:57.304451 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-a2e374f7-a019-4847-a3ad-a56bd0b44e8b admin admin] The token cache is being invalidate because project 5e9f37b745b8421c8d57ea44604845a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:35:57.304746 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-a2e374f7-a019-4847-a3ad-a56bd0b44e8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:57.305500 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-a2e374f7-a019-4847-a3ad-a56bd0b44e8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:57.307406 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1056/2074] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:35:56 2022] DELETE /identity/v3/projects/5e9f37b745b8421c8d57ea44604845a4 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:57.308284 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e374f7-a019-4847-a3ad-a56bd0b44e8b admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:57.309682 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-a2e374f7-a019-4847-a3ad-a56bd0b44e8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:57.351559 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1019/2075] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:35:57.353875 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45be26a-28c0-49c6-a9dc-8291dffe3ee4 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:57.354222 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45be26a-28c0-49c6-a9dc-8291dffe3ee4 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:57.354675 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45be26a-28c0-49c6-a9dc-8291dffe3ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:57.389066 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-a45be26a-28c0-49c6-a9dc-8291dffe3ee4 None None] MFA Rules not processed for user `afe074a9aaa14146b8521d8454c1a674`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:57.390864 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-a45be26a-28c0-49c6-a9dc-8291dffe3ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:57.431175 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e374f7-a019-4847-a3ad-a56bd0b44e8b admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:57.436453 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3f207a-ef01-478b-9be6-ddd5edb38b4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a3ed285ee4c4d04abf7daf0aeb9fb7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:57.436453 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f207a-ef01-478b-9be6-ddd5edb38b4b service cinder] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:57.437629 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f207a-ef01-478b-9be6-ddd5edb38b4b service cinder] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:57.437977 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f207a-ef01-478b-9be6-ddd5edb38b4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:57.440240 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-7e3f207a-ef01-478b-9be6-ddd5edb38b4b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:57.529111 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1020/2076] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:57 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:35:57.533363 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45be26a-28c0-49c6-a9dc-8291dffe3ee4 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:57.536999 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-a45be26a-28c0-49c6-a9dc-8291dffe3ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:57.561951 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3f207a-ef01-478b-9be6-ddd5edb38b4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:57.563667 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3f207a-ef01-478b-9be6-ddd5edb38b4b service cinder] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:57.580802 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1057/2077] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:35:57 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:35:57.581886 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3f207a-ef01-478b-9be6-ddd5edb38b4b service cinder] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:57.584227 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-7e3f207a-ef01-478b-9be6-ddd5edb38b4b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:57.625458 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45be26a-28c0-49c6-a9dc-8291dffe3ee4 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:57.629484 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a34060e-fed9-4d13-b128-830f813f6c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:57.630307 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34060e-fed9-4d13-b128-830f813f6c0f admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:57.630691 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34060e-fed9-4d13-b128-830f813f6c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:57.631067 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34060e-fed9-4d13-b128-830f813f6c0f admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:57.631938 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a34060e-fed9-4d13-b128-830f813f6c0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:57.634517 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a34060e-fed9-4d13-b128-830f813f6c0f admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:57.682026 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3f207a-ef01-478b-9be6-ddd5edb38b4b service cinder] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:57.682026 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc97374a-cf67-43aa-8b16-67ca75bf4178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:57.682026 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc97374a-cf67-43aa-8b16-67ca75bf4178 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:57.682026 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc97374a-cf67-43aa-8b16-67ca75bf4178 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:57.682428 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc97374a-cf67-43aa-8b16-67ca75bf4178 admin admin] PATH_INFO: `/v3/users/d994be1468e8462485590d40a3d1d343` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:57.682428 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc97374a-cf67-43aa-8b16-67ca75bf4178 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d994be1468e8462485590d40a3d1d343)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:57.683308 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc97374a-cf67-43aa-8b16-67ca75bf4178 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:57.685975 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1021/2078] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:35:57 2022] POST /identity/v3/users => generated 302 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:35:57.688044 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a34060e-fed9-4d13-b128-830f813f6c0f admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:57.692118 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-8a34060e-fed9-4d13-b128-830f813f6c0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:57.709093 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a34060e-fed9-4d13-b128-830f813f6c0f admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:57.718513 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27b9e46-b0a7-48ac-8503-0a9960fc79c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a3ed285ee4c4d04abf7daf0aeb9fb7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:57.719314 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b9e46-b0a7-48ac-8503-0a9960fc79c1 service cinder] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:57.719609 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b9e46-b0a7-48ac-8503-0a9960fc79c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:57.719983 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b9e46-b0a7-48ac-8503-0a9960fc79c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:57.736278 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:57.745954 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27b9e46-b0a7-48ac-8503-0a9960fc79c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:57.748832 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27b9e46-b0a7-48ac-8503-0a9960fc79c1 service cinder] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:57.761934 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1022/2079] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:35:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:35:57.763737 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27b9e46-b0a7-48ac-8503-0a9960fc79c1 service cinder] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:57.779292 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27b9e46-b0a7-48ac-8503-0a9960fc79c1 service cinder] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:57.789613 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d979098d-e850-4b7d-9663-cdeadaca0a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:57.791298 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d979098d-e850-4b7d-9663-cdeadaca0a9b admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:57.792036 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d979098d-e850-4b7d-9663-cdeadaca0a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:57.792402 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d979098d-e850-4b7d-9663-cdeadaca0a9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:57.793171 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d979098d-e850-4b7d-9663-cdeadaca0a9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:57.795885 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-bc97374a-cf67-43aa-8b16-67ca75bf4178 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd994be1468e8462485590d40a3d1d343'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:57.796768 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-bc97374a-cf67-43aa-8b16-67ca75bf4178 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd994be1468e8462485590d40a3d1d343'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:57.797389 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d979098d-e850-4b7d-9663-cdeadaca0a9b admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:57.818097 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1023/2080] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:35:57 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:35:57.819845 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d979098d-e850-4b7d-9663-cdeadaca0a9b admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:57.824445 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-bc97374a-cf67-43aa-8b16-67ca75bf4178 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd994be1468e8462485590d40a3d1d343'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:57.838791 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d979098d-e850-4b7d-9663-cdeadaca0a9b admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:57.839993 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-bc97374a-cf67-43aa-8b16-67ca75bf4178 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd994be1468e8462485590d40a3d1d343'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:57.847313 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372647ef-1407-4702-946a-e47ae1db7c8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a3ed285ee4c4d04abf7daf0aeb9fb7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:57.849793 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372647ef-1407-4702-946a-e47ae1db7c8f service cinder] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:57.850474 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372647ef-1407-4702-946a-e47ae1db7c8f service cinder] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:57.851468 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372647ef-1407-4702-946a-e47ae1db7c8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:57.860645 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-bc97374a-cf67-43aa-8b16-67ca75bf4178 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd994be1468e8462485590d40a3d1d343'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:57.872228 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:57.875131 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372647ef-1407-4702-946a-e47ae1db7c8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:57.876982 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372647ef-1407-4702-946a-e47ae1db7c8f service cinder] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:57.882950 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1058/2081] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:35:57 2022] DELETE /identity/v3/users/d994be1468e8462485590d40a3d1d343 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:57.882950 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc97374a-cf67-43aa-8b16-67ca75bf4178 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:57.885347 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-bc97374a-cf67-43aa-8b16-67ca75bf4178 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:57.912816 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1024/2082] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:35:57 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:35:58.026497 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc97374a-cf67-43aa-8b16-67ca75bf4178 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:58.033046 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1281426-4c8c-4a30-b423-359a853dd74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:58.034590 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1281426-4c8c-4a30-b423-359a853dd74d admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:58.034981 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1281426-4c8c-4a30-b423-359a853dd74d admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:58.035431 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1281426-4c8c-4a30-b423-359a853dd74d admin admin] PATH_INFO: `/v3/projects/dde7e1da41864dd2bb7c23377c6144d5/users/6089bd67fda24d9487ace491f026cdd2/roles/6cb03785fb184ef587509b3174622f69` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:58.060070 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1281426-4c8c-4a30-b423-359a853dd74d admin admin] RBAC: Authorizing `identity:create_grant(project_id=dde7e1da41864dd2bb7c23377c6144d5, user_id=6089bd67fda24d9487ace491f026cdd2, role_id=6cb03785fb184ef587509b3174622f69)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:58.067689 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1281426-4c8c-4a30-b423-359a853dd74d admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:58.105680 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1059/2083] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:35:57 2022] PUT /identity/v3/projects/dde7e1da41864dd2bb7c23377c6144d5/users/6089bd67fda24d9487ace491f026cdd2/roles/6cb03785fb184ef587509b3174622f69 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:58.107799 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372647ef-1407-4702-946a-e47ae1db7c8f service cinder] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:58.124805 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372647ef-1407-4702-946a-e47ae1db7c8f service cinder] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:58.375250 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f9bad-886d-4eae-b161-df50f9a66be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:58.376738 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f9bad-886d-4eae-b161-df50f9a66be0 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:58.378486 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f9bad-886d-4eae-b161-df50f9a66be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:58.378880 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f9bad-886d-4eae-b161-df50f9a66be0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:58.385899 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9f9bad-886d-4eae-b161-df50f9a66be0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:58.404084 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9f9bad-886d-4eae-b161-df50f9a66be0 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:58.444618 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1025/2084] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:35:58 2022] GET /identity/v3/roles => generated 1420 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:35:58.445705 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1281426-4c8c-4a30-b423-359a853dd74d admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:58.471382 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1281426-4c8c-4a30-b423-359a853dd74d admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:58.489576 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642a1e94-743e-4a84-b289-9bb565031199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:58.490507 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a1e94-743e-4a84-b289-9bb565031199 admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:58.490764 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a1e94-743e-4a84-b289-9bb565031199 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:58.491045 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a1e94-743e-4a84-b289-9bb565031199 admin admin] PATH_INFO: `/v3/projects/dde7e1da41864dd2bb7c23377c6144d5/users/6089bd67fda24d9487ace491f026cdd2/roles/6cb03785fb184ef587509b3174622f69` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:58.502657 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642a1e94-743e-4a84-b289-9bb565031199 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dde7e1da41864dd2bb7c23377c6144d5, user_id=6089bd67fda24d9487ace491f026cdd2, role_id=6cb03785fb184ef587509b3174622f69)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:58.507689 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642a1e94-743e-4a84-b289-9bb565031199 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:58.593106 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1060/2085] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:35:58 2022] PUT /identity/v3/projects/dde7e1da41864dd2bb7c23377c6144d5/users/6089bd67fda24d9487ace491f026cdd2/roles/6cb03785fb184ef587509b3174622f69 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:58.594971 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b4ec5-1152-42f8-83f2-e3e280f1422c None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:58.595337 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b4ec5-1152-42f8-83f2-e3e280f1422c None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:58.595717 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b4ec5-1152-42f8-83f2-e3e280f1422c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:58.599303 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642a1e94-743e-4a84-b289-9bb565031199 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:58.602007 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-642a1e94-743e-4a84-b289-9bb565031199 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:58.667971 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-a06b4ec5-1152-42f8-83f2-e3e280f1422c None None] MFA Rules not processed for user `6089bd67fda24d9487ace491f026cdd2`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:58.669830 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-a06b4ec5-1152-42f8-83f2-e3e280f1422c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:58.804782 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642a1e94-743e-4a84-b289-9bb565031199 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:58.813543 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57263248-fa99-4d90-ad5d-aa09d0652392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:58.813686 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1026/2086] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:58 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:35:58.813801 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57263248-fa99-4d90-ad5d-aa09d0652392 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:58.813801 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57263248-fa99-4d90-ad5d-aa09d0652392 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:58.813801 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57263248-fa99-4d90-ad5d-aa09d0652392 admin admin] PATH_INFO: `/v3/projects/eb5b38adbf0944629dc4217646bbadf9` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:58.815222 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57263248-fa99-4d90-ad5d-aa09d0652392 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb5b38adbf0944629dc4217646bbadf9)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:58.819524 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57263248-fa99-4d90-ad5d-aa09d0652392 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:58.835756 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06b4ec5-1152-42f8-83f2-e3e280f1422c None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:58.837365 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-a06b4ec5-1152-42f8-83f2-e3e280f1422c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:58.851312 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:58.922682 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-57263248-fa99-4d90-ad5d-aa09d0652392 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb5b38adbf0944629dc4217646bbadf9', 'request_id': 'req-57263248-fa99-4d90-ad5d-aa09d0652392'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:58.937536 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06b4ec5-1152-42f8-83f2-e3e280f1422c None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:58.939524 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-57263248-fa99-4d90-ad5d-aa09d0652392 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb5b38adbf0944629dc4217646bbadf9', 'request_id': 'req-57263248-fa99-4d90-ad5d-aa09d0652392'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:58.962953 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-57263248-fa99-4d90-ad5d-aa09d0652392 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb5b38adbf0944629dc4217646bbadf9', 'request_id': 'req-57263248-fa99-4d90-ad5d-aa09d0652392'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:58.992320 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-57263248-fa99-4d90-ad5d-aa09d0652392 admin admin] The token cache is being invalidate because project eb5b38adbf0944629dc4217646bbadf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:35:58.993117 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-57263248-fa99-4d90-ad5d-aa09d0652392 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:58.994403 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-57263248-fa99-4d90-ad5d-aa09d0652392 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:35:58.998459 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1061/2087] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:35:58 2022] DELETE /identity/v3/projects/eb5b38adbf0944629dc4217646bbadf9 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:35:59.005000 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4592e99e-e7b7-473b-a127-9c55f09a6885 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:59.005299 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4592e99e-e7b7-473b-a127-9c55f09a6885 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:59.005555 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4592e99e-e7b7-473b-a127-9c55f09a6885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:59.009657 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:59.043269 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f433182f-06ec-4982-a9c4-957b265ad8c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a3ed285ee4c4d04abf7daf0aeb9fb7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:59.044333 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f433182f-06ec-4982-a9c4-957b265ad8c6 service cinder] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:59.044633 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f433182f-06ec-4982-a9c4-957b265ad8c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:59.044923 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f433182f-06ec-4982-a9c4-957b265ad8c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:59.046983 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-4592e99e-e7b7-473b-a127-9c55f09a6885 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:59.047779 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-f433182f-06ec-4982-a9c4-957b265ad8c6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:59.048379 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-4592e99e-e7b7-473b-a127-9c55f09a6885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:59.146857 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1062/2088] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:35:59.159162 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc8d5c-43c9-4b3c-964e-028800e7ffd8 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:59.159728 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc8d5c-43c9-4b3c-964e-028800e7ffd8 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:59.160184 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc8d5c-43c9-4b3c-964e-028800e7ffd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:59.180044 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f433182f-06ec-4982-a9c4-957b265ad8c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:59.181689 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f433182f-06ec-4982-a9c4-957b265ad8c6 service cinder] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:59.196829 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-3adc8d5c-43c9-4b3c-964e-028800e7ffd8 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:59.198729 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-3adc8d5c-43c9-4b3c-964e-028800e7ffd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:59.212998 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1063/2089] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:35:59.214216 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adc8d5c-43c9-4b3c-964e-028800e7ffd8 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:59.221083 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1027/2090] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:35:58 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 19:35:59.227251 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adc8d5c-43c9-4b3c-964e-028800e7ffd8 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:59.233689 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b764cdf-8269-4241-b5cc-ce95f9f0c417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:59.234702 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b764cdf-8269-4241-b5cc-ce95f9f0c417 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:59.235326 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b764cdf-8269-4241-b5cc-ce95f9f0c417 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:59.235844 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b764cdf-8269-4241-b5cc-ce95f9f0c417 admin admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:59.237012 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b764cdf-8269-4241-b5cc-ce95f9f0c417 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:35:59.237481 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b764cdf-8269-4241-b5cc-ce95f9f0c417 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:59.239441 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b764cdf-8269-4241-b5cc-ce95f9f0c417 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:59.257721 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1064/2091] 10.222.0.26 () {58 vars in 1152 bytes} [Fri Jul 1 19:35:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:35:59.263501 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f433182f-06ec-4982-a9c4-957b265ad8c6 service cinder] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:59.280834 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f433182f-06ec-4982-a9c4-957b265ad8c6 service cinder] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:59.288668 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad2b14c-8283-48c7-81e7-582df7a23674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:59.290301 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad2b14c-8283-48c7-81e7-582df7a23674 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:59.290596 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b764cdf-8269-4241-b5cc-ce95f9f0c417 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:59.291225 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad2b14c-8283-48c7-81e7-582df7a23674 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:59.292263 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad2b14c-8283-48c7-81e7-582df7a23674 admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:59.292784 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-4b764cdf-8269-4241-b5cc-ce95f9f0c417 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:59.294567 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad2b14c-8283-48c7-81e7-582df7a23674 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:59.299031 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad2b14c-8283-48c7-81e7-582df7a23674 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:59.310063 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b764cdf-8269-4241-b5cc-ce95f9f0c417 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:59.315288 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926aa61d-4c3c-4809-8ed2-943b0965930c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a3ed285ee4c4d04abf7daf0aeb9fb7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:59.316685 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926aa61d-4c3c-4809-8ed2-943b0965930c service cinder] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:59.316989 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926aa61d-4c3c-4809-8ed2-943b0965930c service cinder] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:59.317300 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926aa61d-4c3c-4809-8ed2-943b0965930c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:59.319532 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-926aa61d-4c3c-4809-8ed2-943b0965930c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:59.367784 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1028/2092] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:35:59 2022] POST /identity/v3/projects => generated 387 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:35:59.372734 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad2b14c-8283-48c7-81e7-582df7a23674 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:59.448685 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926aa61d-4c3c-4809-8ed2-943b0965930c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:59.450847 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926aa61d-4c3c-4809-8ed2-943b0965930c service cinder] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:59.461427 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1065/2093] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:35:59 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:35:59.474317 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad2b14c-8283-48c7-81e7-582df7a23674 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:59.482889 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902a8349-9c55-4a17-b27b-270cc2c061cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:59.483713 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a8349-9c55-4a17-b27b-270cc2c061cd admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:59.484114 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a8349-9c55-4a17-b27b-270cc2c061cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:59.484473 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a8349-9c55-4a17-b27b-270cc2c061cd admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:59.485355 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902a8349-9c55-4a17-b27b-270cc2c061cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:59.487588 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902a8349-9c55-4a17-b27b-270cc2c061cd admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:59.520701 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1029/2094] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:35:59 2022] POST /identity/v3/users => generated 294 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:35:59.522167 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926aa61d-4c3c-4809-8ed2-943b0965930c service cinder] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:59.537623 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926aa61d-4c3c-4809-8ed2-943b0965930c service cinder] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:59.543037 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c480bfc-a7c6-48ae-84ad-5bd6f8fae292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:59.543730 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c480bfc-a7c6-48ae-84ad-5bd6f8fae292 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:59.544063 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c480bfc-a7c6-48ae-84ad-5bd6f8fae292 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:59.544343 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c480bfc-a7c6-48ae-84ad-5bd6f8fae292 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:59.545082 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c480bfc-a7c6-48ae-84ad-5bd6f8fae292 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:59.548760 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c480bfc-a7c6-48ae-84ad-5bd6f8fae292 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:59.576971 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902a8349-9c55-4a17-b27b-270cc2c061cd admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:59.579808 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1066/2095] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:35:59 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:35:59.594276 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902a8349-9c55-4a17-b27b-270cc2c061cd admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:59.611077 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f10b7c-4bc1-4d9a-a261-75d074ca0152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:59.611770 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f10b7c-4bc1-4d9a-a261-75d074ca0152 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:59.612056 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f10b7c-4bc1-4d9a-a261-75d074ca0152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:59.612328 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f10b7c-4bc1-4d9a-a261-75d074ca0152 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:59.618090 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f10b7c-4bc1-4d9a-a261-75d074ca0152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:59.619885 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f10b7c-4bc1-4d9a-a261-75d074ca0152 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:59.646526 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1030/2096] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:35:59 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 19:35:59.647491 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c480bfc-a7c6-48ae-84ad-5bd6f8fae292 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:35:59.661519 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c480bfc-a7c6-48ae-84ad-5bd6f8fae292 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:35:59.676561 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98375e9-1d6a-430b-92c6-d9db12b96c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:35:59.677502 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98375e9-1d6a-430b-92c6-d9db12b96c2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:59.677866 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98375e9-1d6a-430b-92c6-d9db12b96c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:59.678064 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98375e9-1d6a-430b-92c6-d9db12b96c2f admin admin] PATH_INFO: `/v3/projects/1706fe45828d45c2978574a638c19361/users/1f552abe649043fc8eae305f4d248c13/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:59.693111 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:59.703695 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98375e9-1d6a-430b-92c6-d9db12b96c2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1706fe45828d45c2978574a638c19361, user_id=1f552abe649043fc8eae305f4d248c13, role_id=4cbf6ec846eb4b7c8cc52e9bfd6f076f)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:35:59.710349 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98375e9-1d6a-430b-92c6-d9db12b96c2f admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:35:59.746106 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1067/2097] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:35:59 2022] PUT /identity/v3/projects/1706fe45828d45c2978574a638c19361/users/1f552abe649043fc8eae305f4d248c13/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 19:35:59.759245 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d0ff7e-60d2-42d6-9564-5f75ad975c1a None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:35:59.759545 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d0ff7e-60d2-42d6-9564-5f75ad975c1a None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:35:59.760240 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d0ff7e-60d2-42d6-9564-5f75ad975c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:35:59.816630 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-e5d0ff7e-60d2-42d6-9564-5f75ad975c1a None None] MFA Rules not processed for user `1f552abe649043fc8eae305f4d248c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:35:59.820929 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-e5d0ff7e-60d2-42d6-9564-5f75ad975c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:35:59.910948 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:35:59.960028 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1031/2098] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:35:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:35:59.964316 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98375e9-1d6a-430b-92c6-d9db12b96c2f admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:00.118824 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98375e9-1d6a-430b-92c6-d9db12b96c2f admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:00.129008 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a607c965-bb50-4c5c-b860-f5bcab315000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:00.130475 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a607c965-bb50-4c5c-b860-f5bcab315000 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:00.131039 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a607c965-bb50-4c5c-b860-f5bcab315000 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:00.133601 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a607c965-bb50-4c5c-b860-f5bcab315000 admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:00.135440 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a607c965-bb50-4c5c-b860-f5bcab315000 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:00.138765 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a607c965-bb50-4c5c-b860-f5bcab315000 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:00.204879 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1068/2099] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:35:59 2022] POST /identity/v3/projects => generated 387 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:36:00.209365 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d0ff7e-60d2-42d6-9564-5f75ad975c1a None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:00.233004 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d0ff7e-60d2-42d6-9564-5f75ad975c1a None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:00.450773 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5150c425-b4d7-4de0-bda4-4575013bb2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:00.460298 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5150c425-b4d7-4de0-bda4-4575013bb2c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:00.460603 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5150c425-b4d7-4de0-bda4-4575013bb2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:00.460898 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5150c425-b4d7-4de0-bda4-4575013bb2c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:00.465428 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5150c425-b4d7-4de0-bda4-4575013bb2c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:00.468292 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5150c425-b4d7-4de0-bda4-4575013bb2c3 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:00.508297 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1032/2100] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:36:00 2022] POST /identity/v3/users => generated 300 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:36:00.516446 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a607c965-bb50-4c5c-b860-f5bcab315000 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:00.540082 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a607c965-bb50-4c5c-b860-f5bcab315000 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:00.551597 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a33c69-a809-4a79-818a-bfec2f4cc8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:00.552287 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a33c69-a809-4a79-818a-bfec2f4cc8a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:00.552576 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a33c69-a809-4a79-818a-bfec2f4cc8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:00.552857 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a33c69-a809-4a79-818a-bfec2f4cc8a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:00.553630 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a33c69-a809-4a79-818a-bfec2f4cc8a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:00.555424 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a33c69-a809-4a79-818a-bfec2f4cc8a7 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:00.603584 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1069/2101] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:36:00 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:36:00.607925 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5150c425-b4d7-4de0-bda4-4575013bb2c3 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:00.627945 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5150c425-b4d7-4de0-bda4-4575013bb2c3 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:00.641655 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e47596-428f-4633-8891-487a36dd3296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:00.642653 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e47596-428f-4633-8891-487a36dd3296 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:00.643102 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e47596-428f-4633-8891-487a36dd3296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:00.643563 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e47596-428f-4633-8891-487a36dd3296 admin admin] PATH_INFO: `/v3/projects/874d9331a7a94225847ff70935e8a98b/users/4271cb360a3440c6a3afb4574bfb94d0/roles/6cb03785fb184ef587509b3174622f69` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:00.676677 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e47596-428f-4633-8891-487a36dd3296 admin admin] RBAC: Authorizing `identity:create_grant(project_id=874d9331a7a94225847ff70935e8a98b, user_id=4271cb360a3440c6a3afb4574bfb94d0, role_id=6cb03785fb184ef587509b3174622f69)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:00.679804 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e47596-428f-4633-8891-487a36dd3296 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:00.713546 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1033/2102] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:36:00 2022] PUT /identity/v3/projects/874d9331a7a94225847ff70935e8a98b/users/4271cb360a3440c6a3afb4574bfb94d0/roles/6cb03785fb184ef587509b3174622f69 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:36:00.718525 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a33c69-a809-4a79-818a-bfec2f4cc8a7 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:00.734424 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a33c69-a809-4a79-818a-bfec2f4cc8a7 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:00.852564 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314a3ecd-0f27-47b8-9eae-cc9dfdc6b5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:00.855987 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a3ecd-0f27-47b8-9eae-cc9dfdc6b5f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:00.856652 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a3ecd-0f27-47b8-9eae-cc9dfdc6b5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:00.856652 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a3ecd-0f27-47b8-9eae-cc9dfdc6b5f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:00.865570 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314a3ecd-0f27-47b8-9eae-cc9dfdc6b5f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:00.867404 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314a3ecd-0f27-47b8-9eae-cc9dfdc6b5f8 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:00.891325 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1070/2103] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:36:00 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 19:36:00.892478 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e47596-428f-4633-8891-487a36dd3296 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:00.907345 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e47596-428f-4633-8891-487a36dd3296 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:00.921333 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a471f8-31b9-4640-9655-b865080e383b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:00.922277 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a471f8-31b9-4640-9655-b865080e383b admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:00.922567 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a471f8-31b9-4640-9655-b865080e383b admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:00.922908 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a471f8-31b9-4640-9655-b865080e383b admin admin] PATH_INFO: `/v3/projects/874d9331a7a94225847ff70935e8a98b/users/4271cb360a3440c6a3afb4574bfb94d0/roles/6cb03785fb184ef587509b3174622f69` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:00.928140 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a471f8-31b9-4640-9655-b865080e383b admin admin] RBAC: Authorizing `identity:create_grant(project_id=874d9331a7a94225847ff70935e8a98b, user_id=4271cb360a3440c6a3afb4574bfb94d0, role_id=6cb03785fb184ef587509b3174622f69)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:00.931167 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a471f8-31b9-4640-9655-b865080e383b admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:00.961724 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1034/2104] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:36:00 2022] PUT /identity/v3/projects/874d9331a7a94225847ff70935e8a98b/users/4271cb360a3440c6a3afb4574bfb94d0/roles/6cb03785fb184ef587509b3174622f69 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 19:36:00.975832 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be8c39-81c6-4839-9ea1-befe17c58f0a None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:00.976358 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be8c39-81c6-4839-9ea1-befe17c58f0a None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:00.976733 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be8c39-81c6-4839-9ea1-befe17c58f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:01.015897 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-d8be8c39-81c6-4839-9ea1-befe17c58f0a None None] MFA Rules not processed for user `4271cb360a3440c6a3afb4574bfb94d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:36:01.017529 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-d8be8c39-81c6-4839-9ea1-befe17c58f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:01.110164 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:01.155927 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1071/2105] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:36:00 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:36:01.187918 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a471f8-31b9-4640-9655-b865080e383b admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:01.191022 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-e8a471f8-31b9-4640-9655-b865080e383b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:01.311853 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a471f8-31b9-4640-9655-b865080e383b admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:01.317509 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342bde7f-610f-4a02-9ecc-9acf87e4661a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a3ed285ee4c4d04abf7daf0aeb9fb7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:01.319411 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342bde7f-610f-4a02-9ecc-9acf87e4661a service cinder] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:01.320565 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342bde7f-610f-4a02-9ecc-9acf87e4661a service cinder] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:01.322230 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342bde7f-610f-4a02-9ecc-9acf87e4661a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:01.348085 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342bde7f-610f-4a02-9ecc-9acf87e4661a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:01.349714 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342bde7f-610f-4a02-9ecc-9acf87e4661a service cinder] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:01.373449 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1035/2106] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:36:01 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:36:01.449712 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8be8c39-81c6-4839-9ea1-befe17c58f0a None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:01.451845 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-d8be8c39-81c6-4839-9ea1-befe17c58f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:01.587154 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8be8c39-81c6-4839-9ea1-befe17c58f0a None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:01.598319 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c9852c-8470-4f2d-94b3-c1a7c928006b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:01.599312 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9852c-8470-4f2d-94b3-c1a7c928006b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:01.599474 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9852c-8470-4f2d-94b3-c1a7c928006b admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:01.599881 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9852c-8470-4f2d-94b3-c1a7c928006b admin admin] PATH_INFO: `/v3/users/b012af7808d3412e9fc1f5cfbd6d0379` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:01.602938 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c9852c-8470-4f2d-94b3-c1a7c928006b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b012af7808d3412e9fc1f5cfbd6d0379)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:01.607595 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c9852c-8470-4f2d-94b3-c1a7c928006b admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:01.723203 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-96c9852c-8470-4f2d-94b3-c1a7c928006b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b012af7808d3412e9fc1f5cfbd6d0379'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:01.725690 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-96c9852c-8470-4f2d-94b3-c1a7c928006b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b012af7808d3412e9fc1f5cfbd6d0379'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:01.744011 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-96c9852c-8470-4f2d-94b3-c1a7c928006b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b012af7808d3412e9fc1f5cfbd6d0379'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:01.756354 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-96c9852c-8470-4f2d-94b3-c1a7c928006b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b012af7808d3412e9fc1f5cfbd6d0379'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:01.771173 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-96c9852c-8470-4f2d-94b3-c1a7c928006b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b012af7808d3412e9fc1f5cfbd6d0379'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:01.787537 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1072/2107] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:36:01 2022] DELETE /identity/v3/users/b012af7808d3412e9fc1f5cfbd6d0379 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:36:01.794974 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd1ba19-d2dd-4439-a602-c5d26a066b59 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:01.795777 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd1ba19-d2dd-4439-a602-c5d26a066b59 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:01.795777 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd1ba19-d2dd-4439-a602-c5d26a066b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:01.843146 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-4fd1ba19-d2dd-4439-a602-c5d26a066b59 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:36:01.843338 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-4fd1ba19-d2dd-4439-a602-c5d26a066b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:01.890742 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:01.980009 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1036/2108] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:36:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:36:02.002574 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c9852c-8470-4f2d-94b3-c1a7c928006b admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:02.004347 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-96c9852c-8470-4f2d-94b3-c1a7c928006b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:02.152492 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c9852c-8470-4f2d-94b3-c1a7c928006b admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:02.157727 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db62eb6-fa8a-4092-8579-aef6977cc517 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:02.159193 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db62eb6-fa8a-4092-8579-aef6977cc517 service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:02.159514 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db62eb6-fa8a-4092-8579-aef6977cc517 service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:02.159803 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db62eb6-fa8a-4092-8579-aef6977cc517 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:02.186455 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db62eb6-fa8a-4092-8579-aef6977cc517 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:02.188614 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db62eb6-fa8a-4092-8579-aef6977cc517 service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:02.219396 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1073/2109] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:36:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:36:02.393730 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69030daf-3b3e-40de-8dad-ceead32ddf26 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:02.394359 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69030daf-3b3e-40de-8dad-ceead32ddf26 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:02.394914 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69030daf-3b3e-40de-8dad-ceead32ddf26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:02.466781 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-69030daf-3b3e-40de-8dad-ceead32ddf26 None None] MFA Rules not processed for user `91c82e59af62461e85d22fc4a8269c25`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:36:02.468089 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-69030daf-3b3e-40de-8dad-ceead32ddf26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:02.612960 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1037/2110] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:36:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:36:02.623558 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6740e7-c0c0-408d-9482-7cf4423e1c13 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:02.623854 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6740e7-c0c0-408d-9482-7cf4423e1c13 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:02.624133 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6740e7-c0c0-408d-9482-7cf4423e1c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:02.651094 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:02.673934 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-ce6740e7-c0c0-408d-9482-7cf4423e1c13 None None] MFA Rules not processed for user `91c82e59af62461e85d22fc4a8269c25`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:36:02.675243 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-ce6740e7-c0c0-408d-9482-7cf4423e1c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:02.702853 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1074/2111] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:36:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:36:02.709849 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69030daf-3b3e-40de-8dad-ceead32ddf26 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:02.712103 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-69030daf-3b3e-40de-8dad-ceead32ddf26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:02.838072 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6740e7-c0c0-408d-9482-7cf4423e1c13 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:02.840249 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-ce6740e7-c0c0-408d-9482-7cf4423e1c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:02.879016 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6740e7-c0c0-408d-9482-7cf4423e1c13 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:02.896342 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45d461c-faff-47ef-ab96-7e3f4108babb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:02.897145 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d461c-faff-47ef-ab96-7e3f4108babb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:02.897456 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d461c-faff-47ef-ab96-7e3f4108babb admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:02.897756 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d461c-faff-47ef-ab96-7e3f4108babb admin admin] PATH_INFO: `/v3/projects/a59ec3c152af4dc1b802a941c429eb26` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:02.899110 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45d461c-faff-47ef-ab96-7e3f4108babb admin admin] RBAC: Authorizing `identity:delete_project(project_id=a59ec3c152af4dc1b802a941c429eb26)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:02.901102 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45d461c-faff-47ef-ab96-7e3f4108babb admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:02.906405 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69030daf-3b3e-40de-8dad-ceead32ddf26 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:02.921443 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c59bce-46b7-4a30-8927-6fed1fa33cc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13fd76fc7dd1410b9cde5adbaa6cb2e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:02.922267 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c59bce-46b7-4a30-8927-6fed1fa33cc6 service nova] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:02.922701 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c59bce-46b7-4a30-8927-6fed1fa33cc6 service nova] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:02.923223 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c59bce-46b7-4a30-8927-6fed1fa33cc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:02.935360 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c59bce-46b7-4a30-8927-6fed1fa33cc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:02.937208 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c59bce-46b7-4a30-8927-6fed1fa33cc6 service nova] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:02.966139 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1038/2112] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:36:02 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:36:03.002613 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-b45d461c-faff-47ef-ab96-7e3f4108babb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a59ec3c152af4dc1b802a941c429eb26', 'request_id': 'req-b45d461c-faff-47ef-ab96-7e3f4108babb'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:03.017817 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-b45d461c-faff-47ef-ab96-7e3f4108babb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a59ec3c152af4dc1b802a941c429eb26', 'request_id': 'req-b45d461c-faff-47ef-ab96-7e3f4108babb'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:03.028217 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-b45d461c-faff-47ef-ab96-7e3f4108babb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a59ec3c152af4dc1b802a941c429eb26', 'request_id': 'req-b45d461c-faff-47ef-ab96-7e3f4108babb'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:03.049591 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-b45d461c-faff-47ef-ab96-7e3f4108babb admin admin] The token cache is being invalidate because project a59ec3c152af4dc1b802a941c429eb26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:36:03.050166 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-b45d461c-faff-47ef-ab96-7e3f4108babb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:03.051172 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-b45d461c-faff-47ef-ab96-7e3f4108babb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:03.053426 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1075/2113] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:36:02 2022] DELETE /identity/v3/projects/a59ec3c152af4dc1b802a941c429eb26 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:36:03.057435 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c59bce-46b7-4a30-8927-6fed1fa33cc6 service nova] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:03.070503 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c59bce-46b7-4a30-8927-6fed1fa33cc6 service nova] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:03.166843 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:03.203610 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359b8a44-34b0-4e37-8190-6a7e670328f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:03.204921 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b8a44-34b0-4e37-8190-6a7e670328f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:03.205397 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b8a44-34b0-4e37-8190-6a7e670328f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:03.206031 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b8a44-34b0-4e37-8190-6a7e670328f9 admin admin] PATH_INFO: `/v3/users/afe074a9aaa14146b8521d8454c1a674` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:03.207471 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359b8a44-34b0-4e37-8190-6a7e670328f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afe074a9aaa14146b8521d8454c1a674)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:03.209976 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359b8a44-34b0-4e37-8190-6a7e670328f9 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:03.265689 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45d461c-faff-47ef-ab96-7e3f4108babb admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:03.267843 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-b45d461c-faff-47ef-ab96-7e3f4108babb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:03.304162 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45d461c-faff-47ef-ab96-7e3f4108babb admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:03.324060 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05a2690-d7a4-4cdb-8797-779154f2fc92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:03.327447 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05a2690-d7a4-4cdb-8797-779154f2fc92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:03.327774 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05a2690-d7a4-4cdb-8797-779154f2fc92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:03.328071 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05a2690-d7a4-4cdb-8797-779154f2fc92 admin admin] PATH_INFO: `/v3/users/1f552abe649043fc8eae305f4d248c13` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:03.333832 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05a2690-d7a4-4cdb-8797-779154f2fc92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f552abe649043fc8eae305f4d248c13)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:03.338090 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05a2690-d7a4-4cdb-8797-779154f2fc92 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:03.344863 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-359b8a44-34b0-4e37-8190-6a7e670328f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afe074a9aaa14146b8521d8454c1a674'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:03.345685 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-359b8a44-34b0-4e37-8190-6a7e670328f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afe074a9aaa14146b8521d8454c1a674'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:03.377127 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-359b8a44-34b0-4e37-8190-6a7e670328f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afe074a9aaa14146b8521d8454c1a674'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:03.390688 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-359b8a44-34b0-4e37-8190-6a7e670328f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afe074a9aaa14146b8521d8454c1a674'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:03.393105 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-359b8a44-34b0-4e37-8190-6a7e670328f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afe074a9aaa14146b8521d8454c1a674'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:03.436724 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1039/2114] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:36:03 2022] DELETE /identity/v3/users/afe074a9aaa14146b8521d8454c1a674 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:36:03.447203 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359b8a44-34b0-4e37-8190-6a7e670328f9 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:03.449301 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-359b8a44-34b0-4e37-8190-6a7e670328f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:03.471866 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-b05a2690-d7a4-4cdb-8797-779154f2fc92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f552abe649043fc8eae305f4d248c13'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:03.472888 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-b05a2690-d7a4-4cdb-8797-779154f2fc92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f552abe649043fc8eae305f4d248c13'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:03.508541 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-b05a2690-d7a4-4cdb-8797-779154f2fc92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f552abe649043fc8eae305f4d248c13'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:03.527422 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-b05a2690-d7a4-4cdb-8797-779154f2fc92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f552abe649043fc8eae305f4d248c13'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:03.549298 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-b05a2690-d7a4-4cdb-8797-779154f2fc92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f552abe649043fc8eae305f4d248c13'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:03.563028 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1076/2115] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:36:03 2022] DELETE /identity/v3/users/1f552abe649043fc8eae305f4d248c13 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:36:03.565222 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84e67fe-8947-4bc3-af21-2a61caab7c83 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:03.565855 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84e67fe-8947-4bc3-af21-2a61caab7c83 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:03.566401 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84e67fe-8947-4bc3-af21-2a61caab7c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:03.594051 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359b8a44-34b0-4e37-8190-6a7e670328f9 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:03.609629 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-d84e67fe-8947-4bc3-af21-2a61caab7c83 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:36:03.611229 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-d84e67fe-8947-4bc3-af21-2a61caab7c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:03.689342 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:03.704276 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1077/2116] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:36:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:36:03.706015 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685bc812-a883-4d22-aa9f-f7d1194f5432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:03.707277 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685bc812-a883-4d22-aa9f-f7d1194f5432 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:03.707641 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685bc812-a883-4d22-aa9f-f7d1194f5432 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:03.708623 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685bc812-a883-4d22-aa9f-f7d1194f5432 admin admin] PATH_INFO: `/v3/users/d767776be4834413852c4af5691c15aa` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:03.710254 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685bc812-a883-4d22-aa9f-f7d1194f5432 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d767776be4834413852c4af5691c15aa)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:03.712369 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685bc812-a883-4d22-aa9f-f7d1194f5432 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:03.723030 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84e67fe-8947-4bc3-af21-2a61caab7c83 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:03.724611 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-d84e67fe-8947-4bc3-af21-2a61caab7c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:03.733882 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:03.816657 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-685bc812-a883-4d22-aa9f-f7d1194f5432 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd767776be4834413852c4af5691c15aa'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:03.817574 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-685bc812-a883-4d22-aa9f-f7d1194f5432 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd767776be4834413852c4af5691c15aa'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:03.835439 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-685bc812-a883-4d22-aa9f-f7d1194f5432 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd767776be4834413852c4af5691c15aa'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:03.845881 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84e67fe-8947-4bc3-af21-2a61caab7c83 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:03.850592 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c41682-b08b-45a5-aecf-8b0b3058525d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:03.851010 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-685bc812-a883-4d22-aa9f-f7d1194f5432 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd767776be4834413852c4af5691c15aa'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:03.851335 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c41682-b08b-45a5-aecf-8b0b3058525d service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:03.851623 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c41682-b08b-45a5-aecf-8b0b3058525d service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:03.851928 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c41682-b08b-45a5-aecf-8b0b3058525d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:03.852018 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-685bc812-a883-4d22-aa9f-f7d1194f5432 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd767776be4834413852c4af5691c15aa'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:03.856896 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-83c41682-b08b-45a5-aecf-8b0b3058525d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:03.884165 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1040/2117] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:36:03 2022] DELETE /identity/v3/users/d767776be4834413852c4af5691c15aa => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:36:03.902465 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23351368-63d9-4935-9761-630e5afe8d0c None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:03.902775 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23351368-63d9-4935-9761-630e5afe8d0c None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:03.903440 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23351368-63d9-4935-9761-630e5afe8d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:03.914127 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c41682-b08b-45a5-aecf-8b0b3058525d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:03.915735 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c41682-b08b-45a5-aecf-8b0b3058525d service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:03.928567 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-23351368-63d9-4935-9761-630e5afe8d0c None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:36:03.931612 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-23351368-63d9-4935-9761-630e5afe8d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:03.944066 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1078/2118] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:36:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:36:04.013698 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1041/2119] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:36:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:36:04.027413 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c41682-b08b-45a5-aecf-8b0b3058525d service neutron] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:04.029065 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-83c41682-b08b-45a5-aecf-8b0b3058525d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:04.049281 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c41682-b08b-45a5-aecf-8b0b3058525d service neutron] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:04.138937 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac422ca1-e65f-417b-9ee4-2050ebd788a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:04.139700 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac422ca1-e65f-417b-9ee4-2050ebd788a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:04.140086 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac422ca1-e65f-417b-9ee4-2050ebd788a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:04.140590 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac422ca1-e65f-417b-9ee4-2050ebd788a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:04.153920 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac422ca1-e65f-417b-9ee4-2050ebd788a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:04.156122 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac422ca1-e65f-417b-9ee4-2050ebd788a5 service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:04.177313 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1079/2120] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:36:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:36:04.273275 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963c0ee-6ba9-4242-bb55-f063b0b17e86 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:04.273275 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963c0ee-6ba9-4242-bb55-f063b0b17e86 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:04.273275 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963c0ee-6ba9-4242-bb55-f063b0b17e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:04.274429 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac422ca1-e65f-417b-9ee4-2050ebd788a5 service neutron] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:04.276230 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-ac422ca1-e65f-417b-9ee4-2050ebd788a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:04.298295 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac422ca1-e65f-417b-9ee4-2050ebd788a5 service neutron] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:04.304158 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8ae8a3-1a45-419b-b0fb-447596f18fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:04.305137 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ae8a3-1a45-419b-b0fb-447596f18fd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:04.305472 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ae8a3-1a45-419b-b0fb-447596f18fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:04.305762 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ae8a3-1a45-419b-b0fb-447596f18fd9 admin admin] PATH_INFO: `/v3/projects/cf163b4663c9480e863469eae3b033d1` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:04.307536 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8ae8a3-1a45-419b-b0fb-447596f18fd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf163b4663c9480e863469eae3b033d1)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:04.310919 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8ae8a3-1a45-419b-b0fb-447596f18fd9 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:04.314284 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-8963c0ee-6ba9-4242-bb55-f063b0b17e86 None None] MFA Rules not processed for user `91c82e59af62461e85d22fc4a8269c25`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:36:04.316628 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-8963c0ee-6ba9-4242-bb55-f063b0b17e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:04.482398 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-ac8ae8a3-1a45-419b-b0fb-447596f18fd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf163b4663c9480e863469eae3b033d1', 'request_id': 'req-ac8ae8a3-1a45-419b-b0fb-447596f18fd9'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:04.510499 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-ac8ae8a3-1a45-419b-b0fb-447596f18fd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf163b4663c9480e863469eae3b033d1', 'request_id': 'req-ac8ae8a3-1a45-419b-b0fb-447596f18fd9'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:04.535052 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1042/2121] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:36:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:36:04.568544 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-ac8ae8a3-1a45-419b-b0fb-447596f18fd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf163b4663c9480e863469eae3b033d1', 'request_id': 'req-ac8ae8a3-1a45-419b-b0fb-447596f18fd9'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:04.629613 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-ac8ae8a3-1a45-419b-b0fb-447596f18fd9 admin admin] The token cache is being invalidate because project cf163b4663c9480e863469eae3b033d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:36:04.629822 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-ac8ae8a3-1a45-419b-b0fb-447596f18fd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:04.643399 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-ac8ae8a3-1a45-419b-b0fb-447596f18fd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:04.650721 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1080/2122] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:36:04 2022] DELETE /identity/v3/projects/cf163b4663c9480e863469eae3b033d1 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:36:04.656351 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8ae8a3-1a45-419b-b0fb-447596f18fd9 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:04.656768 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7664b8f-a5cc-4dd2-ad27-d344d4f100da None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:04.657070 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7664b8f-a5cc-4dd2-ad27-d344d4f100da None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:04.657488 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7664b8f-a5cc-4dd2-ad27-d344d4f100da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:04.660891 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-ac8ae8a3-1a45-419b-b0fb-447596f18fd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:04.709137 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-c7664b8f-a5cc-4dd2-ad27-d344d4f100da None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:36:04.710481 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-c7664b8f-a5cc-4dd2-ad27-d344d4f100da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:04.751240 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:04.792334 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:04.843474 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8ae8a3-1a45-419b-b0fb-447596f18fd9 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:04.861918 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53adf32e-0dac-46ec-918f-ca22612d425a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:04.862876 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53adf32e-0dac-46ec-918f-ca22612d425a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:04.863179 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53adf32e-0dac-46ec-918f-ca22612d425a admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:04.863622 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53adf32e-0dac-46ec-918f-ca22612d425a admin admin] PATH_INFO: `/v3/projects/1706fe45828d45c2978574a638c19361` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:04.871117 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53adf32e-0dac-46ec-918f-ca22612d425a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1706fe45828d45c2978574a638c19361)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:04.873150 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53adf32e-0dac-46ec-918f-ca22612d425a admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:04.902152 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1043/2123] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:36:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:36:04.903919 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f1c83-b9af-4c3b-b95a-0302cd9507a0 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:04.904274 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f1c83-b9af-4c3b-b95a-0302cd9507a0 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:04.904559 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f1c83-b9af-4c3b-b95a-0302cd9507a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:04.931702 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-b33f1c83-b9af-4c3b-b95a-0302cd9507a0 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:36:04.935771 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-b33f1c83-b9af-4c3b-b95a-0302cd9507a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:04.947426 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1044/2124] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:36:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:36:04.952687 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33f1c83-b9af-4c3b-b95a-0302cd9507a0 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:04.965649 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33f1c83-b9af-4c3b-b95a-0302cd9507a0 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:04.991820 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-53adf32e-0dac-46ec-918f-ca22612d425a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1706fe45828d45c2978574a638c19361', 'request_id': 'req-53adf32e-0dac-46ec-918f-ca22612d425a'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:05.005619 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-53adf32e-0dac-46ec-918f-ca22612d425a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1706fe45828d45c2978574a638c19361', 'request_id': 'req-53adf32e-0dac-46ec-918f-ca22612d425a'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:05.027211 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-53adf32e-0dac-46ec-918f-ca22612d425a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1706fe45828d45c2978574a638c19361', 'request_id': 'req-53adf32e-0dac-46ec-918f-ca22612d425a'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:05.073331 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-53adf32e-0dac-46ec-918f-ca22612d425a admin admin] The token cache is being invalidate because project 1706fe45828d45c2978574a638c19361 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:36:05.074089 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-53adf32e-0dac-46ec-918f-ca22612d425a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:05.081884 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-53adf32e-0dac-46ec-918f-ca22612d425a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:05.086273 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1081/2125] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:36:04 2022] DELETE /identity/v3/projects/1706fe45828d45c2978574a638c19361 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:36:05.087535 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53adf32e-0dac-46ec-918f-ca22612d425a admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:05.089464 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-53adf32e-0dac-46ec-918f-ca22612d425a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:05.141514 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a68e7f8-813f-442f-8a22-dfc3122c439f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:05.143732 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a68e7f8-813f-442f-8a22-dfc3122c439f admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:05.144015 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a68e7f8-813f-442f-8a22-dfc3122c439f admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:05.144789 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a68e7f8-813f-442f-8a22-dfc3122c439f admin admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:05.147004 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a68e7f8-813f-442f-8a22-dfc3122c439f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:36:05.147464 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a68e7f8-813f-442f-8a22-dfc3122c439f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:05.152462 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a68e7f8-813f-442f-8a22-dfc3122c439f admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:05.199348 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1045/2126] 10.222.0.26 () {58 vars in 1152 bytes} [Fri Jul 1 19:36:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:36:05.201024 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a68e7f8-813f-442f-8a22-dfc3122c439f admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:05.202820 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-0a68e7f8-813f-442f-8a22-dfc3122c439f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:05.205676 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53adf32e-0dac-46ec-918f-ca22612d425a admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:05.212747 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65fa162-7efe-4d8a-8f04-aa0baade8d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:05.215091 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65fa162-7efe-4d8a-8f04-aa0baade8d71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:05.215736 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65fa162-7efe-4d8a-8f04-aa0baade8d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:05.216242 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65fa162-7efe-4d8a-8f04-aa0baade8d71 admin admin] PATH_INFO: `/v3/users/a5073880326c41f7be9d275d96d89c97` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:05.218518 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65fa162-7efe-4d8a-8f04-aa0baade8d71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5073880326c41f7be9d275d96d89c97)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:05.219997 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a68e7f8-813f-442f-8a22-dfc3122c439f admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:05.221677 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65fa162-7efe-4d8a-8f04-aa0baade8d71 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:05.226935 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647e850e-b271-4213-a3da-6efc8153c4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:05.227881 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e850e-b271-4213-a3da-6efc8153c4b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:05.228170 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e850e-b271-4213-a3da-6efc8153c4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:05.228449 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e850e-b271-4213-a3da-6efc8153c4b9 admin admin] PATH_INFO: `/v3/users/4271cb360a3440c6a3afb4574bfb94d0` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:05.229766 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647e850e-b271-4213-a3da-6efc8153c4b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4271cb360a3440c6a3afb4574bfb94d0)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:05.231788 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647e850e-b271-4213-a3da-6efc8153c4b9 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:05.301473 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-647e850e-b271-4213-a3da-6efc8153c4b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4271cb360a3440c6a3afb4574bfb94d0'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:05.302214 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-647e850e-b271-4213-a3da-6efc8153c4b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4271cb360a3440c6a3afb4574bfb94d0'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:05.312309 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-647e850e-b271-4213-a3da-6efc8153c4b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4271cb360a3440c6a3afb4574bfb94d0'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:05.320885 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-e65fa162-7efe-4d8a-8f04-aa0baade8d71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5073880326c41f7be9d275d96d89c97'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:05.321879 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-e65fa162-7efe-4d8a-8f04-aa0baade8d71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5073880326c41f7be9d275d96d89c97'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:05.326372 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-647e850e-b271-4213-a3da-6efc8153c4b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4271cb360a3440c6a3afb4574bfb94d0'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:05.327103 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-647e850e-b271-4213-a3da-6efc8153c4b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4271cb360a3440c6a3afb4574bfb94d0'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:05.336851 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:05.356529 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1046/2127] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:36:05 2022] DELETE /identity/v3/users/4271cb360a3440c6a3afb4574bfb94d0 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:36:05.356529 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647e850e-b271-4213-a3da-6efc8153c4b9 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:05.356529 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-647e850e-b271-4213-a3da-6efc8153c4b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:05.366936 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-e65fa162-7efe-4d8a-8f04-aa0baade8d71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5073880326c41f7be9d275d96d89c97'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:05.399552 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-e65fa162-7efe-4d8a-8f04-aa0baade8d71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5073880326c41f7be9d275d96d89c97'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:05.427176 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:05.428669 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-e65fa162-7efe-4d8a-8f04-aa0baade8d71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5073880326c41f7be9d275d96d89c97'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:05.462233 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1082/2128] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:36:05 2022] DELETE /identity/v3/users/a5073880326c41f7be9d275d96d89c97 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:36:05.467735 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f022a-ae17-4988-861b-4a90e7859ae8 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:05.468731 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f022a-ae17-4988-861b-4a90e7859ae8 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:05.470685 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f022a-ae17-4988-861b-4a90e7859ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:05.493878 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647e850e-b271-4213-a3da-6efc8153c4b9 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:05.502851 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-3a5f022a-ae17-4988-861b-4a90e7859ae8 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:36:05.504251 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-3a5f022a-ae17-4988-861b-4a90e7859ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:05.594121 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a70268-51bf-4779-bd20-0ec35199aa85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:05.595717 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a70268-51bf-4779-bd20-0ec35199aa85 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:05.596103 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a70268-51bf-4779-bd20-0ec35199aa85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:05.596385 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a70268-51bf-4779-bd20-0ec35199aa85 admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:05.597466 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a70268-51bf-4779-bd20-0ec35199aa85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:05.602654 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a70268-51bf-4779-bd20-0ec35199aa85 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:05.646169 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1083/2129] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:36:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:36:05.647352 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f022a-ae17-4988-861b-4a90e7859ae8 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:05.649148 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-3a5f022a-ae17-4988-861b-4a90e7859ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:05.664060 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f022a-ae17-4988-861b-4a90e7859ae8 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:05.670447 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea064cc-87f5-4c07-9b7b-180b8eb0e0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:05.671329 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea064cc-87f5-4c07-9b7b-180b8eb0e0ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:05.671779 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea064cc-87f5-4c07-9b7b-180b8eb0e0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:05.672065 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea064cc-87f5-4c07-9b7b-180b8eb0e0ce admin admin] PATH_INFO: `/v3/projects/6f3cb40f027047f99d4910707c03f058` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:05.673346 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea064cc-87f5-4c07-9b7b-180b8eb0e0ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f3cb40f027047f99d4910707c03f058)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:05.675380 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea064cc-87f5-4c07-9b7b-180b8eb0e0ce admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:05.688898 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1047/2130] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:36:05 2022] POST /identity/v3/projects => generated 383 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:36:05.688898 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a70268-51bf-4779-bd20-0ec35199aa85 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:05.689385 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-a4a70268-51bf-4779-bd20-0ec35199aa85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:05.751377 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-6ea064cc-87f5-4c07-9b7b-180b8eb0e0ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f3cb40f027047f99d4910707c03f058', 'request_id': 'req-6ea064cc-87f5-4c07-9b7b-180b8eb0e0ce'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:05.755428 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a70268-51bf-4779-bd20-0ec35199aa85 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:05.757968 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-6ea064cc-87f5-4c07-9b7b-180b8eb0e0ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f3cb40f027047f99d4910707c03f058', 'request_id': 'req-6ea064cc-87f5-4c07-9b7b-180b8eb0e0ce'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:05.764766 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-6ea064cc-87f5-4c07-9b7b-180b8eb0e0ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f3cb40f027047f99d4910707c03f058', 'request_id': 'req-6ea064cc-87f5-4c07-9b7b-180b8eb0e0ce'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:05.788142 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-6ea064cc-87f5-4c07-9b7b-180b8eb0e0ce admin admin] The token cache is being invalidate because project 6f3cb40f027047f99d4910707c03f058 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:36:05.788558 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-6ea064cc-87f5-4c07-9b7b-180b8eb0e0ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:05.789411 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-6ea064cc-87f5-4c07-9b7b-180b8eb0e0ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:05.796485 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1084/2131] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:36:05 2022] DELETE /identity/v3/projects/6f3cb40f027047f99d4910707c03f058 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:36:05.797576 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea064cc-87f5-4c07-9b7b-180b8eb0e0ce admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:05.799480 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-6ea064cc-87f5-4c07-9b7b-180b8eb0e0ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:05.820340 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65581775-40d7-453a-aae2-98865a2cb1a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:05.821517 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65581775-40d7-453a-aae2-98865a2cb1a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:05.821890 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65581775-40d7-453a-aae2-98865a2cb1a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:05.822243 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65581775-40d7-453a-aae2-98865a2cb1a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:05.824376 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-65581775-40d7-453a-aae2-98865a2cb1a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:05.882793 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:05.943762 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65581775-40d7-453a-aae2-98865a2cb1a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:05.944985 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:05.947102 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65581775-40d7-453a-aae2-98865a2cb1a4 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:05.951252 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea064cc-87f5-4c07-9b7b-180b8eb0e0ce admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:05.965612 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1048/2132] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:36:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:36:05.966495 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65581775-40d7-453a-aae2-98865a2cb1a4 service neutron] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:05.967864 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-65581775-40d7-453a-aae2-98865a2cb1a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:05.970401 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3ff59a-d72f-4eca-9f9c-03706906cb61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:05.971712 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ff59a-d72f-4eca-9f9c-03706906cb61 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:05.973157 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ff59a-d72f-4eca-9f9c-03706906cb61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:05.983663 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65581775-40d7-453a-aae2-98865a2cb1a4 service neutron] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:05.989303 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8847d6a-ffdc-44d0-837e-299a6403c4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:05.990386 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8847d6a-ffdc-44d0-837e-299a6403c4ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:05.990681 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8847d6a-ffdc-44d0-837e-299a6403c4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:05.990963 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8847d6a-ffdc-44d0-837e-299a6403c4ab admin admin] PATH_INFO: `/v3/users/db969e10c05c4f72b7291fbff887cf57` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:05.992223 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8847d6a-ffdc-44d0-837e-299a6403c4ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=db969e10c05c4f72b7291fbff887cf57)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:05.994629 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8847d6a-ffdc-44d0-837e-299a6403c4ab admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:05.996262 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ff59a-d72f-4eca-9f9c-03706906cb61 admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:05.998103 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3ff59a-d72f-4eca-9f9c-03706906cb61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:06.001504 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3ff59a-d72f-4eca-9f9c-03706906cb61 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:06.045390 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1085/2133] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:36:05 2022] POST /identity/v3/users => generated 292 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:36:06.049996 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3ff59a-d72f-4eca-9f9c-03706906cb61 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:06.054020 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-2f3ff59a-d72f-4eca-9f9c-03706906cb61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:06.074410 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3ff59a-d72f-4eca-9f9c-03706906cb61 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:06.088567 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fff4712-cd39-45c5-a2b6-17627d62c70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:06.093391 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff4712-cd39-45c5-a2b6-17627d62c70b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:06.093926 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff4712-cd39-45c5-a2b6-17627d62c70b admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:06.103104 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff4712-cd39-45c5-a2b6-17627d62c70b admin admin] PATH_INFO: `/v3/projects/874d9331a7a94225847ff70935e8a98b` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:06.109163 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fff4712-cd39-45c5-a2b6-17627d62c70b admin admin] RBAC: Authorizing `identity:delete_project(project_id=874d9331a7a94225847ff70935e8a98b)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:06.113596 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fff4712-cd39-45c5-a2b6-17627d62c70b admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:06.130737 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-e8847d6a-ffdc-44d0-837e-299a6403c4ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db969e10c05c4f72b7291fbff887cf57'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:06.132577 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-e8847d6a-ffdc-44d0-837e-299a6403c4ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db969e10c05c4f72b7291fbff887cf57'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:06.159224 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-e8847d6a-ffdc-44d0-837e-299a6403c4ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db969e10c05c4f72b7291fbff887cf57'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:06.176501 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-e8847d6a-ffdc-44d0-837e-299a6403c4ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db969e10c05c4f72b7291fbff887cf57'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:06.177190 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-e8847d6a-ffdc-44d0-837e-299a6403c4ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db969e10c05c4f72b7291fbff887cf57'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:06.203192 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1049/2134] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:36:05 2022] DELETE /identity/v3/users/db969e10c05c4f72b7291fbff887cf57 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:36:06.204047 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8847d6a-ffdc-44d0-837e-299a6403c4ab admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:06.205928 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-e8847d6a-ffdc-44d0-837e-299a6403c4ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:06.293464 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-0fff4712-cd39-45c5-a2b6-17627d62c70b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '874d9331a7a94225847ff70935e8a98b', 'request_id': 'req-0fff4712-cd39-45c5-a2b6-17627d62c70b'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:06.308667 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-0fff4712-cd39-45c5-a2b6-17627d62c70b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '874d9331a7a94225847ff70935e8a98b', 'request_id': 'req-0fff4712-cd39-45c5-a2b6-17627d62c70b'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:06.327253 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-0fff4712-cd39-45c5-a2b6-17627d62c70b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '874d9331a7a94225847ff70935e8a98b', 'request_id': 'req-0fff4712-cd39-45c5-a2b6-17627d62c70b'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:06.358788 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-0fff4712-cd39-45c5-a2b6-17627d62c70b admin admin] The token cache is being invalidate because project 874d9331a7a94225847ff70935e8a98b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:36:06.359091 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-0fff4712-cd39-45c5-a2b6-17627d62c70b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:06.360554 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-0fff4712-cd39-45c5-a2b6-17627d62c70b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:06.363829 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1086/2135] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:36:06 2022] DELETE /identity/v3/projects/874d9331a7a94225847ff70935e8a98b => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:36:06.370389 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fff4712-cd39-45c5-a2b6-17627d62c70b admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:06.374920 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-0fff4712-cd39-45c5-a2b6-17627d62c70b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:06.380401 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8847d6a-ffdc-44d0-837e-299a6403c4ab admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:06.520136 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:06.552577 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f3e0e-f22c-4ea5-8f96-708d97a06f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:06.553511 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f3e0e-f22c-4ea5-8f96-708d97a06f80 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:06.553801 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f3e0e-f22c-4ea5-8f96-708d97a06f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:06.554079 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f3e0e-f22c-4ea5-8f96-708d97a06f80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:06.557590 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504f3e0e-f22c-4ea5-8f96-708d97a06f80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:06.561265 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504f3e0e-f22c-4ea5-8f96-708d97a06f80 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:06.568949 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fff4712-cd39-45c5-a2b6-17627d62c70b admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:06.584833 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1050/2136] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:36:06 2022] GET /identity/v3/roles => generated 1420 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:36:06.589953 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721b59b5-291c-4494-9cd4-9d9dcc543485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:06.592056 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b59b5-291c-4494-9cd4-9d9dcc543485 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:06.592343 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b59b5-291c-4494-9cd4-9d9dcc543485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:06.592559 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a1dd0-02cd-4275-9a34-9cf8961a2f3b None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:06.592862 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a1dd0-02cd-4275-9a34-9cf8961a2f3b None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:06.593150 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a1dd0-02cd-4275-9a34-9cf8961a2f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:06.597818 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b59b5-291c-4494-9cd4-9d9dcc543485 admin admin] PATH_INFO: `/v3/users/cc6f1ab66fea41dc9c9f92c827b0cb75` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:06.599348 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721b59b5-291c-4494-9cd4-9d9dcc543485 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc6f1ab66fea41dc9c9f92c827b0cb75)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:06.601786 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721b59b5-291c-4494-9cd4-9d9dcc543485 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:06.636028 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-726a1dd0-02cd-4275-9a34-9cf8961a2f3b None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:36:06.637674 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-726a1dd0-02cd-4275-9a34-9cf8961a2f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:06.660968 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1051/2137] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:36:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:36:06.662002 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a1dd0-02cd-4275-9a34-9cf8961a2f3b None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:06.672309 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-726a1dd0-02cd-4275-9a34-9cf8961a2f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:06.688025 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-721b59b5-291c-4494-9cd4-9d9dcc543485 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc6f1ab66fea41dc9c9f92c827b0cb75'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:06.688712 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-721b59b5-291c-4494-9cd4-9d9dcc543485 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc6f1ab66fea41dc9c9f92c827b0cb75'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:06.702470 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a1dd0-02cd-4275-9a34-9cf8961a2f3b None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:06.705665 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-721b59b5-291c-4494-9cd4-9d9dcc543485 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc6f1ab66fea41dc9c9f92c827b0cb75'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:06.711443 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=80,keystone:INSERT=4,keystone:DELETE=16 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:06.714424 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc70dd66-c2ac-4924-b710-e4f1abda36db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:06.715114 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc70dd66-c2ac-4924-b710-e4f1abda36db admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:06.715397 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc70dd66-c2ac-4924-b710-e4f1abda36db admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:06.716309 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc70dd66-c2ac-4924-b710-e4f1abda36db admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:06.717054 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc70dd66-c2ac-4924-b710-e4f1abda36db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:06.719113 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc70dd66-c2ac-4924-b710-e4f1abda36db admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:06.720184 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-721b59b5-291c-4494-9cd4-9d9dcc543485 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc6f1ab66fea41dc9c9f92c827b0cb75'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:06.737562 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1052/2138] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:36:06 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:36:06.739006 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55986717-0870-434d-be10-b9a24c828338 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:06.739423 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55986717-0870-434d-be10-b9a24c828338 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:06.739711 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55986717-0870-434d-be10-b9a24c828338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:06.746186 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-721b59b5-291c-4494-9cd4-9d9dcc543485 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc6f1ab66fea41dc9c9f92c827b0cb75'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:06.753319 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1087/2139] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:36:06 2022] DELETE /identity/v3/users/cc6f1ab66fea41dc9c9f92c827b0cb75 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:36:06.753984 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721b59b5-291c-4494-9cd4-9d9dcc543485 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:06.755403 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-721b59b5-291c-4494-9cd4-9d9dcc543485 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:06.798072 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-55986717-0870-434d-be10-b9a24c828338 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:36:06.799329 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-55986717-0870-434d-be10-b9a24c828338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:06.969352 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721b59b5-291c-4494-9cd4-9d9dcc543485 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:06.988556 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bb5903-0d94-44dc-82a3-9b433b43361f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:06.993737 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bb5903-0d94-44dc-82a3-9b433b43361f admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:06.994104 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bb5903-0d94-44dc-82a3-9b433b43361f admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:06.994399 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bb5903-0d94-44dc-82a3-9b433b43361f admin admin] PATH_INFO: `/v3/projects/11c8653e50f64c36bef57daf1f0f84a4/users/9660d5d1b7894924a3e0e70a08a34775/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:07.022198 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1053/2140] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:36:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:36:07.023241 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb08929-af64-48fe-b672-0b1810e2cfc4 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:07.023527 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb08929-af64-48fe-b672-0b1810e2cfc4 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:07.023809 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb08929-af64-48fe-b672-0b1810e2cfc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:07.047714 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bb5903-0d94-44dc-82a3-9b433b43361f admin admin] RBAC: Authorizing `identity:create_grant(project_id=11c8653e50f64c36bef57daf1f0f84a4, user_id=9660d5d1b7894924a3e0e70a08a34775, role_id=4cbf6ec846eb4b7c8cc52e9bfd6f076f)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:07.050472 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bb5903-0d94-44dc-82a3-9b433b43361f admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:07.078469 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-0eb08929-af64-48fe-b672-0b1810e2cfc4 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:36:07.079689 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-0eb08929-af64-48fe-b672-0b1810e2cfc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:07.093549 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1088/2141] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:36:06 2022] PUT /identity/v3/projects/11c8653e50f64c36bef57daf1f0f84a4/users/9660d5d1b7894924a3e0e70a08a34775/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:36:07.096561 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bb5903-0d94-44dc-82a3-9b433b43361f admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:07.239166 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1054/2142] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:36:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:36:07.240516 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc215e-7c1f-48f7-bcd1-d905219ec1c9 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:07.240806 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc215e-7c1f-48f7-bcd1-d905219ec1c9 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:07.241084 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc215e-7c1f-48f7-bcd1-d905219ec1c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:07.282245 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-c1bc215e-7c1f-48f7-bcd1-d905219ec1c9 None None] MFA Rules not processed for user `9660d5d1b7894924a3e0e70a08a34775`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:36:07.283748 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-c1bc215e-7c1f-48f7-bcd1-d905219ec1c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:07.286391 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bb5903-0d94-44dc-82a3-9b433b43361f admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:07.299054 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede8cafc-a386-4832-b124-848eda8c8a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:07.300805 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede8cafc-a386-4832-b124-848eda8c8a6e admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:07.301135 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede8cafc-a386-4832-b124-848eda8c8a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:07.302882 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede8cafc-a386-4832-b124-848eda8c8a6e admin admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:07.304663 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede8cafc-a386-4832-b124-848eda8c8a6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:36:07.306137 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede8cafc-a386-4832-b124-848eda8c8a6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:07.308615 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede8cafc-a386-4832-b124-848eda8c8a6e admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:07.340510 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1089/2143] 10.222.0.26 () {58 vars in 1152 bytes} [Fri Jul 1 19:36:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:36:07.341910 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede8cafc-a386-4832-b124-848eda8c8a6e admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:07.345338 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-ede8cafc-a386-4832-b124-848eda8c8a6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:07.382317 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede8cafc-a386-4832-b124-848eda8c8a6e admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:07.388641 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:07.390108 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff03276-5539-430f-bf3c-bdb9ce014fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:07.391191 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff03276-5539-430f-bf3c-bdb9ce014fbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:07.391660 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff03276-5539-430f-bf3c-bdb9ce014fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:07.392115 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff03276-5539-430f-bf3c-bdb9ce014fbd admin admin] PATH_INFO: `/v3/projects/9ee850090ce249ee8c1b940588559917` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:07.393686 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff03276-5539-430f-bf3c-bdb9ce014fbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ee850090ce249ee8c1b940588559917)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:07.395624 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff03276-5539-430f-bf3c-bdb9ce014fbd admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:07.395762 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1055/2144] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:36:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:36:07.396730 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bc215e-7c1f-48f7-bcd1-d905219ec1c9 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:07.399353 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-c1bc215e-7c1f-48f7-bcd1-d905219ec1c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:07.415221 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bc215e-7c1f-48f7-bcd1-d905219ec1c9 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:07.422411 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b9d2e-89df-409b-a093-7ccd590432d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:07.423380 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b9d2e-89df-409b-a093-7ccd590432d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:07.423664 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b9d2e-89df-409b-a093-7ccd590432d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:07.423937 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b9d2e-89df-409b-a093-7ccd590432d7 admin admin] PATH_INFO: `/v3/projects/aa22c173e795464aa58dda7e04647626` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:07.425283 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02b9d2e-89df-409b-a093-7ccd590432d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa22c173e795464aa58dda7e04647626)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:07.427257 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02b9d2e-89df-409b-a093-7ccd590432d7 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:07.459310 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-6ff03276-5539-430f-bf3c-bdb9ce014fbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ee850090ce249ee8c1b940588559917', 'request_id': 'req-6ff03276-5539-430f-bf3c-bdb9ce014fbd'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:07.470229 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-6ff03276-5539-430f-bf3c-bdb9ce014fbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ee850090ce249ee8c1b940588559917', 'request_id': 'req-6ff03276-5539-430f-bf3c-bdb9ce014fbd'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:07.476347 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:07.479309 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-6ff03276-5539-430f-bf3c-bdb9ce014fbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ee850090ce249ee8c1b940588559917', 'request_id': 'req-6ff03276-5539-430f-bf3c-bdb9ce014fbd'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:07.506729 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f02b9d2e-89df-409b-a093-7ccd590432d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa22c173e795464aa58dda7e04647626', 'request_id': 'req-f02b9d2e-89df-409b-a093-7ccd590432d7'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:07.509132 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-6ff03276-5539-430f-bf3c-bdb9ce014fbd admin admin] The token cache is being invalidate because project 9ee850090ce249ee8c1b940588559917 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:36:07.510018 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-6ff03276-5539-430f-bf3c-bdb9ce014fbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:07.510916 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-6ff03276-5539-430f-bf3c-bdb9ce014fbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:07.513668 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f02b9d2e-89df-409b-a093-7ccd590432d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa22c173e795464aa58dda7e04647626', 'request_id': 'req-f02b9d2e-89df-409b-a093-7ccd590432d7'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:07.514484 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1090/2145] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:36:07 2022] DELETE /identity/v3/projects/9ee850090ce249ee8c1b940588559917 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:36:07.516730 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff03276-5539-430f-bf3c-bdb9ce014fbd admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:07.518466 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-6ff03276-5539-430f-bf3c-bdb9ce014fbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:07.521394 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f02b9d2e-89df-409b-a093-7ccd590432d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa22c173e795464aa58dda7e04647626', 'request_id': 'req-f02b9d2e-89df-409b-a093-7ccd590432d7'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:07.545278 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f02b9d2e-89df-409b-a093-7ccd590432d7 admin admin] The token cache is being invalidate because project aa22c173e795464aa58dda7e04647626 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:36:07.545557 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f02b9d2e-89df-409b-a093-7ccd590432d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:07.548254 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f02b9d2e-89df-409b-a093-7ccd590432d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:07.556295 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1056/2146] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:36:07 2022] DELETE /identity/v3/projects/aa22c173e795464aa58dda7e04647626 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:36:07.557549 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b9d2e-89df-409b-a093-7ccd590432d7 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:07.558995 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-f02b9d2e-89df-409b-a093-7ccd590432d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:07.612055 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff03276-5539-430f-bf3c-bdb9ce014fbd admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:07.672665 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b9d2e-89df-409b-a093-7ccd590432d7 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:07.679431 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d491ed49-0acf-4f6b-bfaa-c3a41ef24aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:07.680496 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491ed49-0acf-4f6b-bfaa-c3a41ef24aae admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:07.680496 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491ed49-0acf-4f6b-bfaa-c3a41ef24aae admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:07.680697 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491ed49-0acf-4f6b-bfaa-c3a41ef24aae admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:07.681521 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d491ed49-0acf-4f6b-bfaa-c3a41ef24aae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:07.684335 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d491ed49-0acf-4f6b-bfaa-c3a41ef24aae admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:07.701742 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d879a237-2123-40a9-a37b-f9ff67b3282c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:07.702407 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879a237-2123-40a9-a37b-f9ff67b3282c service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:07.702689 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879a237-2123-40a9-a37b-f9ff67b3282c service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:07.702968 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879a237-2123-40a9-a37b-f9ff67b3282c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:07.704863 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-d879a237-2123-40a9-a37b-f9ff67b3282c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:07.722979 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d879a237-2123-40a9-a37b-f9ff67b3282c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:07.724575 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d879a237-2123-40a9-a37b-f9ff67b3282c service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:07.737039 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1091/2147] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:36:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:36:07.738077 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d879a237-2123-40a9-a37b-f9ff67b3282c service neutron] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:07.739630 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-d879a237-2123-40a9-a37b-f9ff67b3282c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:07.748745 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1057/2148] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:36:07 2022] POST /identity/v3/projects => generated 369 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:36:07.750143 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d491ed49-0acf-4f6b-bfaa-c3a41ef24aae admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:07.755921 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-d491ed49-0acf-4f6b-bfaa-c3a41ef24aae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:07.758799 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d879a237-2123-40a9-a37b-f9ff67b3282c service neutron] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:07.871100 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2613b6a-0dd8-4677-b1d7-a167d9616dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:07.884292 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2613b6a-0dd8-4677-b1d7-a167d9616dfb admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:07.884796 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2613b6a-0dd8-4677-b1d7-a167d9616dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:07.885861 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2613b6a-0dd8-4677-b1d7-a167d9616dfb admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:07.886712 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2613b6a-0dd8-4677-b1d7-a167d9616dfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:07.892142 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d491ed49-0acf-4f6b-bfaa-c3a41ef24aae admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:07.892684 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2613b6a-0dd8-4677-b1d7-a167d9616dfb admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:07.911690 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5c60b8-f6ea-4841-89e7-e10e2efb6283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:07.915091 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c60b8-f6ea-4841-89e7-e10e2efb6283 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:07.915437 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c60b8-f6ea-4841-89e7-e10e2efb6283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:07.915720 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c60b8-f6ea-4841-89e7-e10e2efb6283 admin admin] PATH_INFO: `/v3/users/6089bd67fda24d9487ace491f026cdd2` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:07.917669 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5c60b8-f6ea-4841-89e7-e10e2efb6283 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6089bd67fda24d9487ace491f026cdd2)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:07.919797 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5c60b8-f6ea-4841-89e7-e10e2efb6283 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:07.933755 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:07.974237 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1092/2149] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:36:07 2022] POST /identity/v3/projects => generated 385 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:36:07.974237 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d55c9-1b99-4c32-9922-c50cc79ee7d7 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:07.974840 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d55c9-1b99-4c32-9922-c50cc79ee7d7 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:07.975654 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d55c9-1b99-4c32-9922-c50cc79ee7d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:08.010911 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-c67d55c9-1b99-4c32-9922-c50cc79ee7d7 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:36:08.012855 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-c67d55c9-1b99-4c32-9922-c50cc79ee7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:08.050888 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-8d5c60b8-f6ea-4841-89e7-e10e2efb6283 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6089bd67fda24d9487ace491f026cdd2'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:08.052534 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-8d5c60b8-f6ea-4841-89e7-e10e2efb6283 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6089bd67fda24d9487ace491f026cdd2'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:08.057056 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:08.076569 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-8d5c60b8-f6ea-4841-89e7-e10e2efb6283 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6089bd67fda24d9487ace491f026cdd2'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:08.102386 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-8d5c60b8-f6ea-4841-89e7-e10e2efb6283 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6089bd67fda24d9487ace491f026cdd2'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:08.103424 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-8d5c60b8-f6ea-4841-89e7-e10e2efb6283 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6089bd67fda24d9487ace491f026cdd2'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:08.114260 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1093/2150] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:36:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:36:08.115331 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67d55c9-1b99-4c32-9922-c50cc79ee7d7 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:08.116690 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-c67d55c9-1b99-4c32-9922-c50cc79ee7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:08.134261 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67d55c9-1b99-4c32-9922-c50cc79ee7d7 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:08.141539 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c15b1b3-34d1-4884-85df-ac522c724837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:08.141960 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15b1b3-34d1-4884-85df-ac522c724837 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:08.142429 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15b1b3-34d1-4884-85df-ac522c724837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:08.142718 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15b1b3-34d1-4884-85df-ac522c724837 admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:08.143552 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c15b1b3-34d1-4884-85df-ac522c724837 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:08.145768 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c15b1b3-34d1-4884-85df-ac522c724837 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:08.178903 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1094/2151] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:36:08 2022] POST /identity/v3/users => generated 285 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:36:08.179953 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c15b1b3-34d1-4884-85df-ac522c724837 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:08.182523 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1058/2152] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:36:07 2022] DELETE /identity/v3/users/6089bd67fda24d9487ace491f026cdd2 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:36:08.188710 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc67fba-e7ce-41b5-b603-12a8160e2ed5 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:08.190816 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc67fba-e7ce-41b5-b603-12a8160e2ed5 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:08.191365 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc67fba-e7ce-41b5-b603-12a8160e2ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:08.195176 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-7c15b1b3-34d1-4884-85df-ac522c724837 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:08.226566 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c15b1b3-34d1-4884-85df-ac522c724837 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:08.244345 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-adc67fba-e7ce-41b5-b603-12a8160e2ed5 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:36:08.249021 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-adc67fba-e7ce-41b5-b603-12a8160e2ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:08.391765 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63ba4e7-2d21-4d06-a949-fe8f6b71dfd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:08.394323 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ba4e7-2d21-4d06-a949-fe8f6b71dfd2 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:08.395721 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ba4e7-2d21-4d06-a949-fe8f6b71dfd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:08.395868 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ba4e7-2d21-4d06-a949-fe8f6b71dfd2 admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:08.398987 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63ba4e7-2d21-4d06-a949-fe8f6b71dfd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:08.405938 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63ba4e7-2d21-4d06-a949-fe8f6b71dfd2 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:08.429888 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1059/2153] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:36:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:36:08.430902 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc67fba-e7ce-41b5-b603-12a8160e2ed5 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:08.455785 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc67fba-e7ce-41b5-b603-12a8160e2ed5 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:08.463359 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1095/2154] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:36:08 2022] POST /identity/v3/users => generated 299 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:36:08.463550 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cbe438-bba0-4ec6-9f9a-f894109f9def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:08.463963 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cbe438-bba0-4ec6-9f9a-f894109f9def admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:08.464066 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63ba4e7-2d21-4d06-a949-fe8f6b71dfd2 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:08.464154 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cbe438-bba0-4ec6-9f9a-f894109f9def admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:08.464582 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cbe438-bba0-4ec6-9f9a-f894109f9def admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:08.465377 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cbe438-bba0-4ec6-9f9a-f894109f9def admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:08.472424 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cbe438-bba0-4ec6-9f9a-f894109f9def admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:08.488247 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63ba4e7-2d21-4d06-a949-fe8f6b71dfd2 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:08.495315 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f187374d-aed6-499a-b2f6-53b0b8313c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:08.496092 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187374d-aed6-499a-b2f6-53b0b8313c9f admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:08.496511 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187374d-aed6-499a-b2f6-53b0b8313c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:08.497264 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187374d-aed6-499a-b2f6-53b0b8313c9f admin admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:08.497933 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f187374d-aed6-499a-b2f6-53b0b8313c9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:36:08.498329 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f187374d-aed6-499a-b2f6-53b0b8313c9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:08.500109 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f187374d-aed6-499a-b2f6-53b0b8313c9f admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:08.503380 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1060/2155] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:36:08 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:36:08.512222 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cbe438-bba0-4ec6-9f9a-f894109f9def admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:08.521142 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1096/2156] 10.222.0.26 () {58 vars in 1152 bytes} [Fri Jul 1 19:36:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:36:08.521142 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f187374d-aed6-499a-b2f6-53b0b8313c9f admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:08.536153 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f187374d-aed6-499a-b2f6-53b0b8313c9f admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:08.539630 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cbe438-bba0-4ec6-9f9a-f894109f9def admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:08.543288 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7a1c27-fa81-4de2-b457-eddc69ca0cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:08.544649 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a1c27-fa81-4de2-b457-eddc69ca0cf0 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:08.544959 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a1c27-fa81-4de2-b457-eddc69ca0cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:08.545334 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a1c27-fa81-4de2-b457-eddc69ca0cf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:08.546149 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7a1c27-fa81-4de2-b457-eddc69ca0cf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:08.547842 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7a1c27-fa81-4de2-b457-eddc69ca0cf0 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:08.557134 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d483f-b136-4a0c-9ba8-1d76c8d5da88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:08.557870 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d483f-b136-4a0c-9ba8-1d76c8d5da88 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:08.558164 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d483f-b136-4a0c-9ba8-1d76c8d5da88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:08.558448 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d483f-b136-4a0c-9ba8-1d76c8d5da88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:08.559254 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976d483f-b136-4a0c-9ba8-1d76c8d5da88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:08.561492 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976d483f-b136-4a0c-9ba8-1d76c8d5da88 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:08.567151 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1097/2157] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:36:08 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:36:08.573200 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7a1c27-fa81-4de2-b457-eddc69ca0cf0 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:08.586329 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1061/2158] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:36:08 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:36:08.587152 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d483f-b136-4a0c-9ba8-1d76c8d5da88 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:08.598595 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7a1c27-fa81-4de2-b457-eddc69ca0cf0 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:08.611047 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c0ca8-096e-446c-9dbf-ab0b6b1f98b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:08.611735 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c0ca8-096e-446c-9dbf-ab0b6b1f98b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:08.612022 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c0ca8-096e-446c-9dbf-ab0b6b1f98b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:08.612301 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c0ca8-096e-446c-9dbf-ab0b6b1f98b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:08.613006 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12c0ca8-096e-446c-9dbf-ab0b6b1f98b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:08.614964 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12c0ca8-096e-446c-9dbf-ab0b6b1f98b0 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:08.621692 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d483f-b136-4a0c-9ba8-1d76c8d5da88 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:08.646366 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5be1f1-7753-4cf5-ac1d-cfb5d7f93365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:08.647815 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5be1f1-7753-4cf5-ac1d-cfb5d7f93365 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:08.648294 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5be1f1-7753-4cf5-ac1d-cfb5d7f93365 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:08.648750 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5be1f1-7753-4cf5-ac1d-cfb5d7f93365 admin admin] PATH_INFO: `/v3/projects/1f5a2b291fc04343aebc2890ef9e9aba/users/fb13d797838a43c8aa782b63efae7a7d/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:08.683571 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1098/2159] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:36:08 2022] POST /identity/v3/projects => generated 389 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:36:08.686465 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c0ca8-096e-446c-9dbf-ab0b6b1f98b0 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:08.690006 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5be1f1-7753-4cf5-ac1d-cfb5d7f93365 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f5a2b291fc04343aebc2890ef9e9aba, user_id=fb13d797838a43c8aa782b63efae7a7d, role_id=4cbf6ec846eb4b7c8cc52e9bfd6f076f)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:08.692794 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5be1f1-7753-4cf5-ac1d-cfb5d7f93365 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:08.729337 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1062/2160] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:36:08 2022] PUT /identity/v3/projects/1f5a2b291fc04343aebc2890ef9e9aba/users/fb13d797838a43c8aa782b63efae7a7d/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:36:08.730314 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5be1f1-7753-4cf5-ac1d-cfb5d7f93365 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:08.855507 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:08.896607 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5be1f1-7753-4cf5-ac1d-cfb5d7f93365 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:08.907313 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199f5069-3ed6-41f3-afd5-a39a435d3985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:08.908124 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f5069-3ed6-41f3-afd5-a39a435d3985 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:08.908485 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f5069-3ed6-41f3-afd5-a39a435d3985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:08.908832 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f5069-3ed6-41f3-afd5-a39a435d3985 admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:08.909656 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199f5069-3ed6-41f3-afd5-a39a435d3985 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:08.911697 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199f5069-3ed6-41f3-afd5-a39a435d3985 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:08.919639 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c0ca8-096e-446c-9dbf-ab0b6b1f98b0 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:08.926476 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76de754-b350-4a18-9227-60f61ee4424b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:08.927790 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76de754-b350-4a18-9227-60f61ee4424b admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:08.928060 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76de754-b350-4a18-9227-60f61ee4424b admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:08.928333 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76de754-b350-4a18-9227-60f61ee4424b admin admin] PATH_INFO: `/v3/projects/90fb7629e8e748109e9bbbab91782933/users/512f478615bd43c1840ec7d6ef0b5b6f/roles/6cb03785fb184ef587509b3174622f69` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:08.931243 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:08.943433 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1063/2161] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:36:08 2022] POST /identity/v3/users => generated 295 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:36:08.945079 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c897e1-dde4-4f34-b351-29b0d8ace049 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:08.945786 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c897e1-dde4-4f34-b351-29b0d8ace049 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:08.946281 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c897e1-dde4-4f34-b351-29b0d8ace049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:08.960221 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76de754-b350-4a18-9227-60f61ee4424b admin admin] RBAC: Authorizing `identity:create_grant(project_id=90fb7629e8e748109e9bbbab91782933, user_id=512f478615bd43c1840ec7d6ef0b5b6f, role_id=6cb03785fb184ef587509b3174622f69)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:08.963322 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76de754-b350-4a18-9227-60f61ee4424b admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:08.990537 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1099/2162] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:36:08 2022] PUT /identity/v3/projects/90fb7629e8e748109e9bbbab91782933/users/512f478615bd43c1840ec7d6ef0b5b6f/roles/6cb03785fb184ef587509b3174622f69 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:36:08.991836 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76de754-b350-4a18-9227-60f61ee4424b admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:08.996518 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-36c897e1-dde4-4f34-b351-29b0d8ace049 None None] MFA Rules not processed for user `fb13d797838a43c8aa782b63efae7a7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:36:08.998640 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-36c897e1-dde4-4f34-b351-29b0d8ace049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:09.097613 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76de754-b350-4a18-9227-60f61ee4424b admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:09.107775 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c468fa13-5cba-42c8-a6a9-625e5af91d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:09.109308 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c468fa13-5cba-42c8-a6a9-625e5af91d0b admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:09.111453 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c468fa13-5cba-42c8-a6a9-625e5af91d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:09.111967 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c468fa13-5cba-42c8-a6a9-625e5af91d0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:09.114712 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c468fa13-5cba-42c8-a6a9-625e5af91d0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:09.117805 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c468fa13-5cba-42c8-a6a9-625e5af91d0b admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:09.135585 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1100/2163] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:36:08 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:36:09.137034 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c468fa13-5cba-42c8-a6a9-625e5af91d0b admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:09.153196 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c468fa13-5cba-42c8-a6a9-625e5af91d0b admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:09.160928 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1064/2164] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:36:08 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:36:09.162780 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c897e1-dde4-4f34-b351-29b0d8ace049 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:09.167444 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b24c503-6e0c-4ef6-a8e7-736e90158621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:09.168699 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b24c503-6e0c-4ef6-a8e7-736e90158621 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:09.169267 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b24c503-6e0c-4ef6-a8e7-736e90158621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:09.169658 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b24c503-6e0c-4ef6-a8e7-736e90158621 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:09.170558 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b24c503-6e0c-4ef6-a8e7-736e90158621 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:09.172382 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b24c503-6e0c-4ef6-a8e7-736e90158621 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:09.180426 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c897e1-dde4-4f34-b351-29b0d8ace049 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:09.194585 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1101/2165] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:36:09 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:36:09.195795 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b24c503-6e0c-4ef6-a8e7-736e90158621 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:09.196217 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17c3edf-357c-48d1-9aa5-ae82ab9ba80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:09.198301 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c3edf-357c-48d1-9aa5-ae82ab9ba80c admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:09.198773 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c3edf-357c-48d1-9aa5-ae82ab9ba80c admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:09.199647 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c3edf-357c-48d1-9aa5-ae82ab9ba80c admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:09.201214 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17c3edf-357c-48d1-9aa5-ae82ab9ba80c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:09.203439 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17c3edf-357c-48d1-9aa5-ae82ab9ba80c admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:09.213301 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-4b24c503-6e0c-4ef6-a8e7-736e90158621 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:09.219032 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1065/2166] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:36:09 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:36:09.219032 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17c3edf-357c-48d1-9aa5-ae82ab9ba80c admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:09.234752 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17c3edf-357c-48d1-9aa5-ae82ab9ba80c admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:09.241387 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f6220e-e374-4f28-b8c2-c852716d359a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:09.242962 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6220e-e374-4f28-b8c2-c852716d359a admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:09.243566 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6220e-e374-4f28-b8c2-c852716d359a admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:09.243669 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6220e-e374-4f28-b8c2-c852716d359a admin admin] PATH_INFO: `/v3/projects/90fb7629e8e748109e9bbbab91782933/users/512f478615bd43c1840ec7d6ef0b5b6f/roles/6cb03785fb184ef587509b3174622f69` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:09.246486 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f6220e-e374-4f28-b8c2-c852716d359a admin admin] RBAC: Authorizing `identity:create_grant(project_id=90fb7629e8e748109e9bbbab91782933, user_id=512f478615bd43c1840ec7d6ef0b5b6f, role_id=6cb03785fb184ef587509b3174622f69)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:09.255992 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f6220e-e374-4f28-b8c2-c852716d359a admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:09.277211 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1066/2167] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:36:09 2022] PUT /identity/v3/projects/90fb7629e8e748109e9bbbab91782933/users/512f478615bd43c1840ec7d6ef0b5b6f/roles/6cb03785fb184ef587509b3174622f69 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:36:09.279252 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f6220e-e374-4f28-b8c2-c852716d359a admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:09.333870 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b24c503-6e0c-4ef6-a8e7-736e90158621 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:09.389782 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f6220e-e374-4f28-b8c2-c852716d359a admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:09.396790 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771d1723-6306-461e-86e8-2623c73f4a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:09.397979 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d1723-6306-461e-86e8-2623c73f4a78 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:09.398398 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d1723-6306-461e-86e8-2623c73f4a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:09.398762 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d1723-6306-461e-86e8-2623c73f4a78 admin admin] PATH_INFO: `/v3/projects/c584039c24fb4c94b3d0f7a00a7a025c/users/31c9b3226d7f427a8d7d8f5f20639c4a/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:09.425281 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771d1723-6306-461e-86e8-2623c73f4a78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c584039c24fb4c94b3d0f7a00a7a025c, user_id=31c9b3226d7f427a8d7d8f5f20639c4a, role_id=4cbf6ec846eb4b7c8cc52e9bfd6f076f)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:09.428315 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771d1723-6306-461e-86e8-2623c73f4a78 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:09.442765 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a060a1-ea3a-4c62-b6ab-c6cee248eadb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bbcb2463f9c46ddaaa247e4876aca48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:09.443600 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a060a1-ea3a-4c62-b6ab-c6cee248eadb service glance] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:09.443974 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a060a1-ea3a-4c62-b6ab-c6cee248eadb service glance] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:09.444346 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a060a1-ea3a-4c62-b6ab-c6cee248eadb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:09.457534 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1067/2168] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:36:09 2022] PUT /identity/v3/projects/c584039c24fb4c94b3d0f7a00a7a025c/users/31c9b3226d7f427a8d7d8f5f20639c4a/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:36:09.458880 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d912f7b3-47b4-4f05-bf14-dae3f586dd55 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:09.459177 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d912f7b3-47b4-4f05-bf14-dae3f586dd55 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:09.459462 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d912f7b3-47b4-4f05-bf14-dae3f586dd55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:09.524137 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-d912f7b3-47b4-4f05-bf14-dae3f586dd55 None None] MFA Rules not processed for user `512f478615bd43c1840ec7d6ef0b5b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:36:09.525548 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-d912f7b3-47b4-4f05-bf14-dae3f586dd55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:09.532786 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:09.542529 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:09.595495 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a060a1-ea3a-4c62-b6ab-c6cee248eadb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:09.597489 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a060a1-ea3a-4c62-b6ab-c6cee248eadb service glance] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:09.616626 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1102/2169] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:36:09 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:36:09.619481 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a060a1-ea3a-4c62-b6ab-c6cee248eadb service glance] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:09.630265 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-69a060a1-ea3a-4c62-b6ab-c6cee248eadb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:09.667695 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a060a1-ea3a-4c62-b6ab-c6cee248eadb service glance] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:09.713965 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1068/2170] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:36:09 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:36:09.715572 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce6743-0172-4823-a852-ef553a9543c3 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:09.715869 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce6743-0172-4823-a852-ef553a9543c3 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:09.716154 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce6743-0172-4823-a852-ef553a9543c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:09.791559 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-f0ce6743-0172-4823-a852-ef553a9543c3 None None] MFA Rules not processed for user `31c9b3226d7f427a8d7d8f5f20639c4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:36:09.792594 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1fe71c-f6d4-42e1-9a26-e4554e3b21da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:09.792922 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-f0ce6743-0172-4823-a852-ef553a9543c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:09.798073 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1fe71c-f6d4-42e1-9a26-e4554e3b21da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:09.799589 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1fe71c-f6d4-42e1-9a26-e4554e3b21da admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:09.800369 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1fe71c-f6d4-42e1-9a26-e4554e3b21da admin admin] PATH_INFO: `/v3/projects/75e92d9300d74e61a63b76247c623781` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:09.803167 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1fe71c-f6d4-42e1-9a26-e4554e3b21da admin admin] RBAC: Authorizing `identity:delete_project(project_id=75e92d9300d74e61a63b76247c623781)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:09.807093 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1fe71c-f6d4-42e1-9a26-e4554e3b21da admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:09.927143 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-7f1fe71c-f6d4-42e1-9a26-e4554e3b21da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75e92d9300d74e61a63b76247c623781', 'request_id': 'req-7f1fe71c-f6d4-42e1-9a26-e4554e3b21da'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:09.939721 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1069/2171] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:36:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:36:09.940673 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ce6743-0172-4823-a852-ef553a9543c3 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:09.942154 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-f0ce6743-0172-4823-a852-ef553a9543c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:09.970382 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ce6743-0172-4823-a852-ef553a9543c3 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:09.983769 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-7f1fe71c-f6d4-42e1-9a26-e4554e3b21da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75e92d9300d74e61a63b76247c623781', 'request_id': 'req-7f1fe71c-f6d4-42e1-9a26-e4554e3b21da'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:10.002416 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-7f1fe71c-f6d4-42e1-9a26-e4554e3b21da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75e92d9300d74e61a63b76247c623781', 'request_id': 'req-7f1fe71c-f6d4-42e1-9a26-e4554e3b21da'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:10.027846 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-7f1fe71c-f6d4-42e1-9a26-e4554e3b21da admin admin] The token cache is being invalidate because project 75e92d9300d74e61a63b76247c623781 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:36:10.028147 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-7f1fe71c-f6d4-42e1-9a26-e4554e3b21da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:10.029189 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-7f1fe71c-f6d4-42e1-9a26-e4554e3b21da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:10.031974 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1103/2172] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:36:09 2022] DELETE /identity/v3/projects/75e92d9300d74e61a63b76247c623781 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:36:10.033720 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1fe71c-f6d4-42e1-9a26-e4554e3b21da admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:10.035516 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-7f1fe71c-f6d4-42e1-9a26-e4554e3b21da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:10.144759 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1e7ffc-1ffc-4175-a82b-0fd15860e355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:10.148020 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e7ffc-1ffc-4175-a82b-0fd15860e355 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:10.148481 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e7ffc-1ffc-4175-a82b-0fd15860e355 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:10.149217 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e7ffc-1ffc-4175-a82b-0fd15860e355 admin admin] PATH_INFO: `/v3/projects/dde7e1da41864dd2bb7c23377c6144d5` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:10.152240 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1e7ffc-1ffc-4175-a82b-0fd15860e355 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dde7e1da41864dd2bb7c23377c6144d5)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:10.154474 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1e7ffc-1ffc-4175-a82b-0fd15860e355 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:10.184380 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1fe71c-f6d4-42e1-9a26-e4554e3b21da admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:10.194078 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269a8ea9-e6cd-479f-99d8-023a512f0af0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a3ed285ee4c4d04abf7daf0aeb9fb7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:10.198392 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a8ea9-e6cd-479f-99d8-023a512f0af0 service cinder] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:10.201031 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a8ea9-e6cd-479f-99d8-023a512f0af0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:10.201541 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a8ea9-e6cd-479f-99d8-023a512f0af0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:10.211318 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-269a8ea9-e6cd-479f-99d8-023a512f0af0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:10.248015 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:10.285403 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-6d1e7ffc-1ffc-4175-a82b-0fd15860e355 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dde7e1da41864dd2bb7c23377c6144d5', 'request_id': 'req-6d1e7ffc-1ffc-4175-a82b-0fd15860e355'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:10.294522 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:10.302593 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-6d1e7ffc-1ffc-4175-a82b-0fd15860e355 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dde7e1da41864dd2bb7c23377c6144d5', 'request_id': 'req-6d1e7ffc-1ffc-4175-a82b-0fd15860e355'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:10.317156 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-6d1e7ffc-1ffc-4175-a82b-0fd15860e355 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dde7e1da41864dd2bb7c23377c6144d5', 'request_id': 'req-6d1e7ffc-1ffc-4175-a82b-0fd15860e355'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:10.351367 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-6d1e7ffc-1ffc-4175-a82b-0fd15860e355 admin admin] The token cache is being invalidate because project dde7e1da41864dd2bb7c23377c6144d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:36:10.352585 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-6d1e7ffc-1ffc-4175-a82b-0fd15860e355 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:10.352997 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-6d1e7ffc-1ffc-4175-a82b-0fd15860e355 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:10.359459 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1070/2173] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:36:09 2022] DELETE /identity/v3/projects/dde7e1da41864dd2bb7c23377c6144d5 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:36:10.364778 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1e7ffc-1ffc-4175-a82b-0fd15860e355 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:10.366871 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-6d1e7ffc-1ffc-4175-a82b-0fd15860e355 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:10.403617 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269a8ea9-e6cd-479f-99d8-023a512f0af0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:10.406910 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269a8ea9-e6cd-479f-99d8-023a512f0af0 service cinder] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:10.440659 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1104/2174] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:36:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:36:10.442420 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69131d7f-5d12-4340-897d-71d7c8356efc None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:10.442721 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69131d7f-5d12-4340-897d-71d7c8356efc None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:10.443005 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69131d7f-5d12-4340-897d-71d7c8356efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:10.489607 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-69131d7f-5d12-4340-897d-71d7c8356efc None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:36:10.492408 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-69131d7f-5d12-4340-897d-71d7c8356efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:10.544938 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1e7ffc-1ffc-4175-a82b-0fd15860e355 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:10.562382 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce546a94-42b5-4428-9257-4de9f129511d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:10.564291 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce546a94-42b5-4428-9257-4de9f129511d admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:10.564596 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce546a94-42b5-4428-9257-4de9f129511d admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:10.567197 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce546a94-42b5-4428-9257-4de9f129511d admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:10.567990 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce546a94-42b5-4428-9257-4de9f129511d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:10.574690 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce546a94-42b5-4428-9257-4de9f129511d admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:10.667035 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1105/2175] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:36:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:36:10.669183 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e8166c-21c4-4175-89e0-9e9ed4acb98d None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:10.671776 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e8166c-21c4-4175-89e0-9e9ed4acb98d None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:10.673620 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e8166c-21c4-4175-89e0-9e9ed4acb98d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:10.681329 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1071/2176] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:36:10 2022] POST /identity/v3/projects => generated 389 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:36:10.682957 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d877bbd-7e69-435e-830a-c66e8b60364f None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:10.683332 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d877bbd-7e69-435e-830a-c66e8b60364f None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:10.683646 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d877bbd-7e69-435e-830a-c66e8b60364f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:10.730721 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-59e8166c-21c4-4175-89e0-9e9ed4acb98d None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:36:10.732466 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-59e8166c-21c4-4175-89e0-9e9ed4acb98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:10.741585 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-0d877bbd-7e69-435e-830a-c66e8b60364f None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:36:10.744252 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-0d877bbd-7e69-435e-830a-c66e8b60364f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:10.909308 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1106/2177] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:36:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:36:10.909308 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e8166c-21c4-4175-89e0-9e9ed4acb98d None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:10.909635 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1072/2178] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:36:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:36:10.911390 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d877bbd-7e69-435e-830a-c66e8b60364f None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:10.923356 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e8166c-21c4-4175-89e0-9e9ed4acb98d None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:10.937032 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faa0951-f62e-461e-bc09-913180e4350a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:10.938197 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa0951-f62e-461e-bc09-913180e4350a admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:10.940484 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa0951-f62e-461e-bc09-913180e4350a admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:10.940850 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa0951-f62e-461e-bc09-913180e4350a admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:10.941690 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faa0951-f62e-461e-bc09-913180e4350a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:10.945522 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faa0951-f62e-461e-bc09-913180e4350a admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:10.952277 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d877bbd-7e69-435e-830a-c66e8b60364f None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:10.972805 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07feb890-d584-4ef7-9d4c-848270620ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:10.975116 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07feb890-d584-4ef7-9d4c-848270620ca8 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:10.975521 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07feb890-d584-4ef7-9d4c-848270620ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:10.975802 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07feb890-d584-4ef7-9d4c-848270620ca8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:10.976654 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07feb890-d584-4ef7-9d4c-848270620ca8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:36:10.976931 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07feb890-d584-4ef7-9d4c-848270620ca8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:10.978841 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07feb890-d584-4ef7-9d4c-848270620ca8 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:11.005049 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1107/2179] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:36:10 2022] POST /identity/v3/users => generated 301 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:36:11.007093 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31edfba-538d-4c12-a1a7-753428aac4a0 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:11.007714 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31edfba-538d-4c12-a1a7-753428aac4a0 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:11.008126 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31edfba-538d-4c12-a1a7-753428aac4a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:11.029263 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1073/2180] 10.222.0.26 () {58 vars in 1152 bytes} [Fri Jul 1 19:36:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:36:11.030527 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07feb890-d584-4ef7-9d4c-848270620ca8 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:11.040194 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-d31edfba-538d-4c12-a1a7-753428aac4a0 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:36:11.042015 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-d31edfba-538d-4c12-a1a7-753428aac4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:11.054142 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1108/2181] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:36:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:36:11.055163 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31edfba-538d-4c12-a1a7-753428aac4a0 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:11.067050 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07feb890-d584-4ef7-9d4c-848270620ca8 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:11.067624 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31edfba-538d-4c12-a1a7-753428aac4a0 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:11.075224 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4650e8cd-3c4d-4289-99bd-91eb8dcdf7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:11.076514 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650e8cd-3c4d-4289-99bd-91eb8dcdf7f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:11.077071 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650e8cd-3c4d-4289-99bd-91eb8dcdf7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:11.077690 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650e8cd-3c4d-4289-99bd-91eb8dcdf7f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:11.078610 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4650e8cd-3c4d-4289-99bd-91eb8dcdf7f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:11.081317 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4650e8cd-3c4d-4289-99bd-91eb8dcdf7f2 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:11.084621 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1a72f1-d8f1-4bfb-bf87-582bcc73da1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:11.088378 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a72f1-d8f1-4bfb-bf87-582bcc73da1a admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:11.088748 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a72f1-d8f1-4bfb-bf87-582bcc73da1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:11.089114 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a72f1-d8f1-4bfb-bf87-582bcc73da1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:11.090248 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1a72f1-d8f1-4bfb-bf87-582bcc73da1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:11.100119 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1a72f1-d8f1-4bfb-bf87-582bcc73da1a admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:11.122289 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1074/2182] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:36:11 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:36:11.126274 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1a72f1-d8f1-4bfb-bf87-582bcc73da1a admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:11.130505 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1109/2183] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:36:11 2022] POST /identity/v3/projects => generated 371 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:36:11.131556 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4650e8cd-3c4d-4289-99bd-91eb8dcdf7f2 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:11.142804 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1a72f1-d8f1-4bfb-bf87-582bcc73da1a admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:11.161753 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:11.259607 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:11.276822 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4650e8cd-3c4d-4289-99bd-91eb8dcdf7f2 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:11.290640 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9e6458-bf84-4055-86d3-2164e9283bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:11.292907 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e6458-bf84-4055-86d3-2164e9283bd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:11.293197 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e6458-bf84-4055-86d3-2164e9283bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:11.294129 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e6458-bf84-4055-86d3-2164e9283bd6 admin admin] PATH_INFO: `/v3/projects/40da363a682c4f09bb0ed3562a50571c/users/fa5991904fff4a818685e680d3f3d799/roles/6cb03785fb184ef587509b3174622f69` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:11.358247 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9e6458-bf84-4055-86d3-2164e9283bd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40da363a682c4f09bb0ed3562a50571c, user_id=fa5991904fff4a818685e680d3f3d799, role_id=6cb03785fb184ef587509b3174622f69)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:11.364003 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9e6458-bf84-4055-86d3-2164e9283bd6 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:11.392756 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad12f644-4d87-4fc5-91cc-8a6aa22209b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:11.394233 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12f644-4d87-4fc5-91cc-8a6aa22209b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:11.394537 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12f644-4d87-4fc5-91cc-8a6aa22209b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:11.394822 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12f644-4d87-4fc5-91cc-8a6aa22209b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:11.410678 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad12f644-4d87-4fc5-91cc-8a6aa22209b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:36:11.410678 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad12f644-4d87-4fc5-91cc-8a6aa22209b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:11.410865 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1110/2184] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:36:11 2022] PUT /identity/v3/projects/40da363a682c4f09bb0ed3562a50571c/users/fa5991904fff4a818685e680d3f3d799/roles/6cb03785fb184ef587509b3174622f69 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:36:11.410952 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad12f644-4d87-4fc5-91cc-8a6aa22209b9 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:11.411037 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9e6458-bf84-4055-86d3-2164e9283bd6 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:11.425594 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1075/2185] 10.222.0.26 () {58 vars in 1152 bytes} [Fri Jul 1 19:36:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:36:11.426697 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad12f644-4d87-4fc5-91cc-8a6aa22209b9 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:11.453629 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad12f644-4d87-4fc5-91cc-8a6aa22209b9 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:11.531466 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9e6458-bf84-4055-86d3-2164e9283bd6 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:11.537610 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e569b64-7b33-43a2-ae18-7be4cfcf38f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:11.538290 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e569b64-7b33-43a2-ae18-7be4cfcf38f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:11.538583 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e569b64-7b33-43a2-ae18-7be4cfcf38f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:11.538924 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e569b64-7b33-43a2-ae18-7be4cfcf38f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:11.540065 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e569b64-7b33-43a2-ae18-7be4cfcf38f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:11.542054 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e569b64-7b33-43a2-ae18-7be4cfcf38f2 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:11.546399 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5152fe-47c9-489f-ad90-9d9a08afec54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:11.547092 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5152fe-47c9-489f-ad90-9d9a08afec54 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:11.547536 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5152fe-47c9-489f-ad90-9d9a08afec54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:11.547884 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5152fe-47c9-489f-ad90-9d9a08afec54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:11.548685 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5152fe-47c9-489f-ad90-9d9a08afec54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:11.550673 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5152fe-47c9-489f-ad90-9d9a08afec54 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:11.569886 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1076/2186] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:36:11 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:36:11.569886 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5152fe-47c9-489f-ad90-9d9a08afec54 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:11.579556 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1111/2187] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:36:11 2022] POST /identity/v3/users => generated 286 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:36:11.580321 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5152fe-47c9-489f-ad90-9d9a08afec54 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:11.580917 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e569b64-7b33-43a2-ae18-7be4cfcf38f2 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:11.588446 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25f2937-ad7e-4840-91f0-642b78f36a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:11.589261 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25f2937-ad7e-4840-91f0-642b78f36a89 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:11.589614 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25f2937-ad7e-4840-91f0-642b78f36a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:11.590093 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25f2937-ad7e-4840-91f0-642b78f36a89 admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:11.590949 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25f2937-ad7e-4840-91f0-642b78f36a89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:11.593028 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25f2937-ad7e-4840-91f0-642b78f36a89 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:11.593164 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e569b64-7b33-43a2-ae18-7be4cfcf38f2 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:11.598701 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac85de3-0c42-4e31-ad21-4dd401f4e28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:11.600473 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac85de3-0c42-4e31-ad21-4dd401f4e28a admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:11.600805 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac85de3-0c42-4e31-ad21-4dd401f4e28a admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:11.601500 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac85de3-0c42-4e31-ad21-4dd401f4e28a admin admin] PATH_INFO: `/v3/projects/40da363a682c4f09bb0ed3562a50571c/users/fa5991904fff4a818685e680d3f3d799/roles/6cb03785fb184ef587509b3174622f69` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:11.603477 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac85de3-0c42-4e31-ad21-4dd401f4e28a admin admin] RBAC: Authorizing `identity:create_grant(project_id=40da363a682c4f09bb0ed3562a50571c, user_id=fa5991904fff4a818685e680d3f3d799, role_id=6cb03785fb184ef587509b3174622f69)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:11.608494 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac85de3-0c42-4e31-ad21-4dd401f4e28a admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:11.627369 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1077/2188] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:36:11 2022] POST /identity/v3/projects => generated 383 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:36:11.628102 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1112/2189] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:36:11 2022] PUT /identity/v3/projects/40da363a682c4f09bb0ed3562a50571c/users/fa5991904fff4a818685e680d3f3d799/roles/6cb03785fb184ef587509b3174622f69 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:36:11.631602 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25f2937-ad7e-4840-91f0-642b78f36a89 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:11.639385 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac85de3-0c42-4e31-ad21-4dd401f4e28a admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:11.740751 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac85de3-0c42-4e31-ad21-4dd401f4e28a admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:11.741269 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25f2937-ad7e-4840-91f0-642b78f36a89 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:11.748020 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f0d686-df73-49c8-ac05-2724009db0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:11.748818 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f0d686-df73-49c8-ac05-2724009db0e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:11.749172 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f0d686-df73-49c8-ac05-2724009db0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:11.749484 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f0d686-df73-49c8-ac05-2724009db0e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:11.750063 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a099007e-704f-434a-9a01-ae8b69e71f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:11.750269 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f0d686-df73-49c8-ac05-2724009db0e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:11.750887 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099007e-704f-434a-9a01-ae8b69e71f18 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:11.751177 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099007e-704f-434a-9a01-ae8b69e71f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:11.751455 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099007e-704f-434a-9a01-ae8b69e71f18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:11.752177 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f0d686-df73-49c8-ac05-2724009db0e6 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:11.752291 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a099007e-704f-434a-9a01-ae8b69e71f18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:11.753832 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a099007e-704f-434a-9a01-ae8b69e71f18 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:11.774889 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1078/2190] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:36:11 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:36:11.776456 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b3a16-20a0-4709-9704-8e6dfe1fe0d2 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:11.776751 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b3a16-20a0-4709-9704-8e6dfe1fe0d2 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:11.777108 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b3a16-20a0-4709-9704-8e6dfe1fe0d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:11.781055 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1113/2191] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:36:11 2022] POST /identity/v3/users => generated 292 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:36:11.782132 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f0d686-df73-49c8-ac05-2724009db0e6 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:11.794141 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f0d686-df73-49c8-ac05-2724009db0e6 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:11.798470 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7d892a-1f81-4791-9f9d-a80d474c120f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:11.799141 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d892a-1f81-4791-9f9d-a80d474c120f admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:11.799427 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d892a-1f81-4791-9f9d-a80d474c120f admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:11.799704 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d892a-1f81-4791-9f9d-a80d474c120f admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:11.800496 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7d892a-1f81-4791-9f9d-a80d474c120f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:11.802158 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7d892a-1f81-4791-9f9d-a80d474c120f admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:11.803526 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:11.810596 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-9c2b3a16-20a0-4709-9704-8e6dfe1fe0d2 None None] MFA Rules not processed for user `fa5991904fff4a818685e680d3f3d799`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:36:11.811889 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-9c2b3a16-20a0-4709-9704-8e6dfe1fe0d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:11.818813 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1114/2192] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:36:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:36:11.818813 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7d892a-1f81-4791-9f9d-a80d474c120f admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:11.829223 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7d892a-1f81-4791-9f9d-a80d474c120f admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:11.837089 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb4f7c0-46f9-4090-aa81-d87e18d411a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:11.837923 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:11.840180 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4f7c0-46f9-4090-aa81-d87e18d411a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:11.840180 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4f7c0-46f9-4090-aa81-d87e18d411a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:11.840180 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4f7c0-46f9-4090-aa81-d87e18d411a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:11.840580 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb4f7c0-46f9-4090-aa81-d87e18d411a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:11.843730 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb4f7c0-46f9-4090-aa81-d87e18d411a2 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:11.864158 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1115/2193] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:36:11 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:36:11.864917 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb4f7c0-46f9-4090-aa81-d87e18d411a2 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:11.881109 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb4f7c0-46f9-4090-aa81-d87e18d411a2 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:11.891865 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dff08b-9e6e-4c4f-9512-f47ebd4509b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:11.892987 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dff08b-9e6e-4c4f-9512-f47ebd4509b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:11.893305 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dff08b-9e6e-4c4f-9512-f47ebd4509b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:11.893613 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dff08b-9e6e-4c4f-9512-f47ebd4509b0 admin admin] PATH_INFO: `/v3/projects/8d3902cb9b104765933506e688bb94ec/users/56cb1c16dec440388b3527abedbfc90a/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:11.910640 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dff08b-9e6e-4c4f-9512-f47ebd4509b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d3902cb9b104765933506e688bb94ec, user_id=56cb1c16dec440388b3527abedbfc90a, role_id=4cbf6ec846eb4b7c8cc52e9bfd6f076f)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:11.913164 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1079/2194] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:36:11 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:36:11.913466 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dff08b-9e6e-4c4f-9512-f47ebd4509b0 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:11.914253 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2b3a16-20a0-4709-9704-8e6dfe1fe0d2 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:11.926574 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2b3a16-20a0-4709-9704-8e6dfe1fe0d2 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:11.932875 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1116/2195] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:36:11 2022] PUT /identity/v3/projects/8d3902cb9b104765933506e688bb94ec/users/56cb1c16dec440388b3527abedbfc90a/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:36:11.934045 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dff08b-9e6e-4c4f-9512-f47ebd4509b0 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:11.938125 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-b6dff08b-9e6e-4c4f-9512-f47ebd4509b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:11.992546 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f65d65-5afb-48aa-a475-4c83080b2ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:11.993282 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f65d65-5afb-48aa-a475-4c83080b2ece admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:11.993915 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f65d65-5afb-48aa-a475-4c83080b2ece admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:11.993915 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f65d65-5afb-48aa-a475-4c83080b2ece admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:11.994481 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f65d65-5afb-48aa-a475-4c83080b2ece admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:11.996111 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f65d65-5afb-48aa-a475-4c83080b2ece admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:12.005933 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dff08b-9e6e-4c4f-9512-f47ebd4509b0 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:12.007051 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1080/2196] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:36:11 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:36:12.008321 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e4f8e-7611-4b42-9411-13ddabd517b3 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:12.008615 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e4f8e-7611-4b42-9411-13ddabd517b3 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:12.008900 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e4f8e-7611-4b42-9411-13ddabd517b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:12.012039 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb686b23-8ecf-4c38-a49d-ba270ef382d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a3ed285ee4c4d04abf7daf0aeb9fb7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:12.012718 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb686b23-8ecf-4c38-a49d-ba270ef382d7 service cinder] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:12.013025 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb686b23-8ecf-4c38-a49d-ba270ef382d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:12.013342 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb686b23-8ecf-4c38-a49d-ba270ef382d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:12.027115 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-fa1e4f8e-7611-4b42-9411-13ddabd517b3 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:36:12.028834 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-fa1e4f8e-7611-4b42-9411-13ddabd517b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:12.036829 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1081/2197] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:36:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:36:12.037381 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1e4f8e-7611-4b42-9411-13ddabd517b3 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:12.047442 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1e4f8e-7611-4b42-9411-13ddabd517b3 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:12.052063 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4e7207-2684-421b-9f9e-fd318f700444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:12.052940 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e7207-2684-421b-9f9e-fd318f700444 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:12.053221 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e7207-2684-421b-9f9e-fd318f700444 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:12.053526 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e7207-2684-421b-9f9e-fd318f700444 admin admin] PATH_INFO: `/v3/projects/b8b304316cb840b0a4c5919b5bd695ed/users/fb2b949c3a784157a01da46158c05c13/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:12.075024 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4e7207-2684-421b-9f9e-fd318f700444 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8b304316cb840b0a4c5919b5bd695ed, user_id=fb2b949c3a784157a01da46158c05c13, role_id=4cbf6ec846eb4b7c8cc52e9bfd6f076f)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:12.077740 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4e7207-2684-421b-9f9e-fd318f700444 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:12.085393 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb686b23-8ecf-4c38-a49d-ba270ef382d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:12.086920 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb686b23-8ecf-4c38-a49d-ba270ef382d7 service cinder] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:12.092643 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1082/2198] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:36:12 2022] PUT /identity/v3/projects/b8b304316cb840b0a4c5919b5bd695ed/users/fb2b949c3a784157a01da46158c05c13/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:36:12.093443 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4e7207-2684-421b-9f9e-fd318f700444 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:12.095031 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-3b4e7207-2684-421b-9f9e-fd318f700444 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:12.098038 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1117/2199] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:36:11 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:36:12.104651 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9793b48c-9edb-42ca-adc9-a7ee93ae17f3 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:12.104939 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9793b48c-9edb-42ca-adc9-a7ee93ae17f3 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:12.105220 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9793b48c-9edb-42ca-adc9-a7ee93ae17f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:12.139977 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-9793b48c-9edb-42ca-adc9-a7ee93ae17f3 None None] MFA Rules not processed for user `fb2b949c3a784157a01da46158c05c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:36:12.141373 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-9793b48c-9edb-42ca-adc9-a7ee93ae17f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:12.171760 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4e7207-2684-421b-9f9e-fd318f700444 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:12.172360 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc40065-473d-4d5d-9cf6-57f72ba27ae6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:12.173010 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc40065-473d-4d5d-9cf6-57f72ba27ae6 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:12.173326 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc40065-473d-4d5d-9cf6-57f72ba27ae6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:12.173621 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc40065-473d-4d5d-9cf6-57f72ba27ae6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:12.214662 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:12.216961 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:12.222777 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1118/2200] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:36:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:36:12.228050 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9793b48c-9edb-42ca-adc9-a7ee93ae17f3 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:12.254925 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc40065-473d-4d5d-9cf6-57f72ba27ae6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:12.256610 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc40065-473d-4d5d-9cf6-57f72ba27ae6 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:12.269898 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1083/2201] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:36:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:36:12.270826 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc40065-473d-4d5d-9cf6-57f72ba27ae6 service neutron] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:12.280677 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc40065-473d-4d5d-9cf6-57f72ba27ae6 service neutron] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:12.285618 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a4d3a-a15f-4494-8155-bb48af55a09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:12.286485 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a4d3a-a15f-4494-8155-bb48af55a09f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:12.286764 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a4d3a-a15f-4494-8155-bb48af55a09f admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:12.287099 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a4d3a-a15f-4494-8155-bb48af55a09f admin admin] PATH_INFO: `/v3/users/31c9b3226d7f427a8d7d8f5f20639c4a` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:12.288246 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4a4d3a-a15f-4494-8155-bb48af55a09f admin admin] RBAC: Authorizing `identity:delete_user(user_id=31c9b3226d7f427a8d7d8f5f20639c4a)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:12.290238 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4a4d3a-a15f-4494-8155-bb48af55a09f admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:12.305163 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9793b48c-9edb-42ca-adc9-a7ee93ae17f3 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:12.313542 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cee98d-5d05-4d6a-9f42-16ac2aa35ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:12.314223 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cee98d-5d05-4d6a-9f42-16ac2aa35ca6 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:12.314512 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cee98d-5d05-4d6a-9f42-16ac2aa35ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:12.314793 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cee98d-5d05-4d6a-9f42-16ac2aa35ca6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:12.315521 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cee98d-5d05-4d6a-9f42-16ac2aa35ca6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:12.317513 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cee98d-5d05-4d6a-9f42-16ac2aa35ca6 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:12.366296 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1119/2202] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:36:12 2022] POST /identity/v3/projects => generated 381 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:36:12.371851 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-af4a4d3a-a15f-4494-8155-bb48af55a09f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31c9b3226d7f427a8d7d8f5f20639c4a'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:12.372622 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-af4a4d3a-a15f-4494-8155-bb48af55a09f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31c9b3226d7f427a8d7d8f5f20639c4a'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:12.372828 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cee98d-5d05-4d6a-9f42-16ac2aa35ca6 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:12.383398 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-af4a4d3a-a15f-4494-8155-bb48af55a09f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31c9b3226d7f427a8d7d8f5f20639c4a'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:12.405853 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-af4a4d3a-a15f-4494-8155-bb48af55a09f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31c9b3226d7f427a8d7d8f5f20639c4a'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:12.406736 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-af4a4d3a-a15f-4494-8155-bb48af55a09f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31c9b3226d7f427a8d7d8f5f20639c4a'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:12.452816 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1084/2203] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:36:12 2022] DELETE /identity/v3/users/31c9b3226d7f427a8d7d8f5f20639c4a => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:36:12.456746 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cee98d-5d05-4d6a-9f42-16ac2aa35ca6 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:12.457471 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1be198-782c-4a64-9672-b6605ec99004 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:12.457768 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1be198-782c-4a64-9672-b6605ec99004 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:12.458241 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1be198-782c-4a64-9672-b6605ec99004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:12.509822 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-0c1be198-782c-4a64-9672-b6605ec99004 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:36:12.511295 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-0c1be198-782c-4a64-9672-b6605ec99004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:12.539061 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af5042f-8421-4f4a-b79e-e0370ae8e681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:12.539682 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af5042f-8421-4f4a-b79e-e0370ae8e681 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:12.539974 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af5042f-8421-4f4a-b79e-e0370ae8e681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:12.540667 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af5042f-8421-4f4a-b79e-e0370ae8e681 admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:12.540959 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af5042f-8421-4f4a-b79e-e0370ae8e681 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:12.543585 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af5042f-8421-4f4a-b79e-e0370ae8e681 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:12.615908 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1120/2204] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:36:12 2022] POST /identity/v3/users => generated 297 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:36:12.616915 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af5042f-8421-4f4a-b79e-e0370ae8e681 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:12.619192 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-1af5042f-8421-4f4a-b79e-e0370ae8e681 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:12.650397 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1085/2205] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:36:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:36:12.658227 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af5042f-8421-4f4a-b79e-e0370ae8e681 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:12.668060 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8ac66-34f0-4d92-af5e-c3ab50464b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:12.669093 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8ac66-34f0-4d92-af5e-c3ab50464b72 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:12.669511 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8ac66-34f0-4d92-af5e-c3ab50464b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:12.670500 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8ac66-34f0-4d92-af5e-c3ab50464b72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:12.671359 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf8ac66-34f0-4d92-af5e-c3ab50464b72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:12.674351 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf8ac66-34f0-4d92-af5e-c3ab50464b72 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:12.692807 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1be198-782c-4a64-9672-b6605ec99004 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:12.693041 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1121/2206] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:36:12 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:36:12.708471 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1be198-782c-4a64-9672-b6605ec99004 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:12.709877 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8ac66-34f0-4d92-af5e-c3ab50464b72 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:12.712594 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-bdf8ac66-34f0-4d92-af5e-c3ab50464b72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:12.714632 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5c029c-6304-4093-bd48-4993e34e7380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:12.715686 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c029c-6304-4093-bd48-4993e34e7380 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:12.715973 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c029c-6304-4093-bd48-4993e34e7380 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:12.716965 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c029c-6304-4093-bd48-4993e34e7380 admin admin] PATH_INFO: `/v3/projects/8430311bf9714e8e8cf42bdae1d7f0ff/users/1c9783c3282040c4bfac9d2df21f23ff/roles/6cb03785fb184ef587509b3174622f69` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:12.731308 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:12.757846 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5c029c-6304-4093-bd48-4993e34e7380 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8430311bf9714e8e8cf42bdae1d7f0ff, user_id=1c9783c3282040c4bfac9d2df21f23ff, role_id=6cb03785fb184ef587509b3174622f69)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:12.761563 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5c029c-6304-4093-bd48-4993e34e7380 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:12.786899 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1086/2207] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:36:12 2022] PUT /identity/v3/projects/8430311bf9714e8e8cf42bdae1d7f0ff/users/1c9783c3282040c4bfac9d2df21f23ff/roles/6cb03785fb184ef587509b3174622f69 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 19:36:12.794725 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5c029c-6304-4093-bd48-4993e34e7380 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:12.809689 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8ac66-34f0-4d92-af5e-c3ab50464b72 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:12.835334 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:12.931521 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a53bc3-3443-4508-9e08-77752644d0cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:12.937409 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a53bc3-3443-4508-9e08-77752644d0cd service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:12.938422 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a53bc3-3443-4508-9e08-77752644d0cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:12.939930 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a53bc3-3443-4508-9e08-77752644d0cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:12.942168 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5c029c-6304-4093-bd48-4993e34e7380 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:12.956719 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c9640c-db6b-4f6a-82e1-9f5b6a3e30bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:12.957696 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c9640c-db6b-4f6a-82e1-9f5b6a3e30bf admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:12.959274 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c9640c-db6b-4f6a-82e1-9f5b6a3e30bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:12.959784 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c9640c-db6b-4f6a-82e1-9f5b6a3e30bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:12.961658 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c9640c-db6b-4f6a-82e1-9f5b6a3e30bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:12.965136 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a53bc3-3443-4508-9e08-77752644d0cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:12.965728 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c9640c-db6b-4f6a-82e1-9f5b6a3e30bf admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:12.967266 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a53bc3-3443-4508-9e08-77752644d0cd service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:13.004246 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1087/2208] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:36:12 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:36:13.004246 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c9640c-db6b-4f6a-82e1-9f5b6a3e30bf admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:13.004526 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1122/2209] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:36:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:36:13.010725 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c9640c-db6b-4f6a-82e1-9f5b6a3e30bf admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:13.017869 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf85580-abe5-446e-bd99-b3ca1c321c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:13.018767 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf85580-abe5-446e-bd99-b3ca1c321c82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:13.019167 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf85580-abe5-446e-bd99-b3ca1c321c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:13.019366 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf85580-abe5-446e-bd99-b3ca1c321c82 admin admin] PATH_INFO: `/v3/projects/8430311bf9714e8e8cf42bdae1d7f0ff/users/1c9783c3282040c4bfac9d2df21f23ff/roles/6cb03785fb184ef587509b3174622f69` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:13.023646 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf85580-abe5-446e-bd99-b3ca1c321c82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8430311bf9714e8e8cf42bdae1d7f0ff, user_id=1c9783c3282040c4bfac9d2df21f23ff, role_id=6cb03785fb184ef587509b3174622f69)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:13.026677 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf85580-abe5-446e-bd99-b3ca1c321c82 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:13.062866 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1088/2210] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:36:12 2022] PUT /identity/v3/projects/8430311bf9714e8e8cf42bdae1d7f0ff/users/1c9783c3282040c4bfac9d2df21f23ff/roles/6cb03785fb184ef587509b3174622f69 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:36:13.064765 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a2173-02ef-465c-b865-38ada6717ca3 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:13.065065 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a2173-02ef-465c-b865-38ada6717ca3 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:13.065506 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a2173-02ef-465c-b865-38ada6717ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:13.098596 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-379a2173-02ef-465c-b865-38ada6717ca3 None None] MFA Rules not processed for user `1c9783c3282040c4bfac9d2df21f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:36:13.099988 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-379a2173-02ef-465c-b865-38ada6717ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:13.224923 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1123/2211] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:36:13 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:36:13.236018 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf85580-abe5-446e-bd99-b3ca1c321c82 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:13.238202 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-bdf85580-abe5-446e-bd99-b3ca1c321c82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:13.358413 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf85580-abe5-446e-bd99-b3ca1c321c82 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:13.365466 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbb087b-ee95-4c77-b6ac-c53b344ef128 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a3ed285ee4c4d04abf7daf0aeb9fb7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:13.366390 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb087b-ee95-4c77-b6ac-c53b344ef128 service cinder] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:13.366884 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb087b-ee95-4c77-b6ac-c53b344ef128 service cinder] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:13.367813 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb087b-ee95-4c77-b6ac-c53b344ef128 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:13.382126 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbb087b-ee95-4c77-b6ac-c53b344ef128 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:13.383202 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbb087b-ee95-4c77-b6ac-c53b344ef128 service cinder] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:13.395111 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1089/2212] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:36:13 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:36:13.520817 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379a2173-02ef-465c-b865-38ada6717ca3 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:13.534404 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379a2173-02ef-465c-b865-38ada6717ca3 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:13.538945 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e35926-7a61-41fe-8aeb-fc8b03fb7059 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a3ed285ee4c4d04abf7daf0aeb9fb7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:13.539615 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e35926-7a61-41fe-8aeb-fc8b03fb7059 service cinder] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:13.539908 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e35926-7a61-41fe-8aeb-fc8b03fb7059 service cinder] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:13.540181 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e35926-7a61-41fe-8aeb-fc8b03fb7059 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:13.542338 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-a7e35926-7a61-41fe-8aeb-fc8b03fb7059 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:13.645870 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:13.653353 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e35926-7a61-41fe-8aeb-fc8b03fb7059 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:13.654808 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e35926-7a61-41fe-8aeb-fc8b03fb7059 service cinder] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:13.665699 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1124/2213] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:36:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:36:13.947664 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbb087b-ee95-4c77-b6ac-c53b344ef128 service cinder] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:13.953765 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-2dbb087b-ee95-4c77-b6ac-c53b344ef128 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:14.218988 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbb087b-ee95-4c77-b6ac-c53b344ef128 service cinder] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:14.224516 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83132c66-2754-4530-84ac-37129db4f8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:14.225745 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83132c66-2754-4530-84ac-37129db4f8ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:14.226241 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83132c66-2754-4530-84ac-37129db4f8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:14.226597 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83132c66-2754-4530-84ac-37129db4f8ca admin admin] PATH_INFO: `/v3/projects/c584039c24fb4c94b3d0f7a00a7a025c` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:14.228053 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83132c66-2754-4530-84ac-37129db4f8ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=c584039c24fb4c94b3d0f7a00a7a025c)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:14.230294 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83132c66-2754-4530-84ac-37129db4f8ca admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:14.313806 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:14.318768 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-83132c66-2754-4530-84ac-37129db4f8ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c584039c24fb4c94b3d0f7a00a7a025c', 'request_id': 'req-83132c66-2754-4530-84ac-37129db4f8ca'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:14.333816 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-83132c66-2754-4530-84ac-37129db4f8ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c584039c24fb4c94b3d0f7a00a7a025c', 'request_id': 'req-83132c66-2754-4530-84ac-37129db4f8ca'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:14.343224 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-83132c66-2754-4530-84ac-37129db4f8ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c584039c24fb4c94b3d0f7a00a7a025c', 'request_id': 'req-83132c66-2754-4530-84ac-37129db4f8ca'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:14.368403 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-83132c66-2754-4530-84ac-37129db4f8ca admin admin] The token cache is being invalidate because project c584039c24fb4c94b3d0f7a00a7a025c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:36:14.369884 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-83132c66-2754-4530-84ac-37129db4f8ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:14.372760 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-83132c66-2754-4530-84ac-37129db4f8ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:14.375050 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1090/2214] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:36:13 2022] DELETE /identity/v3/projects/c584039c24fb4c94b3d0f7a00a7a025c => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:36:14.379068 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e35926-7a61-41fe-8aeb-fc8b03fb7059 service cinder] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:14.394053 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e35926-7a61-41fe-8aeb-fc8b03fb7059 service cinder] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:14.488846 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d5f9ad-4617-456c-bf50-03ce4c93d9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:14.489925 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5f9ad-4617-456c-bf50-03ce4c93d9a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:14.490365 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5f9ad-4617-456c-bf50-03ce4c93d9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:14.490779 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5f9ad-4617-456c-bf50-03ce4c93d9a5 admin admin] PATH_INFO: `/v3/users/fa5991904fff4a818685e680d3f3d799` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:14.492332 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d5f9ad-4617-456c-bf50-03ce4c93d9a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa5991904fff4a818685e680d3f3d799)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:14.494923 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d5f9ad-4617-456c-bf50-03ce4c93d9a5 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:14.565570 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-02d5f9ad-4617-456c-bf50-03ce4c93d9a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa5991904fff4a818685e680d3f3d799'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:14.566697 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-02d5f9ad-4617-456c-bf50-03ce4c93d9a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa5991904fff4a818685e680d3f3d799'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:14.582756 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-02d5f9ad-4617-456c-bf50-03ce4c93d9a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa5991904fff4a818685e680d3f3d799'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:14.593670 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-02d5f9ad-4617-456c-bf50-03ce4c93d9a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa5991904fff4a818685e680d3f3d799'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:14.609015 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-02d5f9ad-4617-456c-bf50-03ce4c93d9a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa5991904fff4a818685e680d3f3d799'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:14.620963 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1125/2215] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:36:14 2022] DELETE /identity/v3/users/fa5991904fff4a818685e680d3f3d799 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:36:15.016898 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83132c66-2754-4530-84ac-37129db4f8ca admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:15.018538 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-83132c66-2754-4530-84ac-37129db4f8ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:15.038432 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83132c66-2754-4530-84ac-37129db4f8ca admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:15.111937 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a80297-484c-4adf-8491-153eda3d7d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:15.112647 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a80297-484c-4adf-8491-153eda3d7d2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:15.112934 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a80297-484c-4adf-8491-153eda3d7d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:15.113208 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a80297-484c-4adf-8491-153eda3d7d2b admin admin] PATH_INFO: `/v3/projects/40da363a682c4f09bb0ed3562a50571c` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:15.114700 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a80297-484c-4adf-8491-153eda3d7d2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=40da363a682c4f09bb0ed3562a50571c)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:15.116739 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a80297-484c-4adf-8491-153eda3d7d2b admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:15.177651 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-86a80297-484c-4adf-8491-153eda3d7d2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40da363a682c4f09bb0ed3562a50571c', 'request_id': 'req-86a80297-484c-4adf-8491-153eda3d7d2b'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:15.186552 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-86a80297-484c-4adf-8491-153eda3d7d2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40da363a682c4f09bb0ed3562a50571c', 'request_id': 'req-86a80297-484c-4adf-8491-153eda3d7d2b'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:15.195617 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-86a80297-484c-4adf-8491-153eda3d7d2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40da363a682c4f09bb0ed3562a50571c', 'request_id': 'req-86a80297-484c-4adf-8491-153eda3d7d2b'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:15.214344 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-86a80297-484c-4adf-8491-153eda3d7d2b admin admin] The token cache is being invalidate because project 40da363a682c4f09bb0ed3562a50571c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:36:15.215473 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-86a80297-484c-4adf-8491-153eda3d7d2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:15.216358 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-86a80297-484c-4adf-8491-153eda3d7d2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:15.218654 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1091/2216] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:36:15 2022] DELETE /identity/v3/projects/40da363a682c4f09bb0ed3562a50571c => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:36:15.223306 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cfdc20-8747-4a14-a3d9-e1ee59e2e022 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:15.223604 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cfdc20-8747-4a14-a3d9-e1ee59e2e022 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:15.224422 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cfdc20-8747-4a14-a3d9-e1ee59e2e022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:15.245090 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-f9cfdc20-8747-4a14-a3d9-e1ee59e2e022 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:36:15.246908 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-f9cfdc20-8747-4a14-a3d9-e1ee59e2e022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:15.373390 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1126/2217] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:36:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:36:15.379229 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e0086-8122-452d-b098-0d96f0e3e102 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:15.379708 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e0086-8122-452d-b098-0d96f0e3e102 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:15.379914 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e0086-8122-452d-b098-0d96f0e3e102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:15.409364 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-9e4e0086-8122-452d-b098-0d96f0e3e102 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:36:15.409364 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-9e4e0086-8122-452d-b098-0d96f0e3e102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:15.441704 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1092/2218] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:36:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:36:15.442915 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cfdc20-8747-4a14-a3d9-e1ee59e2e022 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:15.457888 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cfdc20-8747-4a14-a3d9-e1ee59e2e022 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:15.470480 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23a6d20-9a39-4737-b381-3a6768de5dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:15.471475 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a6d20-9a39-4737-b381-3a6768de5dc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:15.471826 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a6d20-9a39-4737-b381-3a6768de5dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:15.472228 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a6d20-9a39-4737-b381-3a6768de5dc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:15.473036 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23a6d20-9a39-4737-b381-3a6768de5dc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:36:15.473450 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23a6d20-9a39-4737-b381-3a6768de5dc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:15.475147 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23a6d20-9a39-4737-b381-3a6768de5dc9 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:15.488218 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:15.506291 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e0086-8122-452d-b098-0d96f0e3e102 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:15.507383 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1127/2219] 10.222.0.26 () {58 vars in 1152 bytes} [Fri Jul 1 19:36:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:36:15.517669 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e0086-8122-452d-b098-0d96f0e3e102 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:15.531144 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a0a53-2890-476b-9f8a-4b966d0c61c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:15.531462 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a0a53-2890-476b-9f8a-4b966d0c61c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:15.531785 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a0a53-2890-476b-9f8a-4b966d0c61c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:15.532045 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a0a53-2890-476b-9f8a-4b966d0c61c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:15.532725 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698a0a53-2890-476b-9f8a-4b966d0c61c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:15.534994 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698a0a53-2890-476b-9f8a-4b966d0c61c1 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:15.585871 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1093/2220] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:36:15 2022] POST /identity/v3/projects => generated 375 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:36:15.586663 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23a6d20-9a39-4737-b381-3a6768de5dc9 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:15.602500 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23a6d20-9a39-4737-b381-3a6768de5dc9 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:15.698626 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327bae41-237a-4ebd-a73a-2935efcdfd28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:15.699355 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327bae41-237a-4ebd-a73a-2935efcdfd28 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:15.700230 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327bae41-237a-4ebd-a73a-2935efcdfd28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:15.700523 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327bae41-237a-4ebd-a73a-2935efcdfd28 admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:15.701218 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327bae41-237a-4ebd-a73a-2935efcdfd28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:15.703320 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327bae41-237a-4ebd-a73a-2935efcdfd28 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:15.741632 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1128/2221] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:36:15 2022] POST /identity/v3/users => generated 288 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 19:36:15.743635 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a0a53-2890-476b-9f8a-4b966d0c61c1 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:15.759504 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a0a53-2890-476b-9f8a-4b966d0c61c1 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:15.778740 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6987e5ab-4e28-40a4-8689-3f5c7b39069e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:15.779431 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6987e5ab-4e28-40a4-8689-3f5c7b39069e admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:15.783508 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6987e5ab-4e28-40a4-8689-3f5c7b39069e admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:15.783942 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6987e5ab-4e28-40a4-8689-3f5c7b39069e admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:15.786319 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6987e5ab-4e28-40a4-8689-3f5c7b39069e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:15.788307 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6987e5ab-4e28-40a4-8689-3f5c7b39069e admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:15.812779 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1094/2222] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:36:15 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:36:15.813882 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327bae41-237a-4ebd-a73a-2935efcdfd28 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:15.826778 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327bae41-237a-4ebd-a73a-2935efcdfd28 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:15.835041 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8d8eb3-41f2-4db9-be16-4d3360eeac29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:15.836241 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d8eb3-41f2-4db9-be16-4d3360eeac29 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:15.836241 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d8eb3-41f2-4db9-be16-4d3360eeac29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:15.836459 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d8eb3-41f2-4db9-be16-4d3360eeac29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:15.837338 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8d8eb3-41f2-4db9-be16-4d3360eeac29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:15.839773 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8d8eb3-41f2-4db9-be16-4d3360eeac29 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:15.872537 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6987e5ab-4e28-40a4-8689-3f5c7b39069e admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:15.875843 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-6987e5ab-4e28-40a4-8689-3f5c7b39069e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:15.890775 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1129/2223] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:36:15 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:36:15.892237 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8d8eb3-41f2-4db9-be16-4d3360eeac29 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:15.923212 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:15.926890 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8d8eb3-41f2-4db9-be16-4d3360eeac29 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:15.944535 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d6d65b-1b3f-4e9d-8030-10a18a1a5f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:15.945811 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d6d65b-1b3f-4e9d-8030-10a18a1a5f05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:15.946322 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d6d65b-1b3f-4e9d-8030-10a18a1a5f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:15.946805 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d6d65b-1b3f-4e9d-8030-10a18a1a5f05 admin admin] PATH_INFO: `/v3/projects/f5d8f881c3b24329a76a61a1879fe1ec/users/448cab7166634f4bbc8e682ae21403ab/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:15.967781 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d6d65b-1b3f-4e9d-8030-10a18a1a5f05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5d8f881c3b24329a76a61a1879fe1ec, user_id=448cab7166634f4bbc8e682ae21403ab, role_id=4cbf6ec846eb4b7c8cc52e9bfd6f076f)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:15.971033 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d6d65b-1b3f-4e9d-8030-10a18a1a5f05 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:16.005605 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1130/2224] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:36:15 2022] PUT /identity/v3/projects/f5d8f881c3b24329a76a61a1879fe1ec/users/448cab7166634f4bbc8e682ae21403ab/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:36:16.018980 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d3933-54a0-49b9-b571-5976c69d0e19 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:16.019266 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d3933-54a0-49b9-b571-5976c69d0e19 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:16.019609 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d3933-54a0-49b9-b571-5976c69d0e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:16.027312 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6987e5ab-4e28-40a4-8689-3f5c7b39069e admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:16.063632 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-908d3933-54a0-49b9-b571-5976c69d0e19 None None] MFA Rules not processed for user `448cab7166634f4bbc8e682ae21403ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:36:16.065657 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-908d3933-54a0-49b9-b571-5976c69d0e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:16.150993 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c90499-fab7-4a3c-abbb-2c05c3fd036c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a3ed285ee4c4d04abf7daf0aeb9fb7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:16.151671 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c90499-fab7-4a3c-abbb-2c05c3fd036c service cinder] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:16.152068 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c90499-fab7-4a3c-abbb-2c05c3fd036c service cinder] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:16.152380 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c90499-fab7-4a3c-abbb-2c05c3fd036c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:16.156476 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-04c90499-fab7-4a3c-abbb-2c05c3fd036c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:16.179610 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1131/2225] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:36:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:36:16.194641 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908d3933-54a0-49b9-b571-5976c69d0e19 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:16.198209 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-908d3933-54a0-49b9-b571-5976c69d0e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:16.216199 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908d3933-54a0-49b9-b571-5976c69d0e19 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:16.220417 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888be991-424e-48bc-b95f-2a81241b0bfe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a3ed285ee4c4d04abf7daf0aeb9fb7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:16.220417 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888be991-424e-48bc-b95f-2a81241b0bfe service cinder] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:16.220417 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888be991-424e-48bc-b95f-2a81241b0bfe service cinder] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:16.230635 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888be991-424e-48bc-b95f-2a81241b0bfe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:16.262818 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888be991-424e-48bc-b95f-2a81241b0bfe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:16.266168 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888be991-424e-48bc-b95f-2a81241b0bfe service cinder] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:16.266895 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c90499-fab7-4a3c-abbb-2c05c3fd036c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:16.268387 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c90499-fab7-4a3c-abbb-2c05c3fd036c service cinder] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:16.279831 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1132/2226] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:36:16 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:36:16.283213 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1095/2227] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:36:15 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 19:36:16.803875 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888be991-424e-48bc-b95f-2a81241b0bfe service cinder] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:16.805462 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-888be991-424e-48bc-b95f-2a81241b0bfe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:16.898700 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:16.977139 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888be991-424e-48bc-b95f-2a81241b0bfe service cinder] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:16.988159 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4106dff-437f-4c4e-bb20-a493705d193e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:16.989969 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4106dff-437f-4c4e-bb20-a493705d193e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:16.989969 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4106dff-437f-4c4e-bb20-a493705d193e admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:16.989969 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4106dff-437f-4c4e-bb20-a493705d193e admin admin] PATH_INFO: `/v3/users/fb2b949c3a784157a01da46158c05c13` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:16.997979 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4106dff-437f-4c4e-bb20-a493705d193e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb2b949c3a784157a01da46158c05c13)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:17.001443 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4106dff-437f-4c4e-bb20-a493705d193e admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:17.081789 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-b4106dff-437f-4c4e-bb20-a493705d193e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb2b949c3a784157a01da46158c05c13'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:17.082494 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-b4106dff-437f-4c4e-bb20-a493705d193e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb2b949c3a784157a01da46158c05c13'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:17.106622 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-b4106dff-437f-4c4e-bb20-a493705d193e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb2b949c3a784157a01da46158c05c13'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:17.117676 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-b4106dff-437f-4c4e-bb20-a493705d193e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb2b949c3a784157a01da46158c05c13'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:17.127829 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-b4106dff-437f-4c4e-bb20-a493705d193e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb2b949c3a784157a01da46158c05c13'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:17.135878 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1133/2228] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:36:16 2022] DELETE /identity/v3/users/fb2b949c3a784157a01da46158c05c13 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:36:17.141064 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447bff06-e5c5-4f68-a1a7-5fa4a00b1e96 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:17.141602 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447bff06-e5c5-4f68-a1a7-5fa4a00b1e96 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:17.141715 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447bff06-e5c5-4f68-a1a7-5fa4a00b1e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:17.166859 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-447bff06-e5c5-4f68-a1a7-5fa4a00b1e96 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:36:17.168313 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-447bff06-e5c5-4f68-a1a7-5fa4a00b1e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:17.240233 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1096/2229] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:36:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:36:17.253612 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4106dff-437f-4c4e-bb20-a493705d193e admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:17.255590 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-b4106dff-437f-4c4e-bb20-a493705d193e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:17.355774 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4106dff-437f-4c4e-bb20-a493705d193e admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:17.362458 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6b7450-8a03-484e-811f-f8103beee5ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:17.363265 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b7450-8a03-484e-811f-f8103beee5ce service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:17.363656 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b7450-8a03-484e-811f-f8103beee5ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:17.364259 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b7450-8a03-484e-811f-f8103beee5ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:17.379479 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6b7450-8a03-484e-811f-f8103beee5ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:17.382322 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6b7450-8a03-484e-811f-f8103beee5ce service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:17.394837 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1134/2230] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:36:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:36:17.731586 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447bff06-e5c5-4f68-a1a7-5fa4a00b1e96 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:17.734145 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-447bff06-e5c5-4f68-a1a7-5fa4a00b1e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:17.756739 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447bff06-e5c5-4f68-a1a7-5fa4a00b1e96 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:17.761875 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddc345d-33fa-48fc-8ef7-957082a5d385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:17.763469 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc345d-33fa-48fc-8ef7-957082a5d385 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:17.763742 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc345d-33fa-48fc-8ef7-957082a5d385 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:17.764165 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc345d-33fa-48fc-8ef7-957082a5d385 admin admin] PATH_INFO: `/v3/projects/b8b304316cb840b0a4c5919b5bd695ed` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:17.765810 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddc345d-33fa-48fc-8ef7-957082a5d385 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8b304316cb840b0a4c5919b5bd695ed)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:17.767737 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddc345d-33fa-48fc-8ef7-957082a5d385 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:17.824409 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:17.900384 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-8ddc345d-33fa-48fc-8ef7-957082a5d385 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8b304316cb840b0a4c5919b5bd695ed', 'request_id': 'req-8ddc345d-33fa-48fc-8ef7-957082a5d385'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:17.923059 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-8ddc345d-33fa-48fc-8ef7-957082a5d385 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8b304316cb840b0a4c5919b5bd695ed', 'request_id': 'req-8ddc345d-33fa-48fc-8ef7-957082a5d385'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:17.941656 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-8ddc345d-33fa-48fc-8ef7-957082a5d385 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8b304316cb840b0a4c5919b5bd695ed', 'request_id': 'req-8ddc345d-33fa-48fc-8ef7-957082a5d385'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:17.989259 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-8ddc345d-33fa-48fc-8ef7-957082a5d385 admin admin] The token cache is being invalidate because project b8b304316cb840b0a4c5919b5bd695ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:36:17.989638 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-8ddc345d-33fa-48fc-8ef7-957082a5d385 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:17.991944 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-8ddc345d-33fa-48fc-8ef7-957082a5d385 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:17.993997 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1097/2231] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:36:17 2022] DELETE /identity/v3/projects/b8b304316cb840b0a4c5919b5bd695ed => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:36:17.998652 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6b7450-8a03-484e-811f-f8103beee5ce service neutron] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:18.036071 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6b7450-8a03-484e-811f-f8103beee5ce service neutron] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:18.142797 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:18.162169 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29065ab6-53a0-44f0-af41-3874d87bc95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:18.162673 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29065ab6-53a0-44f0-af41-3874d87bc95b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:18.162968 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29065ab6-53a0-44f0-af41-3874d87bc95b admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:18.163812 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29065ab6-53a0-44f0-af41-3874d87bc95b admin admin] PATH_INFO: `/v3/users/1c9783c3282040c4bfac9d2df21f23ff` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:18.165362 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29065ab6-53a0-44f0-af41-3874d87bc95b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c9783c3282040c4bfac9d2df21f23ff)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:18.171691 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29065ab6-53a0-44f0-af41-3874d87bc95b admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:18.241756 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-29065ab6-53a0-44f0-af41-3874d87bc95b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c9783c3282040c4bfac9d2df21f23ff'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:18.242348 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-29065ab6-53a0-44f0-af41-3874d87bc95b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c9783c3282040c4bfac9d2df21f23ff'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:18.265353 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-29065ab6-53a0-44f0-af41-3874d87bc95b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c9783c3282040c4bfac9d2df21f23ff'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:18.278761 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-29065ab6-53a0-44f0-af41-3874d87bc95b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c9783c3282040c4bfac9d2df21f23ff'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:18.299193 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-29065ab6-53a0-44f0-af41-3874d87bc95b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c9783c3282040c4bfac9d2df21f23ff'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:18.313659 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1135/2232] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:36:17 2022] DELETE /identity/v3/users/1c9783c3282040c4bfac9d2df21f23ff => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:36:18.801183 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddc345d-33fa-48fc-8ef7-957082a5d385 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:18.807120 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-8ddc345d-33fa-48fc-8ef7-957082a5d385 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:18.836452 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddc345d-33fa-48fc-8ef7-957082a5d385 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:18.955035 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320424c4-588d-4958-94f8-61ea444a1a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:18.956585 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320424c4-588d-4958-94f8-61ea444a1a10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:18.957004 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320424c4-588d-4958-94f8-61ea444a1a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:18.957406 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320424c4-588d-4958-94f8-61ea444a1a10 admin admin] PATH_INFO: `/v3/projects/8430311bf9714e8e8cf42bdae1d7f0ff` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:18.959250 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320424c4-588d-4958-94f8-61ea444a1a10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8430311bf9714e8e8cf42bdae1d7f0ff)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:18.961749 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320424c4-588d-4958-94f8-61ea444a1a10 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:19.034194 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c998074d-4dcb-4879-900a-8dab8f789077 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:19.034774 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c998074d-4dcb-4879-900a-8dab8f789077 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:19.039329 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c998074d-4dcb-4879-900a-8dab8f789077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:19.054612 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-320424c4-588d-4958-94f8-61ea444a1a10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8430311bf9714e8e8cf42bdae1d7f0ff', 'request_id': 'req-320424c4-588d-4958-94f8-61ea444a1a10'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:19.064122 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-320424c4-588d-4958-94f8-61ea444a1a10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8430311bf9714e8e8cf42bdae1d7f0ff', 'request_id': 'req-320424c4-588d-4958-94f8-61ea444a1a10'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:19.073888 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-320424c4-588d-4958-94f8-61ea444a1a10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8430311bf9714e8e8cf42bdae1d7f0ff', 'request_id': 'req-320424c4-588d-4958-94f8-61ea444a1a10'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:19.093299 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-320424c4-588d-4958-94f8-61ea444a1a10 admin admin] The token cache is being invalidate because project 8430311bf9714e8e8cf42bdae1d7f0ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:36:19.093736 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-320424c4-588d-4958-94f8-61ea444a1a10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:19.094603 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-320424c4-588d-4958-94f8-61ea444a1a10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:19.096787 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1098/2233] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:36:18 2022] DELETE /identity/v3/projects/8430311bf9714e8e8cf42bdae1d7f0ff => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:36:19.100785 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-c998074d-4dcb-4879-900a-8dab8f789077 None None] MFA Rules not processed for user `56cb1c16dec440388b3527abedbfc90a`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:36:19.101629 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89e9e2-6000-4263-99b0-384de04f0358 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:19.101920 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89e9e2-6000-4263-99b0-384de04f0358 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:19.102301 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89e9e2-6000-4263-99b0-384de04f0358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:19.104498 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-c998074d-4dcb-4879-900a-8dab8f789077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:19.129092 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-5c89e9e2-6000-4263-99b0-384de04f0358 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:36:19.130638 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-5c89e9e2-6000-4263-99b0-384de04f0358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:19.199764 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:19.217286 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1136/2234] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:36:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:36:19.221371 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c998074d-4dcb-4879-900a-8dab8f789077 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:19.223812 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-c998074d-4dcb-4879-900a-8dab8f789077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:19.236039 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1099/2235] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:36:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:36:19.243302 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d1d96-b852-4ad7-b2d0-dbea722d0bef None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:19.244196 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d1d96-b852-4ad7-b2d0-dbea722d0bef None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:19.244495 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d1d96-b852-4ad7-b2d0-dbea722d0bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:19.268285 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-ce8d1d96-b852-4ad7-b2d0-dbea722d0bef None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:36:19.269590 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-ce8d1d96-b852-4ad7-b2d0-dbea722d0bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:19.278198 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1100/2236] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:36:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:36:19.282525 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8d1d96-b852-4ad7-b2d0-dbea722d0bef None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:19.297506 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8d1d96-b852-4ad7-b2d0-dbea722d0bef None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:19.302877 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05706e9d-0fb9-4c3c-a2d1-2183509bd12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:19.303803 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05706e9d-0fb9-4c3c-a2d1-2183509bd12b admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:19.304107 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05706e9d-0fb9-4c3c-a2d1-2183509bd12b admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:19.304373 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05706e9d-0fb9-4c3c-a2d1-2183509bd12b admin admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:19.305835 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05706e9d-0fb9-4c3c-a2d1-2183509bd12b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:36:19.306153 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05706e9d-0fb9-4c3c-a2d1-2183509bd12b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:19.308332 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05706e9d-0fb9-4c3c-a2d1-2183509bd12b admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:19.309896 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c998074d-4dcb-4879-900a-8dab8f789077 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:19.318134 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b1d36-1bbc-4add-9e44-a3cbdef704f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:19.318816 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b1d36-1bbc-4add-9e44-a3cbdef704f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:19.319103 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b1d36-1bbc-4add-9e44-a3cbdef704f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:19.320266 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b1d36-1bbc-4add-9e44-a3cbdef704f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:19.320711 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7b1d36-1bbc-4add-9e44-a3cbdef704f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:19.323453 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7b1d36-1bbc-4add-9e44-a3cbdef704f8 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:19.325335 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1101/2237] 10.222.0.26 () {58 vars in 1152 bytes} [Fri Jul 1 19:36:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:36:19.329493 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:19.329624 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05706e9d-0fb9-4c3c-a2d1-2183509bd12b admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:19.344691 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05706e9d-0fb9-4c3c-a2d1-2183509bd12b admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:19.351832 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b140acaf-46d4-4625-bd14-d11a8f01c6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:19.352508 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b140acaf-46d4-4625-bd14-d11a8f01c6f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:19.352822 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b140acaf-46d4-4625-bd14-d11a8f01c6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:19.353012 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b140acaf-46d4-4625-bd14-d11a8f01c6f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:19.353985 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b140acaf-46d4-4625-bd14-d11a8f01c6f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:19.360790 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b140acaf-46d4-4625-bd14-d11a8f01c6f1 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:19.372601 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1137/2238] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:36:19 2022] POST /identity/v3/projects => generated 371 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:36:19.374066 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b1d36-1bbc-4add-9e44-a3cbdef704f8 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:19.407892 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1102/2239] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:36:19 2022] POST /identity/v3/projects => generated 409 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:36:19.412510 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b140acaf-46d4-4625-bd14-d11a8f01c6f1 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:19.472450 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b1d36-1bbc-4add-9e44-a3cbdef704f8 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:19.518956 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b140acaf-46d4-4625-bd14-d11a8f01c6f1 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:19.523748 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59578a53-141c-4604-93b4-286c042148ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:19.524359 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59578a53-141c-4604-93b4-286c042148ed admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:19.524646 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59578a53-141c-4604-93b4-286c042148ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:19.525265 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59578a53-141c-4604-93b4-286c042148ed admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:19.526299 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59578a53-141c-4604-93b4-286c042148ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:19.528857 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59578a53-141c-4604-93b4-286c042148ed admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:19.560785 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1103/2240] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:36:19 2022] POST /identity/v3/users => generated 305 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:36:19.562069 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59578a53-141c-4604-93b4-286c042148ed admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:19.576407 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59578a53-141c-4604-93b4-286c042148ed admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:19.584370 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1f2df0-10ea-412d-b233-b9a971b0b6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:19.585208 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f2df0-10ea-412d-b233-b9a971b0b6e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:19.585714 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f2df0-10ea-412d-b233-b9a971b0b6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:19.586102 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f2df0-10ea-412d-b233-b9a971b0b6e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:19.587141 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1f2df0-10ea-412d-b233-b9a971b0b6e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:19.592414 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1f2df0-10ea-412d-b233-b9a971b0b6e1 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:19.605111 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1104/2241] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:36:19 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 19:36:19.610163 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1f2df0-10ea-412d-b233-b9a971b0b6e1 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:19.627935 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f248c04c-3ee7-4a72-8ab3-bc0b9bad1f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:19.628638 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f248c04c-3ee7-4a72-8ab3-bc0b9bad1f67 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:19.629026 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f248c04c-3ee7-4a72-8ab3-bc0b9bad1f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:19.638893 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f248c04c-3ee7-4a72-8ab3-bc0b9bad1f67 admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:19.638893 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f248c04c-3ee7-4a72-8ab3-bc0b9bad1f67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:19.638893 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f248c04c-3ee7-4a72-8ab3-bc0b9bad1f67 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:19.649577 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1f2df0-10ea-412d-b233-b9a971b0b6e1 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:19.667651 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1660b297-5120-41f8-8634-07bf780af3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:19.669671 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660b297-5120-41f8-8634-07bf780af3d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:19.671763 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660b297-5120-41f8-8634-07bf780af3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:19.672782 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660b297-5120-41f8-8634-07bf780af3d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:19.673836 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1660b297-5120-41f8-8634-07bf780af3d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:19.677344 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1660b297-5120-41f8-8634-07bf780af3d2 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:19.684513 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1138/2242] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:36:19 2022] POST /identity/v3/users => generated 292 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 19:36:19.685848 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f248c04c-3ee7-4a72-8ab3-bc0b9bad1f67 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:19.697577 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f248c04c-3ee7-4a72-8ab3-bc0b9bad1f67 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:19.699206 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1105/2243] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:36:19 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 19:36:19.703114 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1660b297-5120-41f8-8634-07bf780af3d2 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:19.707870 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f08245c-7ed7-46a9-8a52-720300adbdcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:19.708672 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f08245c-7ed7-46a9-8a52-720300adbdcc admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:19.708834 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f08245c-7ed7-46a9-8a52-720300adbdcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:19.709121 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f08245c-7ed7-46a9-8a52-720300adbdcc admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:19.710752 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f08245c-7ed7-46a9-8a52-720300adbdcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:19.717302 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1660b297-5120-41f8-8634-07bf780af3d2 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:19.718154 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f08245c-7ed7-46a9-8a52-720300adbdcc admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:19.723534 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f4174-c755-4924-942a-f1ffd1862e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:19.724435 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f4174-c755-4924-942a-f1ffd1862e28 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:19.724717 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f4174-c755-4924-942a-f1ffd1862e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:19.724993 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f4174-c755-4924-942a-f1ffd1862e28 admin admin] PATH_INFO: `/v3/projects/a091eee2e9c8443099c2f70a1a2752f9/users/4a809be5e37143c6b0aa2d8b8ecaf258/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:19.743170 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6f4174-c755-4924-942a-f1ffd1862e28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a091eee2e9c8443099c2f70a1a2752f9, user_id=4a809be5e37143c6b0aa2d8b8ecaf258, role_id=4cbf6ec846eb4b7c8cc52e9bfd6f076f)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:19.746053 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6f4174-c755-4924-942a-f1ffd1862e28 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:19.748041 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1139/2244] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:36:19 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:36:19.752817 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f08245c-7ed7-46a9-8a52-720300adbdcc admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:19.767176 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1106/2245] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:36:19 2022] PUT /identity/v3/projects/a091eee2e9c8443099c2f70a1a2752f9/users/4a809be5e37143c6b0aa2d8b8ecaf258/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:36:19.769663 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f08245c-7ed7-46a9-8a52-720300adbdcc admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:19.780708 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69557d19-5ab2-4d8d-9493-1c20b97c4408 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:19.781345 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69557d19-5ab2-4d8d-9493-1c20b97c4408 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:19.785430 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69557d19-5ab2-4d8d-9493-1c20b97c4408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:19.825571 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-69557d19-5ab2-4d8d-9493-1c20b97c4408 None None] MFA Rules not processed for user `4a809be5e37143c6b0aa2d8b8ecaf258`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:36:19.827639 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-69557d19-5ab2-4d8d-9493-1c20b97c4408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:19.869443 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729ed439-5990-423f-b735-27022c8d0d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:19.870693 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729ed439-5990-423f-b735-27022c8d0d91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:19.871082 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729ed439-5990-423f-b735-27022c8d0d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:19.872558 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729ed439-5990-423f-b735-27022c8d0d91 admin admin] PATH_INFO: `/v3/projects/139e19674ff14b6eb16b1ef60b9453e6/users/ab6b3f8513874ea3b87e5a4511360eb8/roles/6cb03785fb184ef587509b3174622f69` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:19.883270 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:19.901004 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729ed439-5990-423f-b735-27022c8d0d91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=139e19674ff14b6eb16b1ef60b9453e6, user_id=ab6b3f8513874ea3b87e5a4511360eb8, role_id=6cb03785fb184ef587509b3174622f69)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:19.904847 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729ed439-5990-423f-b735-27022c8d0d91 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:19.908396 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:19.926713 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1107/2246] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:36:19 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:36:19.927112 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1140/2247] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:36:19 2022] PUT /identity/v3/projects/139e19674ff14b6eb16b1ef60b9453e6/users/ab6b3f8513874ea3b87e5a4511360eb8/roles/6cb03785fb184ef587509b3174622f69 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:36:19.931417 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69557d19-5ab2-4d8d-9493-1c20b97c4408 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:19.931552 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729ed439-5990-423f-b735-27022c8d0d91 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:19.943389 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69557d19-5ab2-4d8d-9493-1c20b97c4408 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:20.038645 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729ed439-5990-423f-b735-27022c8d0d91 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:20.043951 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99c9d60-02bd-4c09-82b0-6b07c2ff68ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:20.047055 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb6f878-710c-4119-8596-59ef42d323c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:20.048326 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6f878-710c-4119-8596-59ef42d323c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:20.048326 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6f878-710c-4119-8596-59ef42d323c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:20.048711 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6f878-710c-4119-8596-59ef42d323c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:20.049064 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c9d60-02bd-4c09-82b0-6b07c2ff68ea admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:20.049592 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb6f878-710c-4119-8596-59ef42d323c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:20.050037 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c9d60-02bd-4c09-82b0-6b07c2ff68ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:20.050521 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c9d60-02bd-4c09-82b0-6b07c2ff68ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:20.051854 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb6f878-710c-4119-8596-59ef42d323c0 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:20.052937 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99c9d60-02bd-4c09-82b0-6b07c2ff68ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:20.056093 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99c9d60-02bd-4c09-82b0-6b07c2ff68ea admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:20.070760 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1108/2248] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:36:19 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:36:20.071628 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99c9d60-02bd-4c09-82b0-6b07c2ff68ea admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:20.081268 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1141/2249] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:36:19 2022] POST /identity/v3/projects => generated 407 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:36:20.083289 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb6f878-710c-4119-8596-59ef42d323c0 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:20.101840 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99c9d60-02bd-4c09-82b0-6b07c2ff68ea admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:20.164501 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb6f878-710c-4119-8596-59ef42d323c0 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:20.172634 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c322229-0103-4941-8cd8-04d1889833e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:20.173364 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c322229-0103-4941-8cd8-04d1889833e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:20.173656 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c322229-0103-4941-8cd8-04d1889833e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:20.173941 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c322229-0103-4941-8cd8-04d1889833e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:20.174808 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c322229-0103-4941-8cd8-04d1889833e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:20.176835 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c322229-0103-4941-8cd8-04d1889833e3 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:20.180489 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a9b8f3-32b6-4274-900e-0546d5fac748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:20.181426 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a9b8f3-32b6-4274-900e-0546d5fac748 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:20.181748 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a9b8f3-32b6-4274-900e-0546d5fac748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:20.181989 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a9b8f3-32b6-4274-900e-0546d5fac748 admin admin] PATH_INFO: `/v3/projects/139e19674ff14b6eb16b1ef60b9453e6/users/ab6b3f8513874ea3b87e5a4511360eb8/roles/6cb03785fb184ef587509b3174622f69` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:20.184611 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a9b8f3-32b6-4274-900e-0546d5fac748 admin admin] RBAC: Authorizing `identity:create_grant(project_id=139e19674ff14b6eb16b1ef60b9453e6, user_id=ab6b3f8513874ea3b87e5a4511360eb8, role_id=6cb03785fb184ef587509b3174622f69)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:20.187470 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a9b8f3-32b6-4274-900e-0546d5fac748 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:20.207939 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1109/2250] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:36:20 2022] PUT /identity/v3/projects/139e19674ff14b6eb16b1ef60b9453e6/users/ab6b3f8513874ea3b87e5a4511360eb8/roles/6cb03785fb184ef587509b3174622f69 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:36:20.208349 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1142/2251] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:36:20 2022] POST /identity/v3/users => generated 310 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:36:20.209000 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a9b8f3-32b6-4274-900e-0546d5fac748 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:20.318326 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a9b8f3-32b6-4274-900e-0546d5fac748 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:20.327082 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e0f638-5034-4591-9edb-da8f185f0f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:20.328154 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e0f638-5034-4591-9edb-da8f185f0f39 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:20.328724 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e0f638-5034-4591-9edb-da8f185f0f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:20.329072 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e0f638-5034-4591-9edb-da8f185f0f39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:20.330055 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e0f638-5034-4591-9edb-da8f185f0f39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:20.333129 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e0f638-5034-4591-9edb-da8f185f0f39 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:20.350145 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1110/2252] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:36:20 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 19:36:20.353505 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c322229-0103-4941-8cd8-04d1889833e3 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:20.363935 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c322229-0103-4941-8cd8-04d1889833e3 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:20.369759 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd4ad01-2f80-4b21-a3f9-7791c87e5506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:20.370068 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4ad01-2f80-4b21-a3f9-7791c87e5506 admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:20.370329 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4ad01-2f80-4b21-a3f9-7791c87e5506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:20.370607 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4ad01-2f80-4b21-a3f9-7791c87e5506 admin admin] PATH_INFO: `/v3/projects/1e35a2457c4e40f5beb6bdbf7e1d264d/users/1e36c84a3f2e4829beb07294c6cfe108/roles/6cb03785fb184ef587509b3174622f69` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:20.399570 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd4ad01-2f80-4b21-a3f9-7791c87e5506 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e35a2457c4e40f5beb6bdbf7e1d264d, user_id=1e36c84a3f2e4829beb07294c6cfe108, role_id=6cb03785fb184ef587509b3174622f69)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:20.403728 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd4ad01-2f80-4b21-a3f9-7791c87e5506 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:20.428823 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1143/2253] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:36:20 2022] PUT /identity/v3/projects/1e35a2457c4e40f5beb6bdbf7e1d264d/users/1e36c84a3f2e4829beb07294c6cfe108/roles/6cb03785fb184ef587509b3174622f69 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:36:20.430287 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e0f638-5034-4591-9edb-da8f185f0f39 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:20.436723 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:20.442840 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e0f638-5034-4591-9edb-da8f185f0f39 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:20.569498 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a44041-1175-42c1-9a28-a32239137474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:20.570474 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a44041-1175-42c1-9a28-a32239137474 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:20.570763 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a44041-1175-42c1-9a28-a32239137474 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:20.571038 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a44041-1175-42c1-9a28-a32239137474 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:20.571919 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a44041-1175-42c1-9a28-a32239137474 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:20.573879 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a44041-1175-42c1-9a28-a32239137474 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:20.656863 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1111/2254] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:36:20 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:36:20.660892 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd4ad01-2f80-4b21-a3f9-7791c87e5506 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:20.675572 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd4ad01-2f80-4b21-a3f9-7791c87e5506 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:20.687487 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a73313-45d9-4c2d-aa60-3790ca5328fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:20.689660 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a73313-45d9-4c2d-aa60-3790ca5328fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:20.690355 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a73313-45d9-4c2d-aa60-3790ca5328fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:20.690969 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a73313-45d9-4c2d-aa60-3790ca5328fd admin admin] PATH_INFO: `/v3/projects/1e35a2457c4e40f5beb6bdbf7e1d264d/users/1e36c84a3f2e4829beb07294c6cfe108/roles/6cb03785fb184ef587509b3174622f69` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:20.697874 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a73313-45d9-4c2d-aa60-3790ca5328fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e35a2457c4e40f5beb6bdbf7e1d264d, user_id=1e36c84a3f2e4829beb07294c6cfe108, role_id=6cb03785fb184ef587509b3174622f69)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:20.710273 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a73313-45d9-4c2d-aa60-3790ca5328fd admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:20.727267 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1144/2255] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:36:20 2022] PUT /identity/v3/projects/1e35a2457c4e40f5beb6bdbf7e1d264d/users/1e36c84a3f2e4829beb07294c6cfe108/roles/6cb03785fb184ef587509b3174622f69 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:36:20.739267 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe0962-324c-4da6-b5ec-5bcdfea43f30 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:20.739573 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe0962-324c-4da6-b5ec-5bcdfea43f30 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:20.739956 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe0962-324c-4da6-b5ec-5bcdfea43f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:20.812907 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-26fe0962-324c-4da6-b5ec-5bcdfea43f30 None None] MFA Rules not processed for user `1e36c84a3f2e4829beb07294c6cfe108`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:36:20.815194 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-26fe0962-324c-4da6-b5ec-5bcdfea43f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:20.962726 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1112/2256] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:36:20 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:36:20.975366 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a73313-45d9-4c2d-aa60-3790ca5328fd admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:20.977471 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-91a73313-45d9-4c2d-aa60-3790ca5328fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:21.055379 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:21.100339 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a73313-45d9-4c2d-aa60-3790ca5328fd admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:21.110883 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10889b88-050c-4c8d-a48a-7c8e332a0591 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a3ed285ee4c4d04abf7daf0aeb9fb7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:21.111786 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10889b88-050c-4c8d-a48a-7c8e332a0591 service cinder] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:21.112268 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10889b88-050c-4c8d-a48a-7c8e332a0591 service cinder] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:21.113572 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10889b88-050c-4c8d-a48a-7c8e332a0591 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:21.124881 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10889b88-050c-4c8d-a48a-7c8e332a0591 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:21.126455 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10889b88-050c-4c8d-a48a-7c8e332a0591 service cinder] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:21.137301 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1145/2257] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:36:20 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:36:21.415724 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fe0962-324c-4da6-b5ec-5bcdfea43f30 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:21.434075 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fe0962-324c-4da6-b5ec-5bcdfea43f30 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:21.439217 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6224783-1d2b-4a1b-b112-7de958936b81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a3ed285ee4c4d04abf7daf0aeb9fb7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:21.439895 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6224783-1d2b-4a1b-b112-7de958936b81 service cinder] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:21.440228 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6224783-1d2b-4a1b-b112-7de958936b81 service cinder] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:21.440506 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6224783-1d2b-4a1b-b112-7de958936b81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:21.550780 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6224783-1d2b-4a1b-b112-7de958936b81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:21.552028 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6224783-1d2b-4a1b-b112-7de958936b81 service cinder] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:21.571400 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1113/2258] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:36:21 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:36:21.955488 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10889b88-050c-4c8d-a48a-7c8e332a0591 service cinder] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:21.961673 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-10889b88-050c-4c8d-a48a-7c8e332a0591 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:22.126737 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10889b88-050c-4c8d-a48a-7c8e332a0591 service cinder] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:22.149778 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2effa960-76b8-4fe5-bdf4-49ee04d80a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:22.156197 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effa960-76b8-4fe5-bdf4-49ee04d80a9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:22.157518 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effa960-76b8-4fe5-bdf4-49ee04d80a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:22.158876 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effa960-76b8-4fe5-bdf4-49ee04d80a9c admin admin] PATH_INFO: `/v3/users/9660d5d1b7894924a3e0e70a08a34775` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:22.166661 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2effa960-76b8-4fe5-bdf4-49ee04d80a9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9660d5d1b7894924a3e0e70a08a34775)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:22.170270 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2effa960-76b8-4fe5-bdf4-49ee04d80a9c admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:22.261114 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-2effa960-76b8-4fe5-bdf4-49ee04d80a9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9660d5d1b7894924a3e0e70a08a34775'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:22.262083 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-2effa960-76b8-4fe5-bdf4-49ee04d80a9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9660d5d1b7894924a3e0e70a08a34775'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:22.290180 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-2effa960-76b8-4fe5-bdf4-49ee04d80a9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9660d5d1b7894924a3e0e70a08a34775'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:22.312079 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-2effa960-76b8-4fe5-bdf4-49ee04d80a9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9660d5d1b7894924a3e0e70a08a34775'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:22.322611 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-2effa960-76b8-4fe5-bdf4-49ee04d80a9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9660d5d1b7894924a3e0e70a08a34775'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:22.333029 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1146/2259] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:36:21 2022] DELETE /identity/v3/users/9660d5d1b7894924a3e0e70a08a34775 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:36:22.335216 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274fffa5-75fb-4f6d-be7c-ca89df35f2b5 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:22.335708 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274fffa5-75fb-4f6d-be7c-ca89df35f2b5 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:22.335992 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274fffa5-75fb-4f6d-be7c-ca89df35f2b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:22.368587 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-274fffa5-75fb-4f6d-be7c-ca89df35f2b5 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:36:22.375841 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-274fffa5-75fb-4f6d-be7c-ca89df35f2b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:22.401292 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:22.477980 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1114/2260] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:36:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:36:22.487446 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2effa960-76b8-4fe5-bdf4-49ee04d80a9c admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:22.489694 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-2effa960-76b8-4fe5-bdf4-49ee04d80a9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:22.644402 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2effa960-76b8-4fe5-bdf4-49ee04d80a9c admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:22.653723 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d230bd-001e-4fe4-8d37-38bdf51cac84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:22.654404 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d230bd-001e-4fe4-8d37-38bdf51cac84 service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:22.654694 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d230bd-001e-4fe4-8d37-38bdf51cac84 service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:22.654973 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d230bd-001e-4fe4-8d37-38bdf51cac84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:22.683850 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d230bd-001e-4fe4-8d37-38bdf51cac84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:22.685984 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d230bd-001e-4fe4-8d37-38bdf51cac84 service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:22.692037 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:22.709488 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1147/2261] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:36:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:36:23.121082 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274fffa5-75fb-4f6d-be7c-ca89df35f2b5 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:23.123055 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-274fffa5-75fb-4f6d-be7c-ca89df35f2b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:23.158190 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274fffa5-75fb-4f6d-be7c-ca89df35f2b5 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:23.165177 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260fa4a5-a36b-4adb-afe8-0b36b165b029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:23.166744 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260fa4a5-a36b-4adb-afe8-0b36b165b029 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:23.167036 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260fa4a5-a36b-4adb-afe8-0b36b165b029 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:23.167376 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260fa4a5-a36b-4adb-afe8-0b36b165b029 admin admin] PATH_INFO: `/v3/projects/11c8653e50f64c36bef57daf1f0f84a4` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:23.169518 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260fa4a5-a36b-4adb-afe8-0b36b165b029 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11c8653e50f64c36bef57daf1f0f84a4)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:23.172506 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260fa4a5-a36b-4adb-afe8-0b36b165b029 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:23.287858 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-260fa4a5-a36b-4adb-afe8-0b36b165b029 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11c8653e50f64c36bef57daf1f0f84a4', 'request_id': 'req-260fa4a5-a36b-4adb-afe8-0b36b165b029'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:23.299123 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-260fa4a5-a36b-4adb-afe8-0b36b165b029 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11c8653e50f64c36bef57daf1f0f84a4', 'request_id': 'req-260fa4a5-a36b-4adb-afe8-0b36b165b029'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:23.315532 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-260fa4a5-a36b-4adb-afe8-0b36b165b029 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11c8653e50f64c36bef57daf1f0f84a4', 'request_id': 'req-260fa4a5-a36b-4adb-afe8-0b36b165b029'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:23.334820 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-260fa4a5-a36b-4adb-afe8-0b36b165b029 admin admin] The token cache is being invalidate because project 11c8653e50f64c36bef57daf1f0f84a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:36:23.334958 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-260fa4a5-a36b-4adb-afe8-0b36b165b029 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:23.335679 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-260fa4a5-a36b-4adb-afe8-0b36b165b029 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:23.339309 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1115/2262] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:36:23 2022] DELETE /identity/v3/projects/11c8653e50f64c36bef57daf1f0f84a4 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:36:23.343484 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d230bd-001e-4fe4-8d37-38bdf51cac84 service neutron] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:23.358785 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d230bd-001e-4fe4-8d37-38bdf51cac84 service neutron] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:23.488323 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f79f3f-0900-40e9-9661-97c67ee50d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:23.490454 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f79f3f-0900-40e9-9661-97c67ee50d0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:23.491084 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f79f3f-0900-40e9-9661-97c67ee50d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:23.491204 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f79f3f-0900-40e9-9661-97c67ee50d0e admin admin] PATH_INFO: `/v3/users/512f478615bd43c1840ec7d6ef0b5b6f` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:23.492759 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f79f3f-0900-40e9-9661-97c67ee50d0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=512f478615bd43c1840ec7d6ef0b5b6f)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:23.494856 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f79f3f-0900-40e9-9661-97c67ee50d0e admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:23.626415 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-81f79f3f-0900-40e9-9661-97c67ee50d0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '512f478615bd43c1840ec7d6ef0b5b6f'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:23.627409 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-81f79f3f-0900-40e9-9661-97c67ee50d0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '512f478615bd43c1840ec7d6ef0b5b6f'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:23.668019 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-81f79f3f-0900-40e9-9661-97c67ee50d0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '512f478615bd43c1840ec7d6ef0b5b6f'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:23.698876 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-81f79f3f-0900-40e9-9661-97c67ee50d0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '512f478615bd43c1840ec7d6ef0b5b6f'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:23.719975 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-81f79f3f-0900-40e9-9661-97c67ee50d0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '512f478615bd43c1840ec7d6ef0b5b6f'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:23.731315 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1148/2263] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:36:23 2022] DELETE /identity/v3/users/512f478615bd43c1840ec7d6ef0b5b6f => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:36:25.095200 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260fa4a5-a36b-4adb-afe8-0b36b165b029 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:25.096724 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-260fa4a5-a36b-4adb-afe8-0b36b165b029 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:25.124337 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260fa4a5-a36b-4adb-afe8-0b36b165b029 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:25.280567 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53387106-ea80-428b-a984-e2221f419de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:25.281932 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53387106-ea80-428b-a984-e2221f419de4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:25.316805 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53387106-ea80-428b-a984-e2221f419de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:25.319836 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53387106-ea80-428b-a984-e2221f419de4 admin admin] PATH_INFO: `/v3/projects/90fb7629e8e748109e9bbbab91782933` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:25.325690 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53387106-ea80-428b-a984-e2221f419de4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90fb7629e8e748109e9bbbab91782933)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:25.330137 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53387106-ea80-428b-a984-e2221f419de4 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:25.506659 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:25.509438 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-53387106-ea80-428b-a984-e2221f419de4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90fb7629e8e748109e9bbbab91782933', 'request_id': 'req-53387106-ea80-428b-a984-e2221f419de4'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:25.526088 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-53387106-ea80-428b-a984-e2221f419de4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90fb7629e8e748109e9bbbab91782933', 'request_id': 'req-53387106-ea80-428b-a984-e2221f419de4'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:25.538607 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-53387106-ea80-428b-a984-e2221f419de4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90fb7629e8e748109e9bbbab91782933', 'request_id': 'req-53387106-ea80-428b-a984-e2221f419de4'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:25.567205 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-53387106-ea80-428b-a984-e2221f419de4 admin admin] The token cache is being invalidate because project 90fb7629e8e748109e9bbbab91782933 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:36:25.567758 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-53387106-ea80-428b-a984-e2221f419de4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:25.568707 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-53387106-ea80-428b-a984-e2221f419de4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:25.578971 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1116/2264] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:36:25 2022] DELETE /identity/v3/projects/90fb7629e8e748109e9bbbab91782933 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:36:25.585111 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae74bf5a-eef9-4661-b97e-f1a93f7173ae None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:25.585687 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae74bf5a-eef9-4661-b97e-f1a93f7173ae None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:25.585687 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae74bf5a-eef9-4661-b97e-f1a93f7173ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:25.630890 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-ae74bf5a-eef9-4661-b97e-f1a93f7173ae None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:36:25.632163 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-ae74bf5a-eef9-4661-b97e-f1a93f7173ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:25.808803 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1149/2265] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:36:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:36:25.810550 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb270ff-6b81-4425-92c9-f7a002fd9286 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:25.811113 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb270ff-6b81-4425-92c9-f7a002fd9286 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:25.811608 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb270ff-6b81-4425-92c9-f7a002fd9286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:25.834749 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-2eb270ff-6b81-4425-92c9-f7a002fd9286 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:36:25.836709 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-2eb270ff-6b81-4425-92c9-f7a002fd9286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:25.848889 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1117/2266] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:36:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:36:25.853312 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae74bf5a-eef9-4661-b97e-f1a93f7173ae None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:25.882220 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae74bf5a-eef9-4661-b97e-f1a93f7173ae None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:25.899398 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aba7d6-5bef-4c52-acaf-b463b4982ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:25.900459 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aba7d6-5bef-4c52-acaf-b463b4982ba9 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:25.901302 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aba7d6-5bef-4c52-acaf-b463b4982ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:25.901737 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aba7d6-5bef-4c52-acaf-b463b4982ba9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:25.903234 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aba7d6-5bef-4c52-acaf-b463b4982ba9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:36:25.907796 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aba7d6-5bef-4c52-acaf-b463b4982ba9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:25.911055 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aba7d6-5bef-4c52-acaf-b463b4982ba9 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:25.949057 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb270ff-6b81-4425-92c9-f7a002fd9286 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:25.949801 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1150/2267] 10.222.0.26 () {58 vars in 1152 bytes} [Fri Jul 1 19:36:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:36:25.967647 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb270ff-6b81-4425-92c9-f7a002fd9286 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:25.979069 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9575d15b-d516-4f08-8693-99144863d86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:25.979738 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9575d15b-d516-4f08-8693-99144863d86e admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:25.980097 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9575d15b-d516-4f08-8693-99144863d86e admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:25.983067 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9575d15b-d516-4f08-8693-99144863d86e admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:25.983937 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9575d15b-d516-4f08-8693-99144863d86e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:25.989054 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9575d15b-d516-4f08-8693-99144863d86e admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:26.050072 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1118/2268] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:36:25 2022] POST /identity/v3/projects => generated 385 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:36:26.055369 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aba7d6-5bef-4c52-acaf-b463b4982ba9 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:26.068429 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:26.077673 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aba7d6-5bef-4c52-acaf-b463b4982ba9 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:26.208792 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a173ce2f-7e0b-48a4-9942-35efea852685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:26.211455 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173ce2f-7e0b-48a4-9942-35efea852685 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:26.211861 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173ce2f-7e0b-48a4-9942-35efea852685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:26.212313 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173ce2f-7e0b-48a4-9942-35efea852685 admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:26.213859 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a173ce2f-7e0b-48a4-9942-35efea852685 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:26.218341 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a173ce2f-7e0b-48a4-9942-35efea852685 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:26.256311 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1151/2269] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:36:26 2022] POST /identity/v3/users => generated 293 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:36:26.259922 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9575d15b-d516-4f08-8693-99144863d86e admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:26.276831 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9575d15b-d516-4f08-8693-99144863d86e admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:26.283225 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1254c2c-2256-4340-bd35-54d269a95375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:26.284485 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1254c2c-2256-4340-bd35-54d269a95375 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:26.285169 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1254c2c-2256-4340-bd35-54d269a95375 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:26.285627 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1254c2c-2256-4340-bd35-54d269a95375 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:26.286457 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1254c2c-2256-4340-bd35-54d269a95375 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:26.288332 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1254c2c-2256-4340-bd35-54d269a95375 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:26.309149 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1119/2270] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:36:26 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:36:26.312919 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a173ce2f-7e0b-48a4-9942-35efea852685 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:26.324503 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a173ce2f-7e0b-48a4-9942-35efea852685 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:26.332231 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf4a40f-a9da-4ed3-adcb-988416ac2d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:26.334613 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf4a40f-a9da-4ed3-adcb-988416ac2d9c admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:26.334906 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf4a40f-a9da-4ed3-adcb-988416ac2d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:26.335203 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf4a40f-a9da-4ed3-adcb-988416ac2d9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:26.337171 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf4a40f-a9da-4ed3-adcb-988416ac2d9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:26.343505 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf4a40f-a9da-4ed3-adcb-988416ac2d9c admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:26.371962 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1152/2271] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:36:26 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:36:26.373352 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1254c2c-2256-4340-bd35-54d269a95375 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:26.387969 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1254c2c-2256-4340-bd35-54d269a95375 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:26.395146 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c2429f-5432-492f-acd4-fa7c2238ce61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:26.396651 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2429f-5432-492f-acd4-fa7c2238ce61 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:26.397214 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2429f-5432-492f-acd4-fa7c2238ce61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:26.397666 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2429f-5432-492f-acd4-fa7c2238ce61 admin admin] PATH_INFO: `/v3/projects/77435d8b456a4bf6bcd7a35aa731ea8d/users/2024157194214791b7b600b40332da4f/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:26.436731 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c2429f-5432-492f-acd4-fa7c2238ce61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77435d8b456a4bf6bcd7a35aa731ea8d, user_id=2024157194214791b7b600b40332da4f, role_id=4cbf6ec846eb4b7c8cc52e9bfd6f076f)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:26.440064 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c2429f-5432-492f-acd4-fa7c2238ce61 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:26.491152 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1120/2272] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:36:26 2022] PUT /identity/v3/projects/77435d8b456a4bf6bcd7a35aa731ea8d/users/2024157194214791b7b600b40332da4f/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:36:26.502978 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4b7757-6e29-4bb7-908f-2f26a8c25660 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:26.503280 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4b7757-6e29-4bb7-908f-2f26a8c25660 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:26.503620 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4b7757-6e29-4bb7-908f-2f26a8c25660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:26.585648 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-0d4b7757-6e29-4bb7-908f-2f26a8c25660 None None] MFA Rules not processed for user `2024157194214791b7b600b40332da4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:36:26.586914 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-0d4b7757-6e29-4bb7-908f-2f26a8c25660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:26.773130 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1153/2273] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:36:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:36:26.780049 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c2429f-5432-492f-acd4-fa7c2238ce61 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:26.987946 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c2429f-5432-492f-acd4-fa7c2238ce61 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:27.000973 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec13b2f3-6b9d-4c81-8422-c1bca7d673ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:27.001692 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec13b2f3-6b9d-4c81-8422-c1bca7d673ff admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:27.001977 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec13b2f3-6b9d-4c81-8422-c1bca7d673ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:27.002388 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec13b2f3-6b9d-4c81-8422-c1bca7d673ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:27.002936 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec13b2f3-6b9d-4c81-8422-c1bca7d673ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:27.004889 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec13b2f3-6b9d-4c81-8422-c1bca7d673ff admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:27.104273 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1121/2274] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:36:26 2022] POST /identity/v3/projects => generated 383 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:36:27.109394 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4b7757-6e29-4bb7-908f-2f26a8c25660 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:27.130119 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4b7757-6e29-4bb7-908f-2f26a8c25660 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:27.299604 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c66b487-385e-4faf-abf8-d11f3aa4c830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:27.300608 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c66b487-385e-4faf-abf8-d11f3aa4c830 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:27.301054 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c66b487-385e-4faf-abf8-d11f3aa4c830 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:27.301543 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c66b487-385e-4faf-abf8-d11f3aa4c830 admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:27.302413 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c66b487-385e-4faf-abf8-d11f3aa4c830 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:27.304768 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c66b487-385e-4faf-abf8-d11f3aa4c830 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:27.335582 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1154/2275] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:36:27 2022] POST /identity/v3/users => generated 292 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:36:27.341500 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec13b2f3-6b9d-4c81-8422-c1bca7d673ff admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:27.379579 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec13b2f3-6b9d-4c81-8422-c1bca7d673ff admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:27.413861 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cbf3eb-2884-438f-b8d9-8f3024d1c71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:27.414735 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cbf3eb-2884-438f-b8d9-8f3024d1c71b admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:27.415161 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cbf3eb-2884-438f-b8d9-8f3024d1c71b admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:27.415577 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cbf3eb-2884-438f-b8d9-8f3024d1c71b admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:27.416789 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cbf3eb-2884-438f-b8d9-8f3024d1c71b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:27.421558 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cbf3eb-2884-438f-b8d9-8f3024d1c71b admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:27.462590 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1122/2276] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:36:27.467290 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c66b487-385e-4faf-abf8-d11f3aa4c830 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:27.474919 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:27.485803 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c66b487-385e-4faf-abf8-d11f3aa4c830 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:27.522744 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456d3f2-0638-4917-8928-e4a850a5e7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:27.533663 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456d3f2-0638-4917-8928-e4a850a5e7e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:27.534105 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456d3f2-0638-4917-8928-e4a850a5e7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:27.534480 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456d3f2-0638-4917-8928-e4a850a5e7e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:27.535374 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4456d3f2-0638-4917-8928-e4a850a5e7e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:27.548754 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4456d3f2-0638-4917-8928-e4a850a5e7e1 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:27.563665 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1155/2277] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:36:27.567623 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cbf3eb-2884-438f-b8d9-8f3024d1c71b admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:27.579158 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cbf3eb-2884-438f-b8d9-8f3024d1c71b admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:27.602050 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7075d5a4-d1e2-4699-9063-c484594890b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:27.603203 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7075d5a4-d1e2-4699-9063-c484594890b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:27.603428 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7075d5a4-d1e2-4699-9063-c484594890b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:27.604328 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7075d5a4-d1e2-4699-9063-c484594890b5 admin admin] PATH_INFO: `/v3/projects/a351f9cf1a854830907199304bb8e4b3/users/94c31bdb4a2f46c393f160e3e2f1afdc/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:27.629175 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7075d5a4-d1e2-4699-9063-c484594890b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a351f9cf1a854830907199304bb8e4b3, user_id=94c31bdb4a2f46c393f160e3e2f1afdc, role_id=4cbf6ec846eb4b7c8cc52e9bfd6f076f)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:27.636557 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7075d5a4-d1e2-4699-9063-c484594890b5 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:27.660987 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1123/2278] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:36:27 2022] PUT /identity/v3/projects/a351f9cf1a854830907199304bb8e4b3/users/94c31bdb4a2f46c393f160e3e2f1afdc/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:36:27.674009 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3a2d8-dcb6-42d3-b729-26d238fda7a9 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:27.674874 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3a2d8-dcb6-42d3-b729-26d238fda7a9 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:27.675300 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3a2d8-dcb6-42d3-b729-26d238fda7a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:27.724206 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-1ab3a2d8-dcb6-42d3-b729-26d238fda7a9 None None] MFA Rules not processed for user `94c31bdb4a2f46c393f160e3e2f1afdc`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:36:27.729277 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-1ab3a2d8-dcb6-42d3-b729-26d238fda7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:27.890461 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1156/2279] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:36:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:36:27.897818 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7075d5a4-d1e2-4699-9063-c484594890b5 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:27.951093 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:28.022145 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7075d5a4-d1e2-4699-9063-c484594890b5 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:28.033090 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0a775e-258b-44df-ade6-9bfba3fc5821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:28.034923 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a775e-258b-44df-ade6-9bfba3fc5821 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:28.035643 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a775e-258b-44df-ade6-9bfba3fc5821 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:28.035643 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a775e-258b-44df-ade6-9bfba3fc5821 admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:28.036506 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0a775e-258b-44df-ade6-9bfba3fc5821 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:28.039499 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0a775e-258b-44df-ade6-9bfba3fc5821 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:28.107255 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1124/2280] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:36:27 2022] POST /identity/v3/projects => generated 385 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:36:28.111044 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab3a2d8-dcb6-42d3-b729-26d238fda7a9 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:28.136012 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab3a2d8-dcb6-42d3-b729-26d238fda7a9 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:28.238405 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697d06a7-62fc-456d-ad27-2ab4ce66705d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:28.239194 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d06a7-62fc-456d-ad27-2ab4ce66705d admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:28.239376 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d06a7-62fc-456d-ad27-2ab4ce66705d admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:28.239905 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d06a7-62fc-456d-ad27-2ab4ce66705d admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:28.240522 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697d06a7-62fc-456d-ad27-2ab4ce66705d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:28.242659 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697d06a7-62fc-456d-ad27-2ab4ce66705d admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:28.276457 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1157/2281] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:36:28 2022] POST /identity/v3/users => generated 299 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 19:36:28.277956 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0a775e-258b-44df-ade6-9bfba3fc5821 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:28.290452 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0a775e-258b-44df-ade6-9bfba3fc5821 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:28.303163 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d7caa-f096-4eae-9163-0520d35bf2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:28.304244 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d7caa-f096-4eae-9163-0520d35bf2c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:28.304848 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d7caa-f096-4eae-9163-0520d35bf2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:28.305310 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d7caa-f096-4eae-9163-0520d35bf2c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:28.306197 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5d7caa-f096-4eae-9163-0520d35bf2c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:28.311364 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5d7caa-f096-4eae-9163-0520d35bf2c5 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:28.325806 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1125/2282] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:36:28 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:36:28.330020 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697d06a7-62fc-456d-ad27-2ab4ce66705d admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:28.342082 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697d06a7-62fc-456d-ad27-2ab4ce66705d admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:28.356241 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e5f77-bdf5-448e-94d9-d0b8fcaef6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:28.358702 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e5f77-bdf5-448e-94d9-d0b8fcaef6bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:28.359100 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e5f77-bdf5-448e-94d9-d0b8fcaef6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:28.359441 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e5f77-bdf5-448e-94d9-d0b8fcaef6bb admin admin] PATH_INFO: `/v3/projects/d27503efeb1f4031b49d64bcec9e557d/users/583e1e1aa1fe4d7892936d05844a6d4e/roles/6cb03785fb184ef587509b3174622f69` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:28.394066 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484e5f77-bdf5-448e-94d9-d0b8fcaef6bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d27503efeb1f4031b49d64bcec9e557d, user_id=583e1e1aa1fe4d7892936d05844a6d4e, role_id=6cb03785fb184ef587509b3174622f69)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:28.399157 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484e5f77-bdf5-448e-94d9-d0b8fcaef6bb admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:28.423312 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1158/2283] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:36:28 2022] PUT /identity/v3/projects/d27503efeb1f4031b49d64bcec9e557d/users/583e1e1aa1fe4d7892936d05844a6d4e/roles/6cb03785fb184ef587509b3174622f69 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:36:28.427169 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d7caa-f096-4eae-9163-0520d35bf2c5 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:28.445504 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d7caa-f096-4eae-9163-0520d35bf2c5 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:28.691375 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0384837-6b4f-4fde-96cb-35e639d88962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:28.699850 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0384837-6b4f-4fde-96cb-35e639d88962 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:28.700735 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0384837-6b4f-4fde-96cb-35e639d88962 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:28.702883 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0384837-6b4f-4fde-96cb-35e639d88962 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:28.703657 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0384837-6b4f-4fde-96cb-35e639d88962 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:28.705333 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0384837-6b4f-4fde-96cb-35e639d88962 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:28.749392 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1126/2284] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:36:28 2022] GET /identity/v3/roles => generated 1420 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:36:28.751044 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e5f77-bdf5-448e-94d9-d0b8fcaef6bb admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:28.787178 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11652f9c-8d69-4610-9a04-d7325870e304 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:28.787959 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11652f9c-8d69-4610-9a04-d7325870e304 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:28.788464 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11652f9c-8d69-4610-9a04-d7325870e304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:28.790587 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e5f77-bdf5-448e-94d9-d0b8fcaef6bb admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:28.817003 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62baff-bbf0-4b1e-8559-b118db39fee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:28.818509 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62baff-bbf0-4b1e-8559-b118db39fee5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:28.819013 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62baff-bbf0-4b1e-8559-b118db39fee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:28.819491 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62baff-bbf0-4b1e-8559-b118db39fee5 admin admin] PATH_INFO: `/v3/projects/d27503efeb1f4031b49d64bcec9e557d/users/583e1e1aa1fe4d7892936d05844a6d4e/roles/6cb03785fb184ef587509b3174622f69` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:28.836303 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb62baff-bbf0-4b1e-8559-b118db39fee5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d27503efeb1f4031b49d64bcec9e557d, user_id=583e1e1aa1fe4d7892936d05844a6d4e, role_id=6cb03785fb184ef587509b3174622f69)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:28.844556 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb62baff-bbf0-4b1e-8559-b118db39fee5 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:28.861825 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-11652f9c-8d69-4610-9a04-d7325870e304 None None] MFA Rules not processed for user `ab6b3f8513874ea3b87e5a4511360eb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:36:28.865558 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-11652f9c-8d69-4610-9a04-d7325870e304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:28.889004 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1159/2285] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:36:28 2022] PUT /identity/v3/projects/d27503efeb1f4031b49d64bcec9e557d/users/583e1e1aa1fe4d7892936d05844a6d4e/roles/6cb03785fb184ef587509b3174622f69 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:36:28.899154 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef849977-b707-4302-8a9c-3b83fc491601 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:28.899659 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef849977-b707-4302-8a9c-3b83fc491601 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:28.900170 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef849977-b707-4302-8a9c-3b83fc491601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:28.985003 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-ef849977-b707-4302-8a9c-3b83fc491601 None None] MFA Rules not processed for user `583e1e1aa1fe4d7892936d05844a6d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:36:28.987231 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-ef849977-b707-4302-8a9c-3b83fc491601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:29.071894 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1127/2286] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:36:28 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:36:29.079085 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11652f9c-8d69-4610-9a04-d7325870e304 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:29.083058 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-11652f9c-8d69-4610-9a04-d7325870e304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:29.088043 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:29.132173 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:29.232905 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1160/2287] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:36:28 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:36:29.234156 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef849977-b707-4302-8a9c-3b83fc491601 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:29.235744 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-ef849977-b707-4302-8a9c-3b83fc491601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:29.283827 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11652f9c-8d69-4610-9a04-d7325870e304 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:29.295385 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d614ba3-47b1-46b5-9420-aa45a9f18d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:29.298942 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d614ba3-47b1-46b5-9420-aa45a9f18d9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:29.299271 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d614ba3-47b1-46b5-9420-aa45a9f18d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:29.299566 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d614ba3-47b1-46b5-9420-aa45a9f18d9e admin admin] PATH_INFO: `/v3/users/4a809be5e37143c6b0aa2d8b8ecaf258` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:29.301038 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d614ba3-47b1-46b5-9420-aa45a9f18d9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a809be5e37143c6b0aa2d8b8ecaf258)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:29.303085 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d614ba3-47b1-46b5-9420-aa45a9f18d9e admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:29.399518 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-1d614ba3-47b1-46b5-9420-aa45a9f18d9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a809be5e37143c6b0aa2d8b8ecaf258'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:29.400608 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-1d614ba3-47b1-46b5-9420-aa45a9f18d9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a809be5e37143c6b0aa2d8b8ecaf258'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:29.414078 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-1d614ba3-47b1-46b5-9420-aa45a9f18d9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a809be5e37143c6b0aa2d8b8ecaf258'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:29.442154 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-1d614ba3-47b1-46b5-9420-aa45a9f18d9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a809be5e37143c6b0aa2d8b8ecaf258'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:29.445068 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-1d614ba3-47b1-46b5-9420-aa45a9f18d9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a809be5e37143c6b0aa2d8b8ecaf258'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:29.474873 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef849977-b707-4302-8a9c-3b83fc491601 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:29.480271 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1128/2288] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:36:29 2022] DELETE /identity/v3/users/4a809be5e37143c6b0aa2d8b8ecaf258 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:36:29.481837 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d614ba3-47b1-46b5-9420-aa45a9f18d9e admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:29.483209 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-1d614ba3-47b1-46b5-9420-aa45a9f18d9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:29.490631 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959c3587-c5be-4e40-85e9-99c98527d2c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13fd76fc7dd1410b9cde5adbaa6cb2e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:29.503194 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c3587-c5be-4e40-85e9-99c98527d2c1 service nova] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:29.503670 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c3587-c5be-4e40-85e9-99c98527d2c1 service nova] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:29.503799 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c3587-c5be-4e40-85e9-99c98527d2c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:29.506955 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-959c3587-c5be-4e40-85e9-99c98527d2c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:29.640644 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d614ba3-47b1-46b5-9420-aa45a9f18d9e admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:29.644944 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959c3587-c5be-4e40-85e9-99c98527d2c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:29.647066 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959c3587-c5be-4e40-85e9-99c98527d2c1 service nova] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:29.649550 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141f3168-9315-48e2-a45e-0fcd7c47aef0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a3ed285ee4c4d04abf7daf0aeb9fb7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:29.650817 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f3168-9315-48e2-a45e-0fcd7c47aef0 service cinder] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:29.651384 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f3168-9315-48e2-a45e-0fcd7c47aef0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:29.651809 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f3168-9315-48e2-a45e-0fcd7c47aef0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:29.654903 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-141f3168-9315-48e2-a45e-0fcd7c47aef0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:29.658546 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1161/2289] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:36:29 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:36:29.659982 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a960c06-e0c2-4a0d-9151-30d78c9ea5f7 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:29.660234 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a960c06-e0c2-4a0d-9151-30d78c9ea5f7 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:29.660525 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a960c06-e0c2-4a0d-9151-30d78c9ea5f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:29.703627 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-2a960c06-e0c2-4a0d-9151-30d78c9ea5f7 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:36:29.705048 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-2a960c06-e0c2-4a0d-9151-30d78c9ea5f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:29.744175 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:29.770524 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141f3168-9315-48e2-a45e-0fcd7c47aef0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:29.770524 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141f3168-9315-48e2-a45e-0fcd7c47aef0 service cinder] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:29.777998 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1129/2290] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:36:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:36:29.792731 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:29.807498 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1162/2291] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:36:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:36:29.823768 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141f3168-9315-48e2-a45e-0fcd7c47aef0 service cinder] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:29.825757 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-141f3168-9315-48e2-a45e-0fcd7c47aef0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:29.966499 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141f3168-9315-48e2-a45e-0fcd7c47aef0 service cinder] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:29.972052 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53f4ba1-e60d-4e92-94c1-9afee4f8bb71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:29.972716 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f4ba1-e60d-4e92-94c1-9afee4f8bb71 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:29.973006 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f4ba1-e60d-4e92-94c1-9afee4f8bb71 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:29.973318 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f4ba1-e60d-4e92-94c1-9afee4f8bb71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:29.986703 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53f4ba1-e60d-4e92-94c1-9afee4f8bb71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:29.988504 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53f4ba1-e60d-4e92-94c1-9afee4f8bb71 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:30.003082 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1130/2292] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:36:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:36:30.400951 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a960c06-e0c2-4a0d-9151-30d78c9ea5f7 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:30.402813 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-2a960c06-e0c2-4a0d-9151-30d78c9ea5f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:30.427223 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a960c06-e0c2-4a0d-9151-30d78c9ea5f7 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:30.434549 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953e6229-6b66-499d-8236-74055726376b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:30.435430 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e6229-6b66-499d-8236-74055726376b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:30.435716 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e6229-6b66-499d-8236-74055726376b admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:30.436116 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e6229-6b66-499d-8236-74055726376b admin admin] PATH_INFO: `/v3/projects/a091eee2e9c8443099c2f70a1a2752f9` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:30.437411 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953e6229-6b66-499d-8236-74055726376b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a091eee2e9c8443099c2f70a1a2752f9)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:30.439637 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953e6229-6b66-499d-8236-74055726376b admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:30.492284 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-953e6229-6b66-499d-8236-74055726376b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a091eee2e9c8443099c2f70a1a2752f9', 'request_id': 'req-953e6229-6b66-499d-8236-74055726376b'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:30.499990 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-953e6229-6b66-499d-8236-74055726376b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a091eee2e9c8443099c2f70a1a2752f9', 'request_id': 'req-953e6229-6b66-499d-8236-74055726376b'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:30.512639 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-953e6229-6b66-499d-8236-74055726376b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a091eee2e9c8443099c2f70a1a2752f9', 'request_id': 'req-953e6229-6b66-499d-8236-74055726376b'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:30.537420 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-953e6229-6b66-499d-8236-74055726376b admin admin] The token cache is being invalidate because project a091eee2e9c8443099c2f70a1a2752f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:36:30.537718 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-953e6229-6b66-499d-8236-74055726376b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:30.538472 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-953e6229-6b66-499d-8236-74055726376b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:30.540197 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1163/2293] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:36:30 2022] DELETE /identity/v3/projects/a091eee2e9c8443099c2f70a1a2752f9 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:36:30.545842 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53f4ba1-e60d-4e92-94c1-9afee4f8bb71 service neutron] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:30.564133 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53f4ba1-e60d-4e92-94c1-9afee4f8bb71 service neutron] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:30.705571 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e192b7-a452-4feb-af4e-fa3ec0aa2f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:30.706545 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e192b7-a452-4feb-af4e-fa3ec0aa2f7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:30.717361 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e192b7-a452-4feb-af4e-fa3ec0aa2f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:30.717946 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e192b7-a452-4feb-af4e-fa3ec0aa2f7f admin admin] PATH_INFO: `/v3/users/1e36c84a3f2e4829beb07294c6cfe108` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:30.719649 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e192b7-a452-4feb-af4e-fa3ec0aa2f7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e36c84a3f2e4829beb07294c6cfe108)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:30.721955 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e192b7-a452-4feb-af4e-fa3ec0aa2f7f admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:30.778146 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-b8e192b7-a452-4feb-af4e-fa3ec0aa2f7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e36c84a3f2e4829beb07294c6cfe108'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:30.778844 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-b8e192b7-a452-4feb-af4e-fa3ec0aa2f7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e36c84a3f2e4829beb07294c6cfe108'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:30.787190 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-b8e192b7-a452-4feb-af4e-fa3ec0aa2f7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e36c84a3f2e4829beb07294c6cfe108'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:30.798361 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-b8e192b7-a452-4feb-af4e-fa3ec0aa2f7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e36c84a3f2e4829beb07294c6cfe108'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:30.799423 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-b8e192b7-a452-4feb-af4e-fa3ec0aa2f7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e36c84a3f2e4829beb07294c6cfe108'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:30.820687 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1131/2294] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:36:30 2022] DELETE /identity/v3/users/1e36c84a3f2e4829beb07294c6cfe108 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 19:36:31.293304 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a14f01-e732-4043-8f91-8ae5f8396bae None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:31.293817 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a14f01-e732-4043-8f91-8ae5f8396bae None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:31.294133 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a14f01-e732-4043-8f91-8ae5f8396bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:31.335361 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-31a14f01-e732-4043-8f91-8ae5f8396bae None None] MFA Rules not processed for user `56cb1c16dec440388b3527abedbfc90a`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:36:31.342052 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-31a14f01-e732-4043-8f91-8ae5f8396bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:31.419588 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e192b7-a452-4feb-af4e-fa3ec0aa2f7f admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:31.421069 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-b8e192b7-a452-4feb-af4e-fa3ec0aa2f7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:31.448123 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:31.489405 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1164/2295] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:36:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:36:31.567981 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e192b7-a452-4feb-af4e-fa3ec0aa2f7f admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:31.573888 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72832c8-511d-4bf4-b745-526bad810a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:31.575633 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72832c8-511d-4bf4-b745-526bad810a88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:31.575913 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72832c8-511d-4bf4-b745-526bad810a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:31.577151 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72832c8-511d-4bf4-b745-526bad810a88 admin admin] PATH_INFO: `/v3/projects/1e35a2457c4e40f5beb6bdbf7e1d264d` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:31.578654 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72832c8-511d-4bf4-b745-526bad810a88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e35a2457c4e40f5beb6bdbf7e1d264d)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:31.581203 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72832c8-511d-4bf4-b745-526bad810a88 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:31.673477 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f72832c8-511d-4bf4-b745-526bad810a88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e35a2457c4e40f5beb6bdbf7e1d264d', 'request_id': 'req-f72832c8-511d-4bf4-b745-526bad810a88'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:31.680945 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f72832c8-511d-4bf4-b745-526bad810a88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e35a2457c4e40f5beb6bdbf7e1d264d', 'request_id': 'req-f72832c8-511d-4bf4-b745-526bad810a88'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:31.689676 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f72832c8-511d-4bf4-b745-526bad810a88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e35a2457c4e40f5beb6bdbf7e1d264d', 'request_id': 'req-f72832c8-511d-4bf4-b745-526bad810a88'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:31.722730 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f72832c8-511d-4bf4-b745-526bad810a88 admin admin] The token cache is being invalidate because project 1e35a2457c4e40f5beb6bdbf7e1d264d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:36:31.723111 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f72832c8-511d-4bf4-b745-526bad810a88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:31.723942 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f72832c8-511d-4bf4-b745-526bad810a88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:31.727596 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1132/2296] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:36:31 2022] DELETE /identity/v3/projects/1e35a2457c4e40f5beb6bdbf7e1d264d => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:36:31.732955 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787cc47b-fe23-483c-9ce7-d8248206ea0d None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:31.733520 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787cc47b-fe23-483c-9ce7-d8248206ea0d None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:31.734195 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787cc47b-fe23-483c-9ce7-d8248206ea0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:31.766426 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-787cc47b-fe23-483c-9ce7-d8248206ea0d None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:36:31.767691 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-787cc47b-fe23-483c-9ce7-d8248206ea0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:31.905327 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1165/2297] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:36:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:36:31.909101 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41db396-c439-468a-89f1-a44df0a67149 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:31.909772 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41db396-c439-468a-89f1-a44df0a67149 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:31.910651 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41db396-c439-468a-89f1-a44df0a67149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:31.957940 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-e41db396-c439-468a-89f1-a44df0a67149 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:36:31.961514 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-e41db396-c439-468a-89f1-a44df0a67149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:32.009926 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787cc47b-fe23-483c-9ce7-d8248206ea0d None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:32.018748 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1133/2298] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:36:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:36:32.022172 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787cc47b-fe23-483c-9ce7-d8248206ea0d None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:32.028499 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90ecdab-497f-4557-9652-4b2fed4a2813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:32.029183 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ecdab-497f-4557-9652-4b2fed4a2813 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:32.029512 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ecdab-497f-4557-9652-4b2fed4a2813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:32.029796 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ecdab-497f-4557-9652-4b2fed4a2813 admin admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:32.030546 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90ecdab-497f-4557-9652-4b2fed4a2813 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:36:32.030861 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90ecdab-497f-4557-9652-4b2fed4a2813 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:32.033554 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90ecdab-497f-4557-9652-4b2fed4a2813 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:32.065466 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1166/2299] 10.222.0.26 () {58 vars in 1152 bytes} [Fri Jul 1 19:36:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:36:32.066967 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41db396-c439-468a-89f1-a44df0a67149 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:32.086259 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41db396-c439-468a-89f1-a44df0a67149 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:32.091602 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92057ff6-27b9-43ce-b3a6-013e8d6ef755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:32.092333 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92057ff6-27b9-43ce-b3a6-013e8d6ef755 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:32.092627 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92057ff6-27b9-43ce-b3a6-013e8d6ef755 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:32.092908 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92057ff6-27b9-43ce-b3a6-013e8d6ef755 admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:32.093682 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92057ff6-27b9-43ce-b3a6-013e8d6ef755 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:32.099662 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92057ff6-27b9-43ce-b3a6-013e8d6ef755 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:32.147249 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90ecdab-497f-4557-9652-4b2fed4a2813 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:32.149224 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-b90ecdab-497f-4557-9652-4b2fed4a2813 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:32.167182 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1134/2300] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:36:32 2022] POST /identity/v3/projects => generated 375 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 19:36:32.178463 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92057ff6-27b9-43ce-b3a6-013e8d6ef755 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:32.191897 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:32.342656 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90ecdab-497f-4557-9652-4b2fed4a2813 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:32.365741 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92057ff6-27b9-43ce-b3a6-013e8d6ef755 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:32.380098 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e919a-b70c-41b4-abba-75f79d000bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:32.380794 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e919a-b70c-41b4-abba-75f79d000bbf admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:32.381084 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e919a-b70c-41b4-abba-75f79d000bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:32.381546 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e919a-b70c-41b4-abba-75f79d000bbf admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:32.382275 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188e919a-b70c-41b4-abba-75f79d000bbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:32.385639 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188e919a-b70c-41b4-abba-75f79d000bbf admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:32.454088 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1135/2301] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:36:32 2022] POST /identity/v3/users => generated 288 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:36:32.457953 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e919a-b70c-41b4-abba-75f79d000bbf admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:32.467838 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:32.472536 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e919a-b70c-41b4-abba-75f79d000bbf admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:32.489539 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf8123-ada2-473d-8375-9d03747cd119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:32.490408 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf8123-ada2-473d-8375-9d03747cd119 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:32.490750 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf8123-ada2-473d-8375-9d03747cd119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:32.491032 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf8123-ada2-473d-8375-9d03747cd119 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:32.491711 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdf8123-ada2-473d-8375-9d03747cd119 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:32.493958 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdf8123-ada2-473d-8375-9d03747cd119 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:32.522888 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0714da71-4193-4d87-8f93-932bef2d8a33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a3ed285ee4c4d04abf7daf0aeb9fb7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:32.523727 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714da71-4193-4d87-8f93-932bef2d8a33 service cinder] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:32.524244 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714da71-4193-4d87-8f93-932bef2d8a33 service cinder] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:32.524540 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714da71-4193-4d87-8f93-932bef2d8a33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:32.526657 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1136/2302] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:36:32 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 19:36:32.528057 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf8123-ada2-473d-8375-9d03747cd119 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:32.541078 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf8123-ada2-473d-8375-9d03747cd119 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:32.541538 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-0714da71-4193-4d87-8f93-932bef2d8a33 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:32.550684 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7063afcb-4bbf-4c29-9128-f892097363e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:32.552481 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063afcb-4bbf-4c29-9128-f892097363e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:32.553904 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063afcb-4bbf-4c29-9128-f892097363e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:32.554357 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063afcb-4bbf-4c29-9128-f892097363e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:32.555430 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7063afcb-4bbf-4c29-9128-f892097363e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:32.558004 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7063afcb-4bbf-4c29-9128-f892097363e4 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:32.579053 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1137/2303] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:36:32 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:36:32.581132 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7063afcb-4bbf-4c29-9128-f892097363e4 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:32.602067 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7063afcb-4bbf-4c29-9128-f892097363e4 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:32.614227 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a1dc41-c745-4db3-a54f-04568b1cac97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:32.615288 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1dc41-c745-4db3-a54f-04568b1cac97 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:32.615658 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1dc41-c745-4db3-a54f-04568b1cac97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:32.616025 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1dc41-c745-4db3-a54f-04568b1cac97 admin admin] PATH_INFO: `/v3/projects/3b868d9c1b2245d38278cfc9d46a8e72/users/98345aca2dd043aabb524bdc23ac697f/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:32.655939 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a1dc41-c745-4db3-a54f-04568b1cac97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b868d9c1b2245d38278cfc9d46a8e72, user_id=98345aca2dd043aabb524bdc23ac697f, role_id=4cbf6ec846eb4b7c8cc52e9bfd6f076f)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:32.664224 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a1dc41-c745-4db3-a54f-04568b1cac97 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:32.695752 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1138/2304] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:36:32 2022] PUT /identity/v3/projects/3b868d9c1b2245d38278cfc9d46a8e72/users/98345aca2dd043aabb524bdc23ac697f/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:36:32.707449 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de99032f-e21a-481d-8118-d3b6e52e8f10 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:32.708031 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de99032f-e21a-481d-8118-d3b6e52e8f10 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:32.708513 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de99032f-e21a-481d-8118-d3b6e52e8f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:32.715516 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0714da71-4193-4d87-8f93-932bef2d8a33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:32.717050 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0714da71-4193-4d87-8f93-932bef2d8a33 service cinder] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:32.734435 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1167/2305] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:36:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 19:36:32.768045 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-de99032f-e21a-481d-8118-d3b6e52e8f10 None None] MFA Rules not processed for user `98345aca2dd043aabb524bdc23ac697f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:36:32.770710 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-de99032f-e21a-481d-8118-d3b6e52e8f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:32.863920 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1139/2306] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:36:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:36:32.877567 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0714da71-4193-4d87-8f93-932bef2d8a33 service cinder] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:32.879529 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-0714da71-4193-4d87-8f93-932bef2d8a33 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:32.895030 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0714da71-4193-4d87-8f93-932bef2d8a33 service cinder] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:33.013688 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef14f1f5-5261-4d9d-a743-f649db6c3fa6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a3ed285ee4c4d04abf7daf0aeb9fb7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:33.015628 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14f1f5-5261-4d9d-a743-f649db6c3fa6 service cinder] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:33.017477 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14f1f5-5261-4d9d-a743-f649db6c3fa6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:33.029056 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14f1f5-5261-4d9d-a743-f649db6c3fa6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:33.045798 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef14f1f5-5261-4d9d-a743-f649db6c3fa6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:33.047241 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef14f1f5-5261-4d9d-a743-f649db6c3fa6 service cinder] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:33.057641 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1168/2307] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:36:32 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 19:36:33.663029 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de99032f-e21a-481d-8118-d3b6e52e8f10 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:33.686781 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de99032f-e21a-481d-8118-d3b6e52e8f10 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:33.691185 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53516b59-503b-45a6-80c6-74302d1cb523 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a3ed285ee4c4d04abf7daf0aeb9fb7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:33.692097 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53516b59-503b-45a6-80c6-74302d1cb523 service cinder] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:33.692458 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53516b59-503b-45a6-80c6-74302d1cb523 service cinder] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:33.692806 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53516b59-503b-45a6-80c6-74302d1cb523 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:33.696263 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-53516b59-503b-45a6-80c6-74302d1cb523 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:33.707161 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef14f1f5-5261-4d9d-a743-f649db6c3fa6 service cinder] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:33.708667 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-ef14f1f5-5261-4d9d-a743-f649db6c3fa6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:33.767815 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:33.838362 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef14f1f5-5261-4d9d-a743-f649db6c3fa6 service cinder] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:33.844786 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac64510-3fd2-4267-923c-2174c3530ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:33.846259 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac64510-3fd2-4267-923c-2174c3530ed9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:33.846950 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac64510-3fd2-4267-923c-2174c3530ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:33.847379 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac64510-3fd2-4267-923c-2174c3530ed9 admin admin] PATH_INFO: `/v3/users/448cab7166634f4bbc8e682ae21403ab` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:33.852171 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac64510-3fd2-4267-923c-2174c3530ed9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=448cab7166634f4bbc8e682ae21403ab)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:33.856424 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac64510-3fd2-4267-923c-2174c3530ed9 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:33.870783 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53516b59-503b-45a6-80c6-74302d1cb523 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:33.872530 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53516b59-503b-45a6-80c6-74302d1cb523 service cinder] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:33.886604 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1140/2308] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:36:33 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:36:33.967442 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-4ac64510-3fd2-4267-923c-2174c3530ed9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '448cab7166634f4bbc8e682ae21403ab'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:33.971174 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-4ac64510-3fd2-4267-923c-2174c3530ed9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '448cab7166634f4bbc8e682ae21403ab'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:34.002734 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-4ac64510-3fd2-4267-923c-2174c3530ed9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '448cab7166634f4bbc8e682ae21403ab'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:34.012941 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-4ac64510-3fd2-4267-923c-2174c3530ed9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '448cab7166634f4bbc8e682ae21403ab'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:34.028706 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-4ac64510-3fd2-4267-923c-2174c3530ed9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '448cab7166634f4bbc8e682ae21403ab'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:34.037929 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1169/2309] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:36:33 2022] DELETE /identity/v3/users/448cab7166634f4bbc8e682ae21403ab => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:36:34.042180 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a04e8-3c0e-4338-a3fa-aead7a711a76 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:34.042480 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a04e8-3c0e-4338-a3fa-aead7a711a76 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:34.043305 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a04e8-3c0e-4338-a3fa-aead7a711a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:34.068132 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-269a04e8-3c0e-4338-a3fa-aead7a711a76 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:36:34.070135 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-269a04e8-3c0e-4338-a3fa-aead7a711a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:34.128257 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:34.186474 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1141/2310] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:36:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:36:34.187821 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac64510-3fd2-4267-923c-2174c3530ed9 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:34.189323 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-4ac64510-3fd2-4267-923c-2174c3530ed9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:34.266974 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac64510-3fd2-4267-923c-2174c3530ed9 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:34.271645 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8434ba92-94a1-44bb-b75b-5230d1979ab1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:34.281800 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434ba92-94a1-44bb-b75b-5230d1979ab1 service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:34.281800 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434ba92-94a1-44bb-b75b-5230d1979ab1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:34.282347 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434ba92-94a1-44bb-b75b-5230d1979ab1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:34.302081 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8434ba92-94a1-44bb-b75b-5230d1979ab1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:34.303705 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8434ba92-94a1-44bb-b75b-5230d1979ab1 service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:34.315730 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1170/2311] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:36:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:36:34.650243 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269a04e8-3c0e-4338-a3fa-aead7a711a76 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:34.651937 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-269a04e8-3c0e-4338-a3fa-aead7a711a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:34.676584 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269a04e8-3c0e-4338-a3fa-aead7a711a76 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:34.682639 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bafc0c0-052a-4ae6-a814-468246d5e429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:34.684002 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bafc0c0-052a-4ae6-a814-468246d5e429 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:34.684392 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bafc0c0-052a-4ae6-a814-468246d5e429 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:34.684773 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bafc0c0-052a-4ae6-a814-468246d5e429 admin admin] PATH_INFO: `/v3/projects/f5d8f881c3b24329a76a61a1879fe1ec` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:34.686404 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bafc0c0-052a-4ae6-a814-468246d5e429 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5d8f881c3b24329a76a61a1879fe1ec)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:34.689800 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bafc0c0-052a-4ae6-a814-468246d5e429 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:34.831599 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-6bafc0c0-052a-4ae6-a814-468246d5e429 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5d8f881c3b24329a76a61a1879fe1ec', 'request_id': 'req-6bafc0c0-052a-4ae6-a814-468246d5e429'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:34.837999 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-6bafc0c0-052a-4ae6-a814-468246d5e429 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5d8f881c3b24329a76a61a1879fe1ec', 'request_id': 'req-6bafc0c0-052a-4ae6-a814-468246d5e429'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:34.847208 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-6bafc0c0-052a-4ae6-a814-468246d5e429 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5d8f881c3b24329a76a61a1879fe1ec', 'request_id': 'req-6bafc0c0-052a-4ae6-a814-468246d5e429'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:34.865512 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-6bafc0c0-052a-4ae6-a814-468246d5e429 admin admin] The token cache is being invalidate because project f5d8f881c3b24329a76a61a1879fe1ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:36:34.865512 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-6bafc0c0-052a-4ae6-a814-468246d5e429 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:34.865512 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-6bafc0c0-052a-4ae6-a814-468246d5e429 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:34.866676 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1142/2312] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:36:34 2022] DELETE /identity/v3/projects/f5d8f881c3b24329a76a61a1879fe1ec => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:36:34.871355 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b7dc15-3668-4617-8cb0-54e6aea31a0d None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:34.871831 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b7dc15-3668-4617-8cb0-54e6aea31a0d None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:34.872125 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b7dc15-3668-4617-8cb0-54e6aea31a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:34.897607 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-96b7dc15-3668-4617-8cb0-54e6aea31a0d None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:36:34.899100 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-96b7dc15-3668-4617-8cb0-54e6aea31a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:34.960269 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:34.986024 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1171/2313] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:36:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:36:34.987147 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a7ee0-94dc-4542-b163-38a0a9d78f5d None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:34.987520 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a7ee0-94dc-4542-b163-38a0a9d78f5d None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:34.987801 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a7ee0-94dc-4542-b163-38a0a9d78f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:35.012712 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-2a1a7ee0-94dc-4542-b163-38a0a9d78f5d None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:36:35.014247 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-2a1a7ee0-94dc-4542-b163-38a0a9d78f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:35.023013 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1143/2314] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:36:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:36:35.027866 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b7dc15-3668-4617-8cb0-54e6aea31a0d None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:35.038222 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b7dc15-3668-4617-8cb0-54e6aea31a0d None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:35.046165 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbd0cbb-309d-404d-b6a0-c53bab997b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:35.046863 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd0cbb-309d-404d-b6a0-c53bab997b44 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:35.047157 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd0cbb-309d-404d-b6a0-c53bab997b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:35.047448 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd0cbb-309d-404d-b6a0-c53bab997b44 admin admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:35.048204 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbd0cbb-309d-404d-b6a0-c53bab997b44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:36:35.048521 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbd0cbb-309d-404d-b6a0-c53bab997b44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:35.050205 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbd0cbb-309d-404d-b6a0-c53bab997b44 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:35.073323 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1172/2315] 10.222.0.26 () {58 vars in 1152 bytes} [Fri Jul 1 19:36:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:36:35.077951 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a7ee0-94dc-4542-b163-38a0a9d78f5d None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:35.092395 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a7ee0-94dc-4542-b163-38a0a9d78f5d None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:35.098688 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b232785-5c45-4246-a960-3d9aa392a421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:35.099518 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b232785-5c45-4246-a960-3d9aa392a421 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:35.099972 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b232785-5c45-4246-a960-3d9aa392a421 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:35.100479 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b232785-5c45-4246-a960-3d9aa392a421 admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:35.101523 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b232785-5c45-4246-a960-3d9aa392a421 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:35.103605 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b232785-5c45-4246-a960-3d9aa392a421 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:35.157273 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1144/2316] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:36:35 2022] POST /identity/v3/projects => generated 371 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:36:35.162810 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbd0cbb-309d-404d-b6a0-c53bab997b44 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:35.176567 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbd0cbb-309d-404d-b6a0-c53bab997b44 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:35.250845 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d83b5b2-e767-485b-8b3f-a5d698aefbba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:35.251854 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d83b5b2-e767-485b-8b3f-a5d698aefbba admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:35.252140 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d83b5b2-e767-485b-8b3f-a5d698aefbba admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:35.252456 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d83b5b2-e767-485b-8b3f-a5d698aefbba admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:35.253323 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d83b5b2-e767-485b-8b3f-a5d698aefbba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:35.255876 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d83b5b2-e767-485b-8b3f-a5d698aefbba admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:35.286193 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1173/2317] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:36:35 2022] POST /identity/v3/users => generated 286 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:36:35.287229 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b232785-5c45-4246-a960-3d9aa392a421 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:35.299132 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b232785-5c45-4246-a960-3d9aa392a421 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:35.305333 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d777fe7-b8d8-47a4-801a-cbddb0d0c26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:35.306005 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d777fe7-b8d8-47a4-801a-cbddb0d0c26e admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:35.306421 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d777fe7-b8d8-47a4-801a-cbddb0d0c26e admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:35.306715 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d777fe7-b8d8-47a4-801a-cbddb0d0c26e admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:35.307466 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d777fe7-b8d8-47a4-801a-cbddb0d0c26e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:35.309659 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d777fe7-b8d8-47a4-801a-cbddb0d0c26e admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:35.323424 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1145/2318] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:36:35 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 19:36:35.328831 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d83b5b2-e767-485b-8b3f-a5d698aefbba admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:35.342008 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d83b5b2-e767-485b-8b3f-a5d698aefbba admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:35.348686 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510bba24-9f87-4b68-8187-c5289351b7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:35.349507 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510bba24-9f87-4b68-8187-c5289351b7b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:35.349843 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510bba24-9f87-4b68-8187-c5289351b7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:35.350087 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510bba24-9f87-4b68-8187-c5289351b7b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:35.350917 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510bba24-9f87-4b68-8187-c5289351b7b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:35.352754 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510bba24-9f87-4b68-8187-c5289351b7b5 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:35.369286 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1174/2319] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:36:35 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:36:35.381705 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d777fe7-b8d8-47a4-801a-cbddb0d0c26e admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:35.420283 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d777fe7-b8d8-47a4-801a-cbddb0d0c26e admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:35.440217 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4be10f6-3501-4322-a199-f89cbd5eab4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:35.441193 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be10f6-3501-4322-a199-f89cbd5eab4a admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:35.445456 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be10f6-3501-4322-a199-f89cbd5eab4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:35.445456 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be10f6-3501-4322-a199-f89cbd5eab4a admin admin] PATH_INFO: `/v3/projects/83d3525d8b274f83ae25a667c1054511/users/341b677d96534239ab8beae2ca4fbc1a/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:35.468751 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4be10f6-3501-4322-a199-f89cbd5eab4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=83d3525d8b274f83ae25a667c1054511, user_id=341b677d96534239ab8beae2ca4fbc1a, role_id=4cbf6ec846eb4b7c8cc52e9bfd6f076f)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:35.471729 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4be10f6-3501-4322-a199-f89cbd5eab4a admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:35.499836 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1146/2320] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:36:35 2022] PUT /identity/v3/projects/83d3525d8b274f83ae25a667c1054511/users/341b677d96534239ab8beae2ca4fbc1a/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:36:35.510634 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a8481-64fd-4820-81ed-dee56c4b45d6 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:35.512162 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a8481-64fd-4820-81ed-dee56c4b45d6 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:35.512162 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a8481-64fd-4820-81ed-dee56c4b45d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:35.552695 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-854a8481-64fd-4820-81ed-dee56c4b45d6 None None] MFA Rules not processed for user `341b677d96534239ab8beae2ca4fbc1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:36:35.554071 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-854a8481-64fd-4820-81ed-dee56c4b45d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:35.648129 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1175/2321] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:36:35 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:36:35.663858 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4be10f6-3501-4322-a199-f89cbd5eab4a admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:35.665745 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-e4be10f6-3501-4322-a199-f89cbd5eab4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:35.729663 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4be10f6-3501-4322-a199-f89cbd5eab4a admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:35.734108 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0f4c74-2abf-4708-87b7-78d5752b1a87 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bbcb2463f9c46ddaaa247e4876aca48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:35.734781 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f4c74-2abf-4708-87b7-78d5752b1a87 service glance] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:35.735068 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f4c74-2abf-4708-87b7-78d5752b1a87 service glance] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:35.735371 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f4c74-2abf-4708-87b7-78d5752b1a87 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:35.744119 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0f4c74-2abf-4708-87b7-78d5752b1a87 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:35.745590 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0f4c74-2abf-4708-87b7-78d5752b1a87 service glance] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:35.761124 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1147/2322] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:36:35 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 19:36:36.561619 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854a8481-64fd-4820-81ed-dee56c4b45d6 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:36.564363 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-854a8481-64fd-4820-81ed-dee56c4b45d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:36.643374 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:36.685640 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854a8481-64fd-4820-81ed-dee56c4b45d6 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:36.692539 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53fd924-d662-4933-98d9-7d0fdb2c5ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:36.694154 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53fd924-d662-4933-98d9-7d0fdb2c5ebb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:36.694848 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53fd924-d662-4933-98d9-7d0fdb2c5ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:36.695264 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53fd924-d662-4933-98d9-7d0fdb2c5ebb admin admin] PATH_INFO: `/v3/users/98345aca2dd043aabb524bdc23ac697f` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:36.698614 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53fd924-d662-4933-98d9-7d0fdb2c5ebb admin admin] RBAC: Authorizing `identity:delete_user(user_id=98345aca2dd043aabb524bdc23ac697f)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:36.702687 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53fd924-d662-4933-98d9-7d0fdb2c5ebb admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:36.788350 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-e53fd924-d662-4933-98d9-7d0fdb2c5ebb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98345aca2dd043aabb524bdc23ac697f'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:36.789582 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-e53fd924-d662-4933-98d9-7d0fdb2c5ebb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98345aca2dd043aabb524bdc23ac697f'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:36.829982 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-e53fd924-d662-4933-98d9-7d0fdb2c5ebb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98345aca2dd043aabb524bdc23ac697f'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:36.848708 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-e53fd924-d662-4933-98d9-7d0fdb2c5ebb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98345aca2dd043aabb524bdc23ac697f'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:36.887228 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-e53fd924-d662-4933-98d9-7d0fdb2c5ebb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98345aca2dd043aabb524bdc23ac697f'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:36.894355 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1176/2323] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:36:36 2022] DELETE /identity/v3/users/98345aca2dd043aabb524bdc23ac697f => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:36:36.899217 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd01561a-0b20-4f0d-9aa1-33e49807a82a None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:36.899702 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd01561a-0b20-4f0d-9aa1-33e49807a82a None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:36.899947 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd01561a-0b20-4f0d-9aa1-33e49807a82a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:36.909106 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:36.928834 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-bd01561a-0b20-4f0d-9aa1-33e49807a82a None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:36:36.934344 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-bd01561a-0b20-4f0d-9aa1-33e49807a82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:37.023058 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1148/2324] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:36:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:36:37.037790 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53fd924-d662-4933-98d9-7d0fdb2c5ebb admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:37.037790 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-e53fd924-d662-4933-98d9-7d0fdb2c5ebb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:37.094072 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53fd924-d662-4933-98d9-7d0fdb2c5ebb admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:37.097639 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07ff0d5-b456-43f9-b831-82eb94b0945d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:37.098280 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ff0d5-b456-43f9-b831-82eb94b0945d service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:37.098563 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ff0d5-b456-43f9-b831-82eb94b0945d service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:37.098846 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ff0d5-b456-43f9-b831-82eb94b0945d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:37.108362 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07ff0d5-b456-43f9-b831-82eb94b0945d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:37.109867 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07ff0d5-b456-43f9-b831-82eb94b0945d service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:37.119653 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1177/2325] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:36:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:36:37.400745 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd01561a-0b20-4f0d-9aa1-33e49807a82a None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:37.403223 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-bd01561a-0b20-4f0d-9aa1-33e49807a82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:37.416225 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd01561a-0b20-4f0d-9aa1-33e49807a82a None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:37.421829 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc104065-2746-4dc1-a737-8e7850dae19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:37.422696 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc104065-2746-4dc1-a737-8e7850dae19f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:37.422988 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc104065-2746-4dc1-a737-8e7850dae19f admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:37.423271 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc104065-2746-4dc1-a737-8e7850dae19f admin admin] PATH_INFO: `/v3/projects/3b868d9c1b2245d38278cfc9d46a8e72` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:37.424542 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc104065-2746-4dc1-a737-8e7850dae19f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b868d9c1b2245d38278cfc9d46a8e72)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:37.426914 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc104065-2746-4dc1-a737-8e7850dae19f admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:37.482887 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-fc104065-2746-4dc1-a737-8e7850dae19f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b868d9c1b2245d38278cfc9d46a8e72', 'request_id': 'req-fc104065-2746-4dc1-a737-8e7850dae19f'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:37.492524 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-fc104065-2746-4dc1-a737-8e7850dae19f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b868d9c1b2245d38278cfc9d46a8e72', 'request_id': 'req-fc104065-2746-4dc1-a737-8e7850dae19f'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:37.500432 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-fc104065-2746-4dc1-a737-8e7850dae19f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b868d9c1b2245d38278cfc9d46a8e72', 'request_id': 'req-fc104065-2746-4dc1-a737-8e7850dae19f'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:37.516045 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-fc104065-2746-4dc1-a737-8e7850dae19f admin admin] The token cache is being invalidate because project 3b868d9c1b2245d38278cfc9d46a8e72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:36:37.516483 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-fc104065-2746-4dc1-a737-8e7850dae19f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:37.517128 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-fc104065-2746-4dc1-a737-8e7850dae19f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:37.518786 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1149/2326] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:36:37 2022] DELETE /identity/v3/projects/3b868d9c1b2245d38278cfc9d46a8e72 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:36:37.525905 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82aa843-e75f-4ba5-aa7c-f621401b65fd None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:37.526241 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82aa843-e75f-4ba5-aa7c-f621401b65fd None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:37.527381 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82aa843-e75f-4ba5-aa7c-f621401b65fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:37.547684 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-c82aa843-e75f-4ba5-aa7c-f621401b65fd None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:36:37.548908 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-c82aa843-e75f-4ba5-aa7c-f621401b65fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:37.631051 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1178/2327] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:36:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:36:37.639153 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b840175-0768-4317-a074-9c875d821217 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:37.639449 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b840175-0768-4317-a074-9c875d821217 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:37.639740 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b840175-0768-4317-a074-9c875d821217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:37.660307 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-7b840175-0768-4317-a074-9c875d821217 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:36:37.661832 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-7b840175-0768-4317-a074-9c875d821217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:37.673346 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1150/2328] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:36:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:36:37.677774 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82aa843-e75f-4ba5-aa7c-f621401b65fd None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:37.684148 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:37.688836 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82aa843-e75f-4ba5-aa7c-f621401b65fd None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:37.695444 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29433b64-f435-40c0-928f-042f832aee86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:37.696126 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29433b64-f435-40c0-928f-042f832aee86 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:37.696747 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29433b64-f435-40c0-928f-042f832aee86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:37.697022 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29433b64-f435-40c0-928f-042f832aee86 admin admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:37.697913 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29433b64-f435-40c0-928f-042f832aee86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:36:37.698227 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29433b64-f435-40c0-928f-042f832aee86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:37.699889 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29433b64-f435-40c0-928f-042f832aee86 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:37.713015 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1179/2329] 10.222.0.26 () {58 vars in 1152 bytes} [Fri Jul 1 19:36:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:36:37.717897 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b840175-0768-4317-a074-9c875d821217 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:37.727851 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b840175-0768-4317-a074-9c875d821217 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:37.733996 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246dcaf8-6d2d-4b1b-8f47-61ac4a79e211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:37.734649 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246dcaf8-6d2d-4b1b-8f47-61ac4a79e211 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:37.734952 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246dcaf8-6d2d-4b1b-8f47-61ac4a79e211 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:37.735208 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246dcaf8-6d2d-4b1b-8f47-61ac4a79e211 admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:37.735912 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246dcaf8-6d2d-4b1b-8f47-61ac4a79e211 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:37.737861 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246dcaf8-6d2d-4b1b-8f47-61ac4a79e211 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:37.767166 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1151/2330] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:36:37 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:36:37.772259 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29433b64-f435-40c0-928f-042f832aee86 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:37.790087 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29433b64-f435-40c0-928f-042f832aee86 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:37.851933 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930efa0-e2a1-4be8-8b02-eebb6eb5f79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:37.852603 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930efa0-e2a1-4be8-8b02-eebb6eb5f79c admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:37.852893 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930efa0-e2a1-4be8-8b02-eebb6eb5f79c admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:37.853800 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930efa0-e2a1-4be8-8b02-eebb6eb5f79c admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:37.854779 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7930efa0-e2a1-4be8-8b02-eebb6eb5f79c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:37.857219 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7930efa0-e2a1-4be8-8b02-eebb6eb5f79c admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:37.879189 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1180/2331] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:36:37 2022] POST /identity/v3/users => generated 287 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:36:37.883302 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246dcaf8-6d2d-4b1b-8f47-61ac4a79e211 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:37.894002 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246dcaf8-6d2d-4b1b-8f47-61ac4a79e211 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:37.898820 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4220048a-286f-46b0-84ac-b591b6c63ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:37.899473 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4220048a-286f-46b0-84ac-b591b6c63ff0 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:37.900096 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4220048a-286f-46b0-84ac-b591b6c63ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:37.900096 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4220048a-286f-46b0-84ac-b591b6c63ff0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:37.900740 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4220048a-286f-46b0-84ac-b591b6c63ff0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:37.902962 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4220048a-286f-46b0-84ac-b591b6c63ff0 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:37.914518 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1152/2332] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:36:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:36:37.918839 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930efa0-e2a1-4be8-8b02-eebb6eb5f79c admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:37.930466 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930efa0-e2a1-4be8-8b02-eebb6eb5f79c admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:37.935794 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d31075-973c-46c2-8792-86a5a2b20e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:37.936476 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d31075-973c-46c2-8792-86a5a2b20e8d admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:37.936758 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d31075-973c-46c2-8792-86a5a2b20e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:37.937016 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d31075-973c-46c2-8792-86a5a2b20e8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:37.937781 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d31075-973c-46c2-8792-86a5a2b20e8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:37.939377 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d31075-973c-46c2-8792-86a5a2b20e8d admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:37.953272 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1181/2333] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:36:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:36:37.954919 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4220048a-286f-46b0-84ac-b591b6c63ff0 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:37.966868 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4220048a-286f-46b0-84ac-b591b6c63ff0 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:37.972751 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf186c2-f801-49a9-838f-d01e178f27ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:37.973703 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf186c2-f801-49a9-838f-d01e178f27ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:37.973997 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf186c2-f801-49a9-838f-d01e178f27ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:37.974279 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf186c2-f801-49a9-838f-d01e178f27ed admin admin] PATH_INFO: `/v3/projects/216cee410a4f4d32a7a48aad3d4d97d3/users/694bb3779a1049948657065da6e767d6/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:37.991468 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf186c2-f801-49a9-838f-d01e178f27ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=216cee410a4f4d32a7a48aad3d4d97d3, user_id=694bb3779a1049948657065da6e767d6, role_id=4cbf6ec846eb4b7c8cc52e9bfd6f076f)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:37.994537 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf186c2-f801-49a9-838f-d01e178f27ed admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:38.020648 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1153/2334] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:36:37 2022] PUT /identity/v3/projects/216cee410a4f4d32a7a48aad3d4d97d3/users/694bb3779a1049948657065da6e767d6/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:36:38.037294 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713cb59c-b802-4075-85b1-57f5482d2159 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:38.037789 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713cb59c-b802-4075-85b1-57f5482d2159 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:38.038376 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713cb59c-b802-4075-85b1-57f5482d2159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:38.071843 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-713cb59c-b802-4075-85b1-57f5482d2159 None None] MFA Rules not processed for user `694bb3779a1049948657065da6e767d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:36:38.077257 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-713cb59c-b802-4075-85b1-57f5482d2159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:38.135020 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf186c2-f801-49a9-838f-d01e178f27ed admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:38.138996 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-dcf186c2-f801-49a9-838f-d01e178f27ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:38.161945 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1182/2335] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:36:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:36:38.173620 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713cb59c-b802-4075-85b1-57f5482d2159 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:38.178055 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:38.178763 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-713cb59c-b802-4075-85b1-57f5482d2159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:38.233127 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf186c2-f801-49a9-838f-d01e178f27ed admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:38.243155 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2211871a-440e-43bf-a6f2-d586681b5765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:38.244432 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2211871a-440e-43bf-a6f2-d586681b5765 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:38.244725 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2211871a-440e-43bf-a6f2-d586681b5765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:38.245011 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2211871a-440e-43bf-a6f2-d586681b5765 admin admin] PATH_INFO: `/v3/users/2024157194214791b7b600b40332da4f` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:38.246945 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2211871a-440e-43bf-a6f2-d586681b5765 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2024157194214791b7b600b40332da4f)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:38.248993 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2211871a-440e-43bf-a6f2-d586681b5765 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:38.267073 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713cb59c-b802-4075-85b1-57f5482d2159 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:38.271332 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd21475-ee11-480e-a638-c4db533fff49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a3ed285ee4c4d04abf7daf0aeb9fb7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:38.272022 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd21475-ee11-480e-a638-c4db533fff49 service cinder] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:38.272319 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd21475-ee11-480e-a638-c4db533fff49 service cinder] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:38.272614 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd21475-ee11-480e-a638-c4db533fff49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:38.283987 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd21475-ee11-480e-a638-c4db533fff49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:38.285473 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd21475-ee11-480e-a638-c4db533fff49 service cinder] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:38.298580 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1183/2336] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:36:38 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 19:36:38.328846 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd21475-ee11-480e-a638-c4db533fff49 service cinder] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:38.331384 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-2211871a-440e-43bf-a6f2-d586681b5765 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2024157194214791b7b600b40332da4f'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:38.332237 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-2211871a-440e-43bf-a6f2-d586681b5765 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2024157194214791b7b600b40332da4f'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:38.338168 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:38.350582 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-2211871a-440e-43bf-a6f2-d586681b5765 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2024157194214791b7b600b40332da4f'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:38.355447 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd21475-ee11-480e-a638-c4db533fff49 service cinder] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:38.371465 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-2211871a-440e-43bf-a6f2-d586681b5765 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2024157194214791b7b600b40332da4f'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:38.372607 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27dd20f-bc5e-45e5-b2de-3b244e59eab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:38.372942 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-2211871a-440e-43bf-a6f2-d586681b5765 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2024157194214791b7b600b40332da4f'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:38.373420 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27dd20f-bc5e-45e5-b2de-3b244e59eab6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:38.373712 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27dd20f-bc5e-45e5-b2de-3b244e59eab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:38.374018 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27dd20f-bc5e-45e5-b2de-3b244e59eab6 admin admin] PATH_INFO: `/v3/users/694bb3779a1049948657065da6e767d6` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:38.377546 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27dd20f-bc5e-45e5-b2de-3b244e59eab6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=694bb3779a1049948657065da6e767d6)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:38.379598 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27dd20f-bc5e-45e5-b2de-3b244e59eab6 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:38.415668 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1154/2337] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:36:38 2022] DELETE /identity/v3/users/2024157194214791b7b600b40332da4f => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 19:36:38.421898 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b337a53-c943-4bed-a1e2-e3636ae48c83 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:38.423256 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b337a53-c943-4bed-a1e2-e3636ae48c83 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:38.423490 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b337a53-c943-4bed-a1e2-e3636ae48c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:38.456895 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-6b337a53-c943-4bed-a1e2-e3636ae48c83 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:36:38.458430 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-6b337a53-c943-4bed-a1e2-e3636ae48c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:38.482771 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-e27dd20f-bc5e-45e5-b2de-3b244e59eab6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '694bb3779a1049948657065da6e767d6'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:38.493638 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-e27dd20f-bc5e-45e5-b2de-3b244e59eab6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '694bb3779a1049948657065da6e767d6'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:38.525995 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-e27dd20f-bc5e-45e5-b2de-3b244e59eab6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '694bb3779a1049948657065da6e767d6'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:38.539651 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-e27dd20f-bc5e-45e5-b2de-3b244e59eab6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '694bb3779a1049948657065da6e767d6'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:38.549872 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-e27dd20f-bc5e-45e5-b2de-3b244e59eab6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '694bb3779a1049948657065da6e767d6'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:38.556873 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1184/2338] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:36:38 2022] DELETE /identity/v3/users/694bb3779a1049948657065da6e767d6 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 19:36:38.561332 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1155/2339] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:36:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:36:38.562664 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159970c-4b93-428e-a8f0-43b95f7483a4 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:38.562898 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159970c-4b93-428e-a8f0-43b95f7483a4 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:38.563196 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159970c-4b93-428e-a8f0-43b95f7483a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:38.570887 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b337a53-c943-4bed-a1e2-e3636ae48c83 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:38.573408 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-6b337a53-c943-4bed-a1e2-e3636ae48c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:38.582685 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-b159970c-4b93-428e-a8f0-43b95f7483a4 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:36:38.583910 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-b159970c-4b93-428e-a8f0-43b95f7483a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:38.627006 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:38.643418 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b337a53-c943-4bed-a1e2-e3636ae48c83 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:38.653139 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1185/2340] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:36:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:36:38.663065 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b159970c-4b93-428e-a8f0-43b95f7483a4 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:38.664453 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-b159970c-4b93-428e-a8f0-43b95f7483a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:38.706745 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155de084-917c-4f09-b144-6df9378654b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:38.708270 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155de084-917c-4f09-b144-6df9378654b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:38.708573 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155de084-917c-4f09-b144-6df9378654b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:38.709000 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155de084-917c-4f09-b144-6df9378654b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:38.725155 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155de084-917c-4f09-b144-6df9378654b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:38.728013 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155de084-917c-4f09-b144-6df9378654b1 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:38.733885 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b159970c-4b93-428e-a8f0-43b95f7483a4 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:38.740266 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f55e8-883c-4e3a-bc6c-7dfb62246eb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:38.740572 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1156/2341] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:36:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:36:38.742889 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f55e8-883c-4e3a-bc6c-7dfb62246eb1 service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:38.742889 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f55e8-883c-4e3a-bc6c-7dfb62246eb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:38.742889 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f55e8-883c-4e3a-bc6c-7dfb62246eb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:38.758587 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638f55e8-883c-4e3a-bc6c-7dfb62246eb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:38.761044 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638f55e8-883c-4e3a-bc6c-7dfb62246eb1 service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:38.776109 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1186/2342] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:36:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:36:39.180221 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155de084-917c-4f09-b144-6df9378654b1 service neutron] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:39.181863 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-155de084-917c-4f09-b144-6df9378654b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:39.205513 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155de084-917c-4f09-b144-6df9378654b1 service neutron] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:39.211409 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729fe976-a88c-46dc-b813-4dce40c76655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:39.212515 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729fe976-a88c-46dc-b813-4dce40c76655 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:39.213081 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729fe976-a88c-46dc-b813-4dce40c76655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:39.213509 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729fe976-a88c-46dc-b813-4dce40c76655 admin admin] PATH_INFO: `/v3/projects/77435d8b456a4bf6bcd7a35aa731ea8d` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:39.216144 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729fe976-a88c-46dc-b813-4dce40c76655 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77435d8b456a4bf6bcd7a35aa731ea8d)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:39.218422 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729fe976-a88c-46dc-b813-4dce40c76655 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:39.290404 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-729fe976-a88c-46dc-b813-4dce40c76655 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77435d8b456a4bf6bcd7a35aa731ea8d', 'request_id': 'req-729fe976-a88c-46dc-b813-4dce40c76655'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:39.297582 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-729fe976-a88c-46dc-b813-4dce40c76655 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77435d8b456a4bf6bcd7a35aa731ea8d', 'request_id': 'req-729fe976-a88c-46dc-b813-4dce40c76655'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:39.299875 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f55e8-883c-4e3a-bc6c-7dfb62246eb1 service neutron] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:39.301509 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-638f55e8-883c-4e3a-bc6c-7dfb62246eb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:39.308974 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-729fe976-a88c-46dc-b813-4dce40c76655 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77435d8b456a4bf6bcd7a35aa731ea8d', 'request_id': 'req-729fe976-a88c-46dc-b813-4dce40c76655'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:39.322547 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f55e8-883c-4e3a-bc6c-7dfb62246eb1 service neutron] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:39.326656 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-729fe976-a88c-46dc-b813-4dce40c76655 admin admin] The token cache is being invalidate because project 77435d8b456a4bf6bcd7a35aa731ea8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:36:39.326960 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-729fe976-a88c-46dc-b813-4dce40c76655 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:39.327670 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-729fe976-a88c-46dc-b813-4dce40c76655 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:39.329731 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1157/2343] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:36:39 2022] DELETE /identity/v3/projects/77435d8b456a4bf6bcd7a35aa731ea8d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:36:39.333905 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729fe976-a88c-46dc-b813-4dce40c76655 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:39.338319 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-729fe976-a88c-46dc-b813-4dce40c76655 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:39.351005 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:39.402735 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20065e6-922a-47fb-9096-1ff3a6c91211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:39.403618 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20065e6-922a-47fb-9096-1ff3a6c91211 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:39.404000 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20065e6-922a-47fb-9096-1ff3a6c91211 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:39.404170 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20065e6-922a-47fb-9096-1ff3a6c91211 admin admin] PATH_INFO: `/v3/projects/216cee410a4f4d32a7a48aad3d4d97d3` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:39.405701 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20065e6-922a-47fb-9096-1ff3a6c91211 admin admin] RBAC: Authorizing `identity:delete_project(project_id=216cee410a4f4d32a7a48aad3d4d97d3)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:39.407813 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20065e6-922a-47fb-9096-1ff3a6c91211 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:39.432274 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729fe976-a88c-46dc-b813-4dce40c76655 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:39.440207 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23aec66-fcff-4d0f-a469-9f773a1c4f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:39.441101 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23aec66-fcff-4d0f-a469-9f773a1c4f3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:39.441413 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23aec66-fcff-4d0f-a469-9f773a1c4f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:39.441694 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23aec66-fcff-4d0f-a469-9f773a1c4f3a admin admin] PATH_INFO: `/v3/users/94c31bdb4a2f46c393f160e3e2f1afdc` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:39.442929 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23aec66-fcff-4d0f-a469-9f773a1c4f3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=94c31bdb4a2f46c393f160e3e2f1afdc)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:39.444917 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23aec66-fcff-4d0f-a469-9f773a1c4f3a admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:39.481039 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-b20065e6-922a-47fb-9096-1ff3a6c91211 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '216cee410a4f4d32a7a48aad3d4d97d3', 'request_id': 'req-b20065e6-922a-47fb-9096-1ff3a6c91211'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:39.487590 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-b20065e6-922a-47fb-9096-1ff3a6c91211 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '216cee410a4f4d32a7a48aad3d4d97d3', 'request_id': 'req-b20065e6-922a-47fb-9096-1ff3a6c91211'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:39.494276 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:39.498852 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-b20065e6-922a-47fb-9096-1ff3a6c91211 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '216cee410a4f4d32a7a48aad3d4d97d3', 'request_id': 'req-b20065e6-922a-47fb-9096-1ff3a6c91211'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:39.518930 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-b20065e6-922a-47fb-9096-1ff3a6c91211 admin admin] The token cache is being invalidate because project 216cee410a4f4d32a7a48aad3d4d97d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:36:39.519495 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-b20065e6-922a-47fb-9096-1ff3a6c91211 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:39.520151 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-b20065e6-922a-47fb-9096-1ff3a6c91211 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:39.521823 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1187/2344] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:36:39 2022] DELETE /identity/v3/projects/216cee410a4f4d32a7a48aad3d4d97d3 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:36:39.537314 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-a23aec66-fcff-4d0f-a469-9f773a1c4f3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94c31bdb4a2f46c393f160e3e2f1afdc'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:39.538368 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-a23aec66-fcff-4d0f-a469-9f773a1c4f3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94c31bdb4a2f46c393f160e3e2f1afdc'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:39.550177 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-a23aec66-fcff-4d0f-a469-9f773a1c4f3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94c31bdb4a2f46c393f160e3e2f1afdc'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:39.565848 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-a23aec66-fcff-4d0f-a469-9f773a1c4f3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94c31bdb4a2f46c393f160e3e2f1afdc'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:39.566414 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-a23aec66-fcff-4d0f-a469-9f773a1c4f3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94c31bdb4a2f46c393f160e3e2f1afdc'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:39.590198 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1158/2345] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:36:39 2022] DELETE /identity/v3/users/94c31bdb4a2f46c393f160e3e2f1afdc => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:36:40.022551 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20065e6-922a-47fb-9096-1ff3a6c91211 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:40.025634 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-b20065e6-922a-47fb-9096-1ff3a6c91211 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:40.116632 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20065e6-922a-47fb-9096-1ff3a6c91211 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:40.187909 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:40.197922 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6015af0e-ebb1-4d49-859d-be47f014feea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:40.199026 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6015af0e-ebb1-4d49-859d-be47f014feea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:40.199422 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6015af0e-ebb1-4d49-859d-be47f014feea admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:40.199791 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6015af0e-ebb1-4d49-859d-be47f014feea admin admin] PATH_INFO: `/v3/projects/a351f9cf1a854830907199304bb8e4b3` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:40.201207 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6015af0e-ebb1-4d49-859d-be47f014feea admin admin] RBAC: Authorizing `identity:delete_project(project_id=a351f9cf1a854830907199304bb8e4b3)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:40.203932 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6015af0e-ebb1-4d49-859d-be47f014feea admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:40.254902 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-6015af0e-ebb1-4d49-859d-be47f014feea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a351f9cf1a854830907199304bb8e4b3', 'request_id': 'req-6015af0e-ebb1-4d49-859d-be47f014feea'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:40.261889 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-6015af0e-ebb1-4d49-859d-be47f014feea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a351f9cf1a854830907199304bb8e4b3', 'request_id': 'req-6015af0e-ebb1-4d49-859d-be47f014feea'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:40.269291 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-6015af0e-ebb1-4d49-859d-be47f014feea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a351f9cf1a854830907199304bb8e4b3', 'request_id': 'req-6015af0e-ebb1-4d49-859d-be47f014feea'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:40.284001 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-6015af0e-ebb1-4d49-859d-be47f014feea admin admin] The token cache is being invalidate because project a351f9cf1a854830907199304bb8e4b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:36:40.284391 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-6015af0e-ebb1-4d49-859d-be47f014feea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:40.285065 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-6015af0e-ebb1-4d49-859d-be47f014feea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:40.286675 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1188/2346] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:36:40 2022] DELETE /identity/v3/projects/a351f9cf1a854830907199304bb8e4b3 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:36:40.291074 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23aec66-fcff-4d0f-a469-9f773a1c4f3a admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:40.293105 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-a23aec66-fcff-4d0f-a469-9f773a1c4f3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:40.306096 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23aec66-fcff-4d0f-a469-9f773a1c4f3a admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:40.367887 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8726f6b8-5a4a-4725-abfa-bd73dc4d45a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:40.368769 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726f6b8-5a4a-4725-abfa-bd73dc4d45a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:40.369058 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726f6b8-5a4a-4725-abfa-bd73dc4d45a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:40.369443 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726f6b8-5a4a-4725-abfa-bd73dc4d45a4 admin admin] PATH_INFO: `/v3/users/583e1e1aa1fe4d7892936d05844a6d4e` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:40.371312 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8726f6b8-5a4a-4725-abfa-bd73dc4d45a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=583e1e1aa1fe4d7892936d05844a6d4e)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:40.373331 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8726f6b8-5a4a-4725-abfa-bd73dc4d45a4 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:40.430094 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-8726f6b8-5a4a-4725-abfa-bd73dc4d45a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '583e1e1aa1fe4d7892936d05844a6d4e'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:40.431012 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-8726f6b8-5a4a-4725-abfa-bd73dc4d45a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '583e1e1aa1fe4d7892936d05844a6d4e'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:40.438621 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-8726f6b8-5a4a-4725-abfa-bd73dc4d45a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '583e1e1aa1fe4d7892936d05844a6d4e'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:40.446282 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-8726f6b8-5a4a-4725-abfa-bd73dc4d45a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '583e1e1aa1fe4d7892936d05844a6d4e'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:40.446932 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-8726f6b8-5a4a-4725-abfa-bd73dc4d45a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '583e1e1aa1fe4d7892936d05844a6d4e'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:40.467119 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1159/2347] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:36:40 2022] DELETE /identity/v3/users/583e1e1aa1fe4d7892936d05844a6d4e => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:36:40.776666 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6015af0e-ebb1-4d49-859d-be47f014feea admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:40.778763 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-6015af0e-ebb1-4d49-859d-be47f014feea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:40.792516 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6015af0e-ebb1-4d49-859d-be47f014feea admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:40.868945 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f32b45a-4d19-41bd-a58c-d876f0df7996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:40.869995 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32b45a-4d19-41bd-a58c-d876f0df7996 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:40.870283 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32b45a-4d19-41bd-a58c-d876f0df7996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:40.870627 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32b45a-4d19-41bd-a58c-d876f0df7996 admin admin] PATH_INFO: `/v3/projects/d27503efeb1f4031b49d64bcec9e557d` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:40.872041 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f32b45a-4d19-41bd-a58c-d876f0df7996 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d27503efeb1f4031b49d64bcec9e557d)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:40.874632 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f32b45a-4d19-41bd-a58c-d876f0df7996 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:40.946871 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-9f32b45a-4d19-41bd-a58c-d876f0df7996 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd27503efeb1f4031b49d64bcec9e557d', 'request_id': 'req-9f32b45a-4d19-41bd-a58c-d876f0df7996'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:40.954202 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-9f32b45a-4d19-41bd-a58c-d876f0df7996 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd27503efeb1f4031b49d64bcec9e557d', 'request_id': 'req-9f32b45a-4d19-41bd-a58c-d876f0df7996'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:40.960203 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-9f32b45a-4d19-41bd-a58c-d876f0df7996 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd27503efeb1f4031b49d64bcec9e557d', 'request_id': 'req-9f32b45a-4d19-41bd-a58c-d876f0df7996'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:40.977668 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-9f32b45a-4d19-41bd-a58c-d876f0df7996 admin admin] The token cache is being invalidate because project d27503efeb1f4031b49d64bcec9e557d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:36:40.977960 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-9f32b45a-4d19-41bd-a58c-d876f0df7996 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:40.978615 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-9f32b45a-4d19-41bd-a58c-d876f0df7996 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:40.980208 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1189/2348] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:36:40 2022] DELETE /identity/v3/projects/d27503efeb1f4031b49d64bcec9e557d => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:36:40.986123 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11191669-d2b6-4485-8477-3e10cb2195d8 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:40.986419 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11191669-d2b6-4485-8477-3e10cb2195d8 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:40.986700 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11191669-d2b6-4485-8477-3e10cb2195d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:41.007268 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-11191669-d2b6-4485-8477-3e10cb2195d8 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:36:41.008598 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-11191669-d2b6-4485-8477-3e10cb2195d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:41.031820 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:41.076646 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1160/2349] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:36:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:36:41.084699 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893350d-d89e-4920-a610-b2afe33cc8c3 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:41.085123 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893350d-d89e-4920-a610-b2afe33cc8c3 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:41.085297 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893350d-d89e-4920-a610-b2afe33cc8c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:41.104617 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-4893350d-d89e-4920-a610-b2afe33cc8c3 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:36:41.105954 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-4893350d-d89e-4920-a610-b2afe33cc8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:41.113991 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1190/2350] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:36:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:36:41.118395 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11191669-d2b6-4485-8477-3e10cb2195d8 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:41.129100 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11191669-d2b6-4485-8477-3e10cb2195d8 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:41.134381 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a58447-650e-4e92-aeda-971968483952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:41.135046 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a58447-650e-4e92-aeda-971968483952 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:41.135328 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a58447-650e-4e92-aeda-971968483952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:41.135609 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a58447-650e-4e92-aeda-971968483952 admin admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:41.136896 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a58447-650e-4e92-aeda-971968483952 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:36:41.137211 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a58447-650e-4e92-aeda-971968483952 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:41.139001 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a58447-650e-4e92-aeda-971968483952 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:41.151505 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1161/2351] 10.222.0.26 () {58 vars in 1152 bytes} [Fri Jul 1 19:36:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:36:41.166340 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4893350d-d89e-4920-a610-b2afe33cc8c3 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:41.178168 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4893350d-d89e-4920-a610-b2afe33cc8c3 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:41.184026 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86d5d18-b005-4ca9-9aec-434f45c9c754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:41.184699 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d5d18-b005-4ca9-9aec-434f45c9c754 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:41.185020 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d5d18-b005-4ca9-9aec-434f45c9c754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:41.185492 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d5d18-b005-4ca9-9aec-434f45c9c754 admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:41.186279 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86d5d18-b005-4ca9-9aec-434f45c9c754 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:41.188407 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86d5d18-b005-4ca9-9aec-434f45c9c754 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:41.192972 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:41.218352 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1191/2352] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:36:41 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:36:41.222692 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a58447-650e-4e92-aeda-971968483952 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:41.233667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a58447-650e-4e92-aeda-971968483952 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:41.294915 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f266fdd-7cdc-4f12-a87f-011afc09d4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:41.295767 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f266fdd-7cdc-4f12-a87f-011afc09d4a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:41.296140 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f266fdd-7cdc-4f12-a87f-011afc09d4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:41.296514 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f266fdd-7cdc-4f12-a87f-011afc09d4a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:41.297501 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f266fdd-7cdc-4f12-a87f-011afc09d4a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:41.299520 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f266fdd-7cdc-4f12-a87f-011afc09d4a6 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:41.323080 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1162/2353] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:36:41 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:36:41.327739 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86d5d18-b005-4ca9-9aec-434f45c9c754 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:41.342580 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86d5d18-b005-4ca9-9aec-434f45c9c754 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:41.348602 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c63b56-ca4d-4752-9e13-a76b476da8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:41.349415 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c63b56-ca4d-4752-9e13-a76b476da8e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:41.349670 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c63b56-ca4d-4752-9e13-a76b476da8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:41.349997 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c63b56-ca4d-4752-9e13-a76b476da8e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:41.350896 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c63b56-ca4d-4752-9e13-a76b476da8e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:41.352738 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c63b56-ca4d-4752-9e13-a76b476da8e5 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:41.363571 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1192/2354] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 19:36:41.367593 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f266fdd-7cdc-4f12-a87f-011afc09d4a6 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:41.378842 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f266fdd-7cdc-4f12-a87f-011afc09d4a6 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:41.383615 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71277a5-c516-4e31-b4d4-a3691df0c765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:41.384321 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71277a5-c516-4e31-b4d4-a3691df0c765 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:41.384610 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71277a5-c516-4e31-b4d4-a3691df0c765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:41.384893 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71277a5-c516-4e31-b4d4-a3691df0c765 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:41.385804 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71277a5-c516-4e31-b4d4-a3691df0c765 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:41.388141 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71277a5-c516-4e31-b4d4-a3691df0c765 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:41.399066 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1163/2355] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:36:41.403336 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c63b56-ca4d-4752-9e13-a76b476da8e5 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:41.413332 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c63b56-ca4d-4752-9e13-a76b476da8e5 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:41.418551 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93afe8aa-8a24-4c1d-b205-6c5e810f6630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:41.419474 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93afe8aa-8a24-4c1d-b205-6c5e810f6630 admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:41.419794 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93afe8aa-8a24-4c1d-b205-6c5e810f6630 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:41.420135 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93afe8aa-8a24-4c1d-b205-6c5e810f6630 admin admin] PATH_INFO: `/v3/projects/20e1ab8989214a8cb018834d113c33e6/users/7c0ef92b0dfa4ee6b301411ded377861/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:41.436157 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93afe8aa-8a24-4c1d-b205-6c5e810f6630 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20e1ab8989214a8cb018834d113c33e6, user_id=7c0ef92b0dfa4ee6b301411ded377861, role_id=4cbf6ec846eb4b7c8cc52e9bfd6f076f)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:41.438932 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93afe8aa-8a24-4c1d-b205-6c5e810f6630 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:41.452753 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1193/2356] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:36:41 2022] PUT /identity/v3/projects/20e1ab8989214a8cb018834d113c33e6/users/7c0ef92b0dfa4ee6b301411ded377861/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:36:41.463654 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689fa89-39c9-4649-b979-24dde0e728f2 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:41.463943 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689fa89-39c9-4649-b979-24dde0e728f2 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:41.464265 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689fa89-39c9-4649-b979-24dde0e728f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:41.495348 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-8689fa89-39c9-4649-b979-24dde0e728f2 None None] MFA Rules not processed for user `7c0ef92b0dfa4ee6b301411ded377861`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:36:41.497170 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-8689fa89-39c9-4649-b979-24dde0e728f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:41.565838 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1164/2357] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:36:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:36:41.581810 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93afe8aa-8a24-4c1d-b205-6c5e810f6630 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:41.583904 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-93afe8aa-8a24-4c1d-b205-6c5e810f6630 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:41.669798 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93afe8aa-8a24-4c1d-b205-6c5e810f6630 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:41.675848 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a88ff2-ea05-4f64-b3a2-11526ba31641 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a3ed285ee4c4d04abf7daf0aeb9fb7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:41.676458 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a88ff2-ea05-4f64-b3a2-11526ba31641 service cinder] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:41.676760 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a88ff2-ea05-4f64-b3a2-11526ba31641 service cinder] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:41.677052 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a88ff2-ea05-4f64-b3a2-11526ba31641 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:41.688068 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a88ff2-ea05-4f64-b3a2-11526ba31641 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:41.689542 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a88ff2-ea05-4f64-b3a2-11526ba31641 service cinder] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:41.698712 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1194/2358] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:36:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:36:44.248769 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8689fa89-39c9-4649-b979-24dde0e728f2 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:44.250183 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-8689fa89-39c9-4649-b979-24dde0e728f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:44.271822 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:44.299988 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a88ff2-ea05-4f64-b3a2-11526ba31641 service cinder] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:44.337714 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8689fa89-39c9-4649-b979-24dde0e728f2 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:44.342453 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de65fb0-3037-41b2-a16f-ad8d8208ee07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:44.343332 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de65fb0-3037-41b2-a16f-ad8d8208ee07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:44.343615 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de65fb0-3037-41b2-a16f-ad8d8208ee07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:44.344190 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de65fb0-3037-41b2-a16f-ad8d8208ee07 admin admin] PATH_INFO: `/v3/users/fb13d797838a43c8aa782b63efae7a7d` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:44.345807 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de65fb0-3037-41b2-a16f-ad8d8208ee07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb13d797838a43c8aa782b63efae7a7d)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:44.348192 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de65fb0-3037-41b2-a16f-ad8d8208ee07 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:44.390690 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a88ff2-ea05-4f64-b3a2-11526ba31641 service cinder] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:44.395581 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e2f15d-6fda-48f0-846c-5df55fe44618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:44.396495 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2f15d-6fda-48f0-846c-5df55fe44618 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:44.396798 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2f15d-6fda-48f0-846c-5df55fe44618 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:44.397060 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2f15d-6fda-48f0-846c-5df55fe44618 admin admin] PATH_INFO: `/v3/users/7c0ef92b0dfa4ee6b301411ded377861` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:44.398345 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e2f15d-6fda-48f0-846c-5df55fe44618 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c0ef92b0dfa4ee6b301411ded377861)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:44.400314 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e2f15d-6fda-48f0-846c-5df55fe44618 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:44.406341 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-5de65fb0-3037-41b2-a16f-ad8d8208ee07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb13d797838a43c8aa782b63efae7a7d'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:44.407122 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-5de65fb0-3037-41b2-a16f-ad8d8208ee07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb13d797838a43c8aa782b63efae7a7d'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:44.414519 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-5de65fb0-3037-41b2-a16f-ad8d8208ee07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb13d797838a43c8aa782b63efae7a7d'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:44.423074 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-5de65fb0-3037-41b2-a16f-ad8d8208ee07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb13d797838a43c8aa782b63efae7a7d'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:44.423930 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-5de65fb0-3037-41b2-a16f-ad8d8208ee07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb13d797838a43c8aa782b63efae7a7d'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:44.446236 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1165/2359] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:36:44 2022] DELETE /identity/v3/users/fb13d797838a43c8aa782b63efae7a7d => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:36:44.451207 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c34fc4-38f3-4e88-9291-2dc56f1939fa None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:44.451504 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c34fc4-38f3-4e88-9291-2dc56f1939fa None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:44.451793 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c34fc4-38f3-4e88-9291-2dc56f1939fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:44.455521 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-81e2f15d-6fda-48f0-846c-5df55fe44618 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c0ef92b0dfa4ee6b301411ded377861'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:44.456263 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-81e2f15d-6fda-48f0-846c-5df55fe44618 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c0ef92b0dfa4ee6b301411ded377861'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:44.470129 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:44.470271 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-c6c34fc4-38f3-4e88-9291-2dc56f1939fa None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:36:44.471847 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-c6c34fc4-38f3-4e88-9291-2dc56f1939fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:44.480342 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-81e2f15d-6fda-48f0-846c-5df55fe44618 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c0ef92b0dfa4ee6b301411ded377861'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:44.491829 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-81e2f15d-6fda-48f0-846c-5df55fe44618 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c0ef92b0dfa4ee6b301411ded377861'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:44.502863 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-81e2f15d-6fda-48f0-846c-5df55fe44618 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c0ef92b0dfa4ee6b301411ded377861'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:44.509949 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1195/2360] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:36:44 2022] DELETE /identity/v3/users/7c0ef92b0dfa4ee6b301411ded377861 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 19:36:44.515003 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e615b-8229-433f-9d80-a008e769cd78 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:44.515194 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e615b-8229-433f-9d80-a008e769cd78 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:44.515467 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e615b-8229-433f-9d80-a008e769cd78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:44.539442 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-9e0e615b-8229-433f-9d80-a008e769cd78 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:36:44.541021 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-9e0e615b-8229-433f-9d80-a008e769cd78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:44.558831 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1166/2361] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:36:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:36:44.572915 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c34fc4-38f3-4e88-9291-2dc56f1939fa None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:44.575303 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-c6c34fc4-38f3-4e88-9291-2dc56f1939fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:44.644294 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1196/2362] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:36:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:36:44.645162 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:44.650973 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0e615b-8229-433f-9d80-a008e769cd78 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:44.657144 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c34fc4-38f3-4e88-9291-2dc56f1939fa None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:44.716616 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d647b0a-46ee-4211-8358-820cef394f1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:44.717570 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d647b0a-46ee-4211-8358-820cef394f1b service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:44.717855 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d647b0a-46ee-4211-8358-820cef394f1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:44.718133 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d647b0a-46ee-4211-8358-820cef394f1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:44.729062 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0e615b-8229-433f-9d80-a008e769cd78 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:44.731470 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d647b0a-46ee-4211-8358-820cef394f1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:44.732761 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d647b0a-46ee-4211-8358-820cef394f1b service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:44.736037 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d9a51-4b27-4d37-84a0-d1161e680b90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:44.736837 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d9a51-4b27-4d37-84a0-d1161e680b90 service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:44.737293 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d9a51-4b27-4d37-84a0-d1161e680b90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:44.737828 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d9a51-4b27-4d37-84a0-d1161e680b90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:44.751508 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1167/2363] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:36:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 19:36:44.752281 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32d9a51-4b27-4d37-84a0-d1161e680b90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:44.754279 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32d9a51-4b27-4d37-84a0-d1161e680b90 service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:44.771517 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1197/2364] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:36:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 19:36:45.176106 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d647b0a-46ee-4211-8358-820cef394f1b service neutron] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:45.179336 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-1d647b0a-46ee-4211-8358-820cef394f1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:45.197612 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d647b0a-46ee-4211-8358-820cef394f1b service neutron] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:45.203674 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34718b47-305a-4213-a185-d2712fb93458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:45.204633 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34718b47-305a-4213-a185-d2712fb93458 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:45.204990 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34718b47-305a-4213-a185-d2712fb93458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:45.205602 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34718b47-305a-4213-a185-d2712fb93458 admin admin] PATH_INFO: `/v3/projects/1f5a2b291fc04343aebc2890ef9e9aba` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:45.206942 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34718b47-305a-4213-a185-d2712fb93458 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f5a2b291fc04343aebc2890ef9e9aba)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:45.208954 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34718b47-305a-4213-a185-d2712fb93458 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:45.275978 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-34718b47-305a-4213-a185-d2712fb93458 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f5a2b291fc04343aebc2890ef9e9aba', 'request_id': 'req-34718b47-305a-4213-a185-d2712fb93458'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:45.284285 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d9a51-4b27-4d37-84a0-d1161e680b90 service neutron] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:45.285981 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-f32d9a51-4b27-4d37-84a0-d1161e680b90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:45.287325 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-34718b47-305a-4213-a185-d2712fb93458 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f5a2b291fc04343aebc2890ef9e9aba', 'request_id': 'req-34718b47-305a-4213-a185-d2712fb93458'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:45.296351 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-34718b47-305a-4213-a185-d2712fb93458 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f5a2b291fc04343aebc2890ef9e9aba', 'request_id': 'req-34718b47-305a-4213-a185-d2712fb93458'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:45.307120 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d9a51-4b27-4d37-84a0-d1161e680b90 service neutron] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:45.325021 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-34718b47-305a-4213-a185-d2712fb93458 admin admin] The token cache is being invalidate because project 1f5a2b291fc04343aebc2890ef9e9aba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:36:45.325347 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-34718b47-305a-4213-a185-d2712fb93458 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:45.325982 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-34718b47-305a-4213-a185-d2712fb93458 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:45.327917 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1168/2365] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:36:45 2022] DELETE /identity/v3/projects/1f5a2b291fc04343aebc2890ef9e9aba => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:36:45.332750 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4b6c9-69e2-405a-8947-379263e4d929 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:45.333043 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4b6c9-69e2-405a-8947-379263e4d929 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:45.333352 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4b6c9-69e2-405a-8947-379263e4d929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:45.357648 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-d9a4b6c9-69e2-405a-8947-379263e4d929 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:36:45.359594 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-d9a4b6c9-69e2-405a-8947-379263e4d929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:45.382646 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15561e3c-b0f5-47a7-ab12-062b02ee54d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:45.383811 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15561e3c-b0f5-47a7-ab12-062b02ee54d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:45.384102 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15561e3c-b0f5-47a7-ab12-062b02ee54d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:45.384373 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15561e3c-b0f5-47a7-ab12-062b02ee54d8 admin admin] PATH_INFO: `/v3/projects/20e1ab8989214a8cb018834d113c33e6` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:45.385632 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15561e3c-b0f5-47a7-ab12-062b02ee54d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20e1ab8989214a8cb018834d113c33e6)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:45.388144 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15561e3c-b0f5-47a7-ab12-062b02ee54d8 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:45.414747 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:45.428417 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1169/2366] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:36:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:36:45.436634 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c990fa-3ba6-46a3-b02e-cbc82f5e4cde None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:45.436932 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c990fa-3ba6-46a3-b02e-cbc82f5e4cde None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:45.437216 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c990fa-3ba6-46a3-b02e-cbc82f5e4cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:45.445557 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-15561e3c-b0f5-47a7-ab12-062b02ee54d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20e1ab8989214a8cb018834d113c33e6', 'request_id': 'req-15561e3c-b0f5-47a7-ab12-062b02ee54d8'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:45.460109 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-15561e3c-b0f5-47a7-ab12-062b02ee54d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20e1ab8989214a8cb018834d113c33e6', 'request_id': 'req-15561e3c-b0f5-47a7-ab12-062b02ee54d8'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:45.461698 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-44c990fa-3ba6-46a3-b02e-cbc82f5e4cde None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:36:45.462940 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-44c990fa-3ba6-46a3-b02e-cbc82f5e4cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:45.467772 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-15561e3c-b0f5-47a7-ab12-062b02ee54d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20e1ab8989214a8cb018834d113c33e6', 'request_id': 'req-15561e3c-b0f5-47a7-ab12-062b02ee54d8'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:45.482419 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-15561e3c-b0f5-47a7-ab12-062b02ee54d8 admin admin] The token cache is being invalidate because project 20e1ab8989214a8cb018834d113c33e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:36:45.482931 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-15561e3c-b0f5-47a7-ab12-062b02ee54d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:45.483776 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-15561e3c-b0f5-47a7-ab12-062b02ee54d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:45.484597 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:45.486276 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1198/2367] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:36:45 2022] DELETE /identity/v3/projects/20e1ab8989214a8cb018834d113c33e6 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:36:45.492119 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca367d-283f-4062-a626-a5692e88d9ce None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:45.492567 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca367d-283f-4062-a626-a5692e88d9ce None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:45.492949 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca367d-283f-4062-a626-a5692e88d9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:45.514593 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-f5ca367d-283f-4062-a626-a5692e88d9ce None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:36:45.515823 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-f5ca367d-283f-4062-a626-a5692e88d9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:45.539854 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1170/2368] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:36:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:36:45.544582 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c990fa-3ba6-46a3-b02e-cbc82f5e4cde None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:45.558054 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c990fa-3ba6-46a3-b02e-cbc82f5e4cde None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:45.565441 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73496d5a-aad8-4af3-a173-0128bcad58ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:45.566158 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73496d5a-aad8-4af3-a173-0128bcad58ba admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:45.566442 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73496d5a-aad8-4af3-a173-0128bcad58ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:45.566747 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73496d5a-aad8-4af3-a173-0128bcad58ba admin admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:45.567521 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73496d5a-aad8-4af3-a173-0128bcad58ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:36:45.567854 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73496d5a-aad8-4af3-a173-0128bcad58ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:45.569688 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73496d5a-aad8-4af3-a173-0128bcad58ba admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:45.583997 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1171/2369] 10.222.0.26 () {58 vars in 1152 bytes} [Fri Jul 1 19:36:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:36:45.588694 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73496d5a-aad8-4af3-a173-0128bcad58ba admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:45.596991 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1199/2370] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:36:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:36:45.599565 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73496d5a-aad8-4af3-a173-0128bcad58ba admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:45.604662 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7fa7c-7a9f-4754-9b4e-847eb7d6eabf None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:45.604987 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7fa7c-7a9f-4754-9b4e-847eb7d6eabf None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:45.605300 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7fa7c-7a9f-4754-9b4e-847eb7d6eabf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:45.606492 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4329b654-753a-4908-8511-73c660c871c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:45.607256 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329b654-753a-4908-8511-73c660c871c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:45.607786 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329b654-753a-4908-8511-73c660c871c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:45.608089 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329b654-753a-4908-8511-73c660c871c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:45.608850 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4329b654-753a-4908-8511-73c660c871c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:45.610966 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4329b654-753a-4908-8511-73c660c871c2 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:45.627942 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-7da7fa7c-7a9f-4754-9b4e-847eb7d6eabf None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:36:45.629172 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-7da7fa7c-7a9f-4754-9b4e-847eb7d6eabf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:45.639868 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1200/2371] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:36:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:36:45.646224 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da7fa7c-7a9f-4754-9b4e-847eb7d6eabf None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:45.654032 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1172/2372] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:36:45 2022] POST /identity/v3/projects => generated 389 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:36:45.655561 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4329b654-753a-4908-8511-73c660c871c2 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:45.664616 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da7fa7c-7a9f-4754-9b4e-847eb7d6eabf None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:45.751680 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4329b654-753a-4908-8511-73c660c871c2 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:45.758482 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c1d1e-7ab4-4cca-bb54-fb3f732f08f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:45.759267 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c1d1e-7ab4-4cca-bb54-fb3f732f08f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:45.759549 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c1d1e-7ab4-4cca-bb54-fb3f732f08f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:45.759826 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c1d1e-7ab4-4cca-bb54-fb3f732f08f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:45.760619 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5c1d1e-7ab4-4cca-bb54-fb3f732f08f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:45.763676 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5c1d1e-7ab4-4cca-bb54-fb3f732f08f9 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:45.783913 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599ae9c7-8e71-4eac-86ff-a656821f8f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:45.784925 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ae9c7-8e71-4eac-86ff-a656821f8f3b admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:45.785181 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ae9c7-8e71-4eac-86ff-a656821f8f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:45.785479 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ae9c7-8e71-4eac-86ff-a656821f8f3b admin admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:45.786213 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599ae9c7-8e71-4eac-86ff-a656821f8f3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:36:45.786534 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599ae9c7-8e71-4eac-86ff-a656821f8f3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:45.788320 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599ae9c7-8e71-4eac-86ff-a656821f8f3b admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:45.808798 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1173/2373] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:36:45 2022] POST /identity/v3/users => generated 295 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:36:45.809898 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c1d1e-7ab4-4cca-bb54-fb3f732f08f9 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:45.820855 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c1d1e-7ab4-4cca-bb54-fb3f732f08f9 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:45.826843 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1201/2374] 10.222.0.26 () {58 vars in 1152 bytes} [Fri Jul 1 19:36:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:36:45.831285 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e06ec77-7b32-414b-8ec7-56214dd83a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:45.831558 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599ae9c7-8e71-4eac-86ff-a656821f8f3b admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:45.832105 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06ec77-7b32-414b-8ec7-56214dd83a79 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:45.832567 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06ec77-7b32-414b-8ec7-56214dd83a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:45.832912 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06ec77-7b32-414b-8ec7-56214dd83a79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:45.833758 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e06ec77-7b32-414b-8ec7-56214dd83a79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:45.835454 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e06ec77-7b32-414b-8ec7-56214dd83a79 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:45.842631 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599ae9c7-8e71-4eac-86ff-a656821f8f3b admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:45.846515 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1174/2375] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:36:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:36:45.847349 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703781b5-bd9a-408d-852d-c057e0cd8046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:45.848015 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703781b5-bd9a-408d-852d-c057e0cd8046 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:45.848305 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703781b5-bd9a-408d-852d-c057e0cd8046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:45.848634 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703781b5-bd9a-408d-852d-c057e0cd8046 admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:45.849963 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703781b5-bd9a-408d-852d-c057e0cd8046 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:45.850261 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e06ec77-7b32-414b-8ec7-56214dd83a79 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:45.851525 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703781b5-bd9a-408d-852d-c057e0cd8046 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:45.867463 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e06ec77-7b32-414b-8ec7-56214dd83a79 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:45.867463 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c792f6-4eb9-4e79-abfb-19701e364c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:45.867463 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c792f6-4eb9-4e79-abfb-19701e364c3a admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:45.867463 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c792f6-4eb9-4e79-abfb-19701e364c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:45.867866 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c792f6-4eb9-4e79-abfb-19701e364c3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:45.868480 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c792f6-4eb9-4e79-abfb-19701e364c3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:45.871416 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c792f6-4eb9-4e79-abfb-19701e364c3a admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:45.890022 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1175/2376] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:36:45 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:36:45.894106 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c792f6-4eb9-4e79-abfb-19701e364c3a admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:45.907796 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1202/2377] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:36:45 2022] POST /identity/v3/projects => generated 365 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:36:45.907999 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c792f6-4eb9-4e79-abfb-19701e364c3a admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:45.909603 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703781b5-bd9a-408d-852d-c057e0cd8046 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:45.932319 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:45.967483 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:45.975983 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e6c001-fe12-48a9-b527-04279cdaa2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:45.977307 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e6c001-fe12-48a9-b527-04279cdaa2d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:45.977841 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e6c001-fe12-48a9-b527-04279cdaa2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:45.978917 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e6c001-fe12-48a9-b527-04279cdaa2d8 admin admin] PATH_INFO: `/v3/projects/4b316968cabc4f8daa1db6f7801274ba/users/a999ab3c11f547fcbad04be11453848e/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:45.993771 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703781b5-bd9a-408d-852d-c057e0cd8046 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:45.998418 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e6c001-fe12-48a9-b527-04279cdaa2d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b316968cabc4f8daa1db6f7801274ba, user_id=a999ab3c11f547fcbad04be11453848e, role_id=4cbf6ec846eb4b7c8cc52e9bfd6f076f)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:45.999417 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497a2a5f-5567-49c0-924d-cfe31d2d569d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:46.000185 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a2a5f-5567-49c0-924d-cfe31d2d569d admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:46.000532 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a2a5f-5567-49c0-924d-cfe31d2d569d admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:46.000897 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a2a5f-5567-49c0-924d-cfe31d2d569d admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:46.001716 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497a2a5f-5567-49c0-924d-cfe31d2d569d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:46.002067 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e6c001-fe12-48a9-b527-04279cdaa2d8 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:46.003791 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497a2a5f-5567-49c0-924d-cfe31d2d569d admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:46.027625 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1176/2378] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:36:45 2022] PUT /identity/v3/projects/4b316968cabc4f8daa1db6f7801274ba/users/a999ab3c11f547fcbad04be11453848e/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 19:36:46.036762 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1203/2379] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:36:45 2022] POST /identity/v3/users => generated 283 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:36:46.041861 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e6c001-fe12-48a9-b527-04279cdaa2d8 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:46.097959 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4a54b-b95f-4483-9bc8-4b36ff8871b1 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:46.099961 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4a54b-b95f-4483-9bc8-4b36ff8871b1 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:46.099961 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4a54b-b95f-4483-9bc8-4b36ff8871b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:46.127826 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e6c001-fe12-48a9-b527-04279cdaa2d8 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:46.132804 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f64173-42d2-4746-a38a-9272d06427f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:46.133617 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f64173-42d2-4746-a38a-9272d06427f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:46.133914 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f64173-42d2-4746-a38a-9272d06427f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:46.136900 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f64173-42d2-4746-a38a-9272d06427f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:46.137782 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f64173-42d2-4746-a38a-9272d06427f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:46.139452 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f64173-42d2-4746-a38a-9272d06427f2 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:46.140825 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-2fd4a54b-b95f-4483-9bc8-4b36ff8871b1 None None] MFA Rules not processed for user `a999ab3c11f547fcbad04be11453848e`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:36:46.142117 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-2fd4a54b-b95f-4483-9bc8-4b36ff8871b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:46.153087 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1177/2380] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:36:46 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:36:46.154237 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f64173-42d2-4746-a38a-9272d06427f2 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:46.165893 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f64173-42d2-4746-a38a-9272d06427f2 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:46.171216 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c09ab43-e965-44aa-9c6c-b200d45106bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:46.171877 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c09ab43-e965-44aa-9c6c-b200d45106bf admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:46.172265 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c09ab43-e965-44aa-9c6c-b200d45106bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:46.172552 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c09ab43-e965-44aa-9c6c-b200d45106bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:46.173332 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c09ab43-e965-44aa-9c6c-b200d45106bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:46.174955 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c09ab43-e965-44aa-9c6c-b200d45106bf admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:46.186061 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1178/2381] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:36:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:36:46.190172 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c09ab43-e965-44aa-9c6c-b200d45106bf admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:46.202158 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c09ab43-e965-44aa-9c6c-b200d45106bf admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:46.207218 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae59c1f-099b-46f2-ab95-012df45f3699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:46.208108 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae59c1f-099b-46f2-ab95-012df45f3699 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:46.208543 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae59c1f-099b-46f2-ab95-012df45f3699 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:46.208828 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae59c1f-099b-46f2-ab95-012df45f3699 admin admin] PATH_INFO: `/v3/projects/567e6d7bf50245c8b84457238ccb42a8/users/b358de6b485a4220bf3b9f432f6ee438/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:46.221413 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1204/2382] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:36:46 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:36:46.224667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae59c1f-099b-46f2-ab95-012df45f3699 admin admin] RBAC: Authorizing `identity:create_grant(project_id=567e6d7bf50245c8b84457238ccb42a8, user_id=b358de6b485a4220bf3b9f432f6ee438, role_id=4cbf6ec846eb4b7c8cc52e9bfd6f076f)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:46.227351 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae59c1f-099b-46f2-ab95-012df45f3699 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:46.233057 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd4a54b-b95f-4483-9bc8-4b36ff8871b1 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:46.237917 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-2fd4a54b-b95f-4483-9bc8-4b36ff8871b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:46.244517 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1179/2383] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:36:46 2022] PUT /identity/v3/projects/567e6d7bf50245c8b84457238ccb42a8/users/b358de6b485a4220bf3b9f432f6ee438/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 19:36:46.256406 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72491c9-1b4e-4b44-83c0-2e0883242069 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:46.256702 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72491c9-1b4e-4b44-83c0-2e0883242069 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:46.256960 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72491c9-1b4e-4b44-83c0-2e0883242069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:46.283484 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-a72491c9-1b4e-4b44-83c0-2e0883242069 None None] MFA Rules not processed for user `b358de6b485a4220bf3b9f432f6ee438`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:36:46.285483 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-a72491c9-1b4e-4b44-83c0-2e0883242069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:46.299473 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd4a54b-b95f-4483-9bc8-4b36ff8871b1 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:46.361414 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1180/2384] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:36:46 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:36:46.361902 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:46.370430 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbd3110-02c0-4aab-9883-8e7b09bd126e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a3ed285ee4c4d04abf7daf0aeb9fb7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:46.372085 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd3110-02c0-4aab-9883-8e7b09bd126e service cinder] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:46.372085 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd3110-02c0-4aab-9883-8e7b09bd126e service cinder] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:46.372538 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd3110-02c0-4aab-9883-8e7b09bd126e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:46.376277 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72491c9-1b4e-4b44-83c0-2e0883242069 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:46.381070 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-a72491c9-1b4e-4b44-83c0-2e0883242069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:46.395271 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72491c9-1b4e-4b44-83c0-2e0883242069 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:46.399850 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb2bcd2-30d1-4e6d-b9ed-f288865f1e9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a3ed285ee4c4d04abf7daf0aeb9fb7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:46.400614 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb2bcd2-30d1-4e6d-b9ed-f288865f1e9c service cinder] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:46.400995 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb2bcd2-30d1-4e6d-b9ed-f288865f1e9c service cinder] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:46.401406 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb2bcd2-30d1-4e6d-b9ed-f288865f1e9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:46.421150 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb2bcd2-30d1-4e6d-b9ed-f288865f1e9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:46.422683 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb2bcd2-30d1-4e6d-b9ed-f288865f1e9c service cinder] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:46.441969 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1181/2385] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:36:46 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 19:36:46.458401 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbd3110-02c0-4aab-9883-8e7b09bd126e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:46.465082 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbd3110-02c0-4aab-9883-8e7b09bd126e service cinder] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:46.477948 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1205/2386] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:36:46 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 19:36:56.429966 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=91,keystone:INSERT=2 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:56.478029 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=26 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:57.007863 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb2bcd2-30d1-4e6d-b9ed-f288865f1e9c service cinder] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:57.080162 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb2bcd2-30d1-4e6d-b9ed-f288865f1e9c service cinder] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:57.084637 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127da86d-5292-4bc2-abfc-bb3b692e9151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:57.085539 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127da86d-5292-4bc2-abfc-bb3b692e9151 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:57.085824 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127da86d-5292-4bc2-abfc-bb3b692e9151 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:57.086103 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127da86d-5292-4bc2-abfc-bb3b692e9151 admin admin] PATH_INFO: `/v3/users/a999ab3c11f547fcbad04be11453848e` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:57.087301 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127da86d-5292-4bc2-abfc-bb3b692e9151 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a999ab3c11f547fcbad04be11453848e)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:57.089779 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127da86d-5292-4bc2-abfc-bb3b692e9151 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:57.140166 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-127da86d-5292-4bc2-abfc-bb3b692e9151 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a999ab3c11f547fcbad04be11453848e'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:57.140825 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-127da86d-5292-4bc2-abfc-bb3b692e9151 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a999ab3c11f547fcbad04be11453848e'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:57.147727 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-127da86d-5292-4bc2-abfc-bb3b692e9151 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a999ab3c11f547fcbad04be11453848e'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:57.155836 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-127da86d-5292-4bc2-abfc-bb3b692e9151 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a999ab3c11f547fcbad04be11453848e'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:57.156479 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-127da86d-5292-4bc2-abfc-bb3b692e9151 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a999ab3c11f547fcbad04be11453848e'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:57.174435 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1182/2387] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:36:57 2022] DELETE /identity/v3/users/a999ab3c11f547fcbad04be11453848e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:36:57.178871 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a707dc97-9452-4410-a6f0-218fe6122649 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:57.179168 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a707dc97-9452-4410-a6f0-218fe6122649 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:57.179449 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a707dc97-9452-4410-a6f0-218fe6122649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:57.196825 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-a707dc97-9452-4410-a6f0-218fe6122649 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:36:57.198213 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-a707dc97-9452-4410-a6f0-218fe6122649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:57.262939 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1206/2388] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:36:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:36:57.273054 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127da86d-5292-4bc2-abfc-bb3b692e9151 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:57.274615 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-127da86d-5292-4bc2-abfc-bb3b692e9151 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:57.339409 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127da86d-5292-4bc2-abfc-bb3b692e9151 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:57.343202 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c71ce3-aca7-4af1-af3f-4df73cec682f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:57.343837 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c71ce3-aca7-4af1-af3f-4df73cec682f service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:57.344126 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c71ce3-aca7-4af1-af3f-4df73cec682f service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:57.344408 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c71ce3-aca7-4af1-af3f-4df73cec682f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:57.356328 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c71ce3-aca7-4af1-af3f-4df73cec682f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:57.357838 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c71ce3-aca7-4af1-af3f-4df73cec682f service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:57.367684 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1183/2389] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:36:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:36:57.685909 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a707dc97-9452-4410-a6f0-218fe6122649 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:57.687409 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-a707dc97-9452-4410-a6f0-218fe6122649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:57.704798 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a707dc97-9452-4410-a6f0-218fe6122649 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:57.710564 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d59741-6fe1-4d67-84e8-9f28a2cb6e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:57.711842 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d59741-6fe1-4d67-84e8-9f28a2cb6e3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:57.712281 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d59741-6fe1-4d67-84e8-9f28a2cb6e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:57.713594 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d59741-6fe1-4d67-84e8-9f28a2cb6e3e admin admin] PATH_INFO: `/v3/projects/4b316968cabc4f8daa1db6f7801274ba` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:57.716437 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d59741-6fe1-4d67-84e8-9f28a2cb6e3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b316968cabc4f8daa1db6f7801274ba)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:57.719147 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d59741-6fe1-4d67-84e8-9f28a2cb6e3e admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:57.782844 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-e8d59741-6fe1-4d67-84e8-9f28a2cb6e3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b316968cabc4f8daa1db6f7801274ba', 'request_id': 'req-e8d59741-6fe1-4d67-84e8-9f28a2cb6e3e'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:57.789832 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-e8d59741-6fe1-4d67-84e8-9f28a2cb6e3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b316968cabc4f8daa1db6f7801274ba', 'request_id': 'req-e8d59741-6fe1-4d67-84e8-9f28a2cb6e3e'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:57.798689 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-e8d59741-6fe1-4d67-84e8-9f28a2cb6e3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b316968cabc4f8daa1db6f7801274ba', 'request_id': 'req-e8d59741-6fe1-4d67-84e8-9f28a2cb6e3e'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:57.813165 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-e8d59741-6fe1-4d67-84e8-9f28a2cb6e3e admin admin] The token cache is being invalidate because project 4b316968cabc4f8daa1db6f7801274ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:36:57.813529 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-e8d59741-6fe1-4d67-84e8-9f28a2cb6e3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:57.814138 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-e8d59741-6fe1-4d67-84e8-9f28a2cb6e3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:36:57.815796 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1207/2390] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:36:57 2022] DELETE /identity/v3/projects/4b316968cabc4f8daa1db6f7801274ba => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:36:57.930810 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfdfa39-93b5-4ef2-ae8c-c49434062310 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:57.931377 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfdfa39-93b5-4ef2-ae8c-c49434062310 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:57.931470 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfdfa39-93b5-4ef2-ae8c-c49434062310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:57.951798 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-0bfdfa39-93b5-4ef2-ae8c-c49434062310 None None] MFA Rules not processed for user `0834256bdfbc48ffbc5af6d6760ecdd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:36:57.953044 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-0bfdfa39-93b5-4ef2-ae8c-c49434062310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:57.978868 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:58.037093 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1184/2391] 10.222.0.26 () {58 vars in 1009 bytes} [Fri Jul 1 19:36:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:36:58.103393 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d59741-6fe1-4d67-84e8-9f28a2cb6e3e admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:58.106006 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-e8d59741-6fe1-4d67-84e8-9f28a2cb6e3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:58.179199 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d59741-6fe1-4d67-84e8-9f28a2cb6e3e admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:58.184915 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dac6673-1739-40a8-9ed9-b6acc55c429c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e958c5b03a9346d59c32675c5271bf3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:58.185625 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac6673-1739-40a8-9ed9-b6acc55c429c service swift] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:58.185914 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac6673-1739-40a8-9ed9-b6acc55c429c service swift] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:58.186195 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac6673-1739-40a8-9ed9-b6acc55c429c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:58.194546 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dac6673-1739-40a8-9ed9-b6acc55c429c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:58.196132 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dac6673-1739-40a8-9ed9-b6acc55c429c service swift] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:58.204320 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1208/2392] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Jul 1 19:36:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 01 19:37:08.027674 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=15 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:37:08.200993 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:37:17.382256 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bffbbc3-b8e6-4afa-87ac-9326ca361673 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:37:17.382823 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bffbbc3-b8e6-4afa-87ac-9326ca361673 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:37:17.382823 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bffbbc3-b8e6-4afa-87ac-9326ca361673 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:37:17.384204 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1185/2393] 10.222.0.26 () {54 vars in 921 bytes} [Fri Jul 1 19:37:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:37:17.392066 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048cea4-8b85-4151-9cbd-ddbebd63b205 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:37:17.392657 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048cea4-8b85-4151-9cbd-ddbebd63b205 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:37:17.392855 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048cea4-8b85-4151-9cbd-ddbebd63b205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:37:17.422705 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-d048cea4-8b85-4151-9cbd-ddbebd63b205 None None] MFA Rules not processed for user `13fd76fc7dd1410b9cde5adbaa6cb2e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:37:17.424236 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-d048cea4-8b85-4151-9cbd-ddbebd63b205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:37:17.549988 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1209/2394] 10.222.0.26 () {58 vars in 1018 bytes} [Fri Jul 1 19:37:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:37:17.563685 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bffbbc3-b8e6-4afa-87ac-9326ca361673 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:37:17.565652 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-5bffbbc3-b8e6-4afa-87ac-9326ca361673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:37:17.644490 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bffbbc3-b8e6-4afa-87ac-9326ca361673 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:37:17.648129 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc400dfb-35d3-4285-bd13-c5d7d17a9d58 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bbcb2463f9c46ddaaa247e4876aca48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:37:17.648822 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc400dfb-35d3-4285-bd13-c5d7d17a9d58 service glance] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:37:17.649088 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc400dfb-35d3-4285-bd13-c5d7d17a9d58 service glance] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:37:17.649379 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc400dfb-35d3-4285-bd13-c5d7d17a9d58 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:37:17.660438 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc400dfb-35d3-4285-bd13-c5d7d17a9d58 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:37:17.661966 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc400dfb-35d3-4285-bd13-c5d7d17a9d58 service glance] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:37:17.675121 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1186/2395] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:37:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:37:17.750637 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613cc061-22f7-477a-9738-f509895520dc None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:37:17.750957 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613cc061-22f7-477a-9738-f509895520dc None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:37:17.751251 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613cc061-22f7-477a-9738-f509895520dc None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:37:17.752657 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1210/2396] 10.222.0.26 () {54 vars in 921 bytes} [Fri Jul 1 19:37:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:37:17.759458 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad16ba-eec0-4e42-980e-3e9a24c10b6a None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:37:17.759849 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad16ba-eec0-4e42-980e-3e9a24c10b6a None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:37:17.760213 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad16ba-eec0-4e42-980e-3e9a24c10b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:37:17.808801 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-ffad16ba-eec0-4e42-980e-3e9a24c10b6a None None] MFA Rules not processed for user `4557d17438a249ee8f75927449a1a059`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:37:17.810838 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-ffad16ba-eec0-4e42-980e-3e9a24c10b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:37:17.893167 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1187/2397] 10.222.0.26 () {58 vars in 1018 bytes} [Fri Jul 1 19:37:17 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:37:17.905432 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613cc061-22f7-477a-9738-f509895520dc None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:37:17.908915 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-613cc061-22f7-477a-9738-f509895520dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:37:17.925858 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613cc061-22f7-477a-9738-f509895520dc None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:37:17.929575 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6239a152-a3a1-4b24-8bc2-15b9cc54d13f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:37:17.930205 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6239a152-a3a1-4b24-8bc2-15b9cc54d13f service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:37:17.930495 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6239a152-a3a1-4b24-8bc2-15b9cc54d13f service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:37:17.930777 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6239a152-a3a1-4b24-8bc2-15b9cc54d13f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:37:17.939134 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6239a152-a3a1-4b24-8bc2-15b9cc54d13f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:37:17.940569 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6239a152-a3a1-4b24-8bc2-15b9cc54d13f service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:37:17.948654 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1211/2398] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:37:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 19:37:18.036956 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae45831-0843-4fe9-8938-154855227db4 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:37:18.037264 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae45831-0843-4fe9-8938-154855227db4 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:37:18.037559 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae45831-0843-4fe9-8938-154855227db4 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:37:18.039783 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1188/2399] 10.222.0.26 () {54 vars in 921 bytes} [Fri Jul 1 19:37:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 19:37:18.046811 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135ab7a-d649-4bc0-a027-a127ed52a75c None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:37:18.047160 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135ab7a-d649-4bc0-a027-a127ed52a75c None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:37:18.047363 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135ab7a-d649-4bc0-a027-a127ed52a75c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:37:18.067031 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-8135ab7a-d649-4bc0-a027-a127ed52a75c None None] MFA Rules not processed for user `13fd76fc7dd1410b9cde5adbaa6cb2e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:37:18.068249 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-8135ab7a-d649-4bc0-a027-a127ed52a75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:37:18.080571 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1212/2400] 10.222.0.26 () {58 vars in 1018 bytes} [Fri Jul 1 19:37:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:37:18.093346 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae45831-0843-4fe9-8938-154855227db4 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:37:18.105061 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae45831-0843-4fe9-8938-154855227db4 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:37:18.108645 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff0fa65-99ea-4c8c-a725-b9fb4033b196 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:37:18.109323 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff0fa65-99ea-4c8c-a725-b9fb4033b196 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:37:18.109611 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff0fa65-99ea-4c8c-a725-b9fb4033b196 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:37:18.109890 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff0fa65-99ea-4c8c-a725-b9fb4033b196 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:37:18.120477 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff0fa65-99ea-4c8c-a725-b9fb4033b196 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:37:18.121992 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff0fa65-99ea-4c8c-a725-b9fb4033b196 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:37:18.135162 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1189/2401] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:37:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:37:20.092226 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8135ab7a-d649-4bc0-a027-a127ed52a75c None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:37:20.093735 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-8135ab7a-d649-4bc0-a027-a127ed52a75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:37:20.229342 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:37:20.235399 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8135ab7a-d649-4bc0-a027-a127ed52a75c None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:37:20.240415 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f984f4-a262-4201-b496-18bd5b5eb215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:37:20.241331 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f984f4-a262-4201-b496-18bd5b5eb215 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:37:20.241621 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f984f4-a262-4201-b496-18bd5b5eb215 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:37:20.241904 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f984f4-a262-4201-b496-18bd5b5eb215 admin admin] PATH_INFO: `/v3/users/341b677d96534239ab8beae2ca4fbc1a` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:37:20.243161 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f984f4-a262-4201-b496-18bd5b5eb215 admin admin] RBAC: Authorizing `identity:delete_user(user_id=341b677d96534239ab8beae2ca4fbc1a)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:37:20.245664 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f984f4-a262-4201-b496-18bd5b5eb215 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:37:20.309001 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-b5f984f4-a262-4201-b496-18bd5b5eb215 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '341b677d96534239ab8beae2ca4fbc1a'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:37:20.311003 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-b5f984f4-a262-4201-b496-18bd5b5eb215 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '341b677d96534239ab8beae2ca4fbc1a'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:37:20.330549 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-b5f984f4-a262-4201-b496-18bd5b5eb215 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '341b677d96534239ab8beae2ca4fbc1a'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:37:20.340802 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-b5f984f4-a262-4201-b496-18bd5b5eb215 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '341b677d96534239ab8beae2ca4fbc1a'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:37:20.350584 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-b5f984f4-a262-4201-b496-18bd5b5eb215 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '341b677d96534239ab8beae2ca4fbc1a'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:37:20.358466 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1213/2402] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:37:20 2022] DELETE /identity/v3/users/341b677d96534239ab8beae2ca4fbc1a => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:37:20.363118 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66b73f-fedc-4976-8875-b2a11b50332e None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:37:20.363634 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66b73f-fedc-4976-8875-b2a11b50332e None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:37:20.363762 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66b73f-fedc-4976-8875-b2a11b50332e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:37:20.397871 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-4d66b73f-fedc-4976-8875-b2a11b50332e None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:37:20.399408 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-4d66b73f-fedc-4976-8875-b2a11b50332e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:37:20.463966 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1190/2403] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:37:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:37:20.477495 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f984f4-a262-4201-b496-18bd5b5eb215 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:37:20.479262 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-b5f984f4-a262-4201-b496-18bd5b5eb215 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:37:20.549433 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f984f4-a262-4201-b496-18bd5b5eb215 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:37:20.553151 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0859df1-cd9a-4bd4-a5b7-57fe49b7e50c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:37:20.553865 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0859df1-cd9a-4bd4-a5b7-57fe49b7e50c service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:37:20.554177 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0859df1-cd9a-4bd4-a5b7-57fe49b7e50c service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:37:20.554422 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0859df1-cd9a-4bd4-a5b7-57fe49b7e50c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:37:20.565676 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0859df1-cd9a-4bd4-a5b7-57fe49b7e50c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:37:20.567128 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0859df1-cd9a-4bd4-a5b7-57fe49b7e50c service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:37:20.579372 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1214/2404] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:37:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 19:37:20.949272 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d66b73f-fedc-4976-8875-b2a11b50332e None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:37:20.951015 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-4d66b73f-fedc-4976-8875-b2a11b50332e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:37:20.964424 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d66b73f-fedc-4976-8875-b2a11b50332e None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:37:20.969258 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b678f569-ca71-4cb6-9823-5f92a767c32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:37:20.970241 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b678f569-ca71-4cb6-9823-5f92a767c32f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:37:20.970640 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b678f569-ca71-4cb6-9823-5f92a767c32f admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:37:20.970991 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b678f569-ca71-4cb6-9823-5f92a767c32f admin admin] PATH_INFO: `/v3/projects/83d3525d8b274f83ae25a667c1054511` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:37:20.972312 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b678f569-ca71-4cb6-9823-5f92a767c32f admin admin] RBAC: Authorizing `identity:delete_project(project_id=83d3525d8b274f83ae25a667c1054511)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:37:20.974367 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b678f569-ca71-4cb6-9823-5f92a767c32f admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:37:20.983952 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:37:21.052951 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-b678f569-ca71-4cb6-9823-5f92a767c32f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83d3525d8b274f83ae25a667c1054511', 'request_id': 'req-b678f569-ca71-4cb6-9823-5f92a767c32f'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:37:21.059897 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-b678f569-ca71-4cb6-9823-5f92a767c32f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83d3525d8b274f83ae25a667c1054511', 'request_id': 'req-b678f569-ca71-4cb6-9823-5f92a767c32f'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:37:21.066242 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-b678f569-ca71-4cb6-9823-5f92a767c32f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83d3525d8b274f83ae25a667c1054511', 'request_id': 'req-b678f569-ca71-4cb6-9823-5f92a767c32f'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:37:21.079903 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-b678f569-ca71-4cb6-9823-5f92a767c32f admin admin] The token cache is being invalidate because project 83d3525d8b274f83ae25a667c1054511 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:37:21.080197 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-b678f569-ca71-4cb6-9823-5f92a767c32f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:37:21.080839 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-b678f569-ca71-4cb6-9823-5f92a767c32f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:37:21.082558 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1191/2405] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:37:20 2022] DELETE /identity/v3/projects/83d3525d8b274f83ae25a667c1054511 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:37:21.087538 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6115e968-1801-4803-bb11-bbb00895e400 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:37:21.088325 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6115e968-1801-4803-bb11-bbb00895e400 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:37:21.088607 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6115e968-1801-4803-bb11-bbb00895e400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:37:21.130326 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-6115e968-1801-4803-bb11-bbb00895e400 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:37:21.131820 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-6115e968-1801-4803-bb11-bbb00895e400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:37:21.216819 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1215/2406] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:37:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:37:21.220420 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806d35e-c13a-47a0-b4e6-569ee3cc59dc None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:37:21.220643 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806d35e-c13a-47a0-b4e6-569ee3cc59dc None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:37:21.220924 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806d35e-c13a-47a0-b4e6-569ee3cc59dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:37:21.241023 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-3806d35e-c13a-47a0-b4e6-569ee3cc59dc None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:37:21.242558 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-3806d35e-c13a-47a0-b4e6-569ee3cc59dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:37:21.255927 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1192/2407] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:37:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:37:21.260947 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6115e968-1801-4803-bb11-bbb00895e400 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:37:21.266581 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:37:21.274344 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6115e968-1801-4803-bb11-bbb00895e400 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:37:21.282152 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcc43ad-d3d6-4c44-a5ff-29ea277bb632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:37:21.283026 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc43ad-d3d6-4c44-a5ff-29ea277bb632 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:37:21.283760 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc43ad-d3d6-4c44-a5ff-29ea277bb632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:37:21.284981 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc43ad-d3d6-4c44-a5ff-29ea277bb632 admin admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:37:21.285435 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcc43ad-d3d6-4c44-a5ff-29ea277bb632 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:37:21.286878 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcc43ad-d3d6-4c44-a5ff-29ea277bb632 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:37:21.289201 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcc43ad-d3d6-4c44-a5ff-29ea277bb632 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:37:21.305274 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1216/2408] 10.222.0.26 () {58 vars in 1152 bytes} [Fri Jul 1 19:37:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:37:21.310189 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3806d35e-c13a-47a0-b4e6-569ee3cc59dc None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:37:21.322070 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3806d35e-c13a-47a0-b4e6-569ee3cc59dc None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:37:21.330411 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622ea2c9-0167-4550-9183-fad3ee51f97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:37:21.331260 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ea2c9-0167-4550-9183-fad3ee51f97b admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:37:21.331696 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ea2c9-0167-4550-9183-fad3ee51f97b admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:37:21.332113 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ea2c9-0167-4550-9183-fad3ee51f97b admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:37:21.333036 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622ea2c9-0167-4550-9183-fad3ee51f97b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:37:21.337271 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622ea2c9-0167-4550-9183-fad3ee51f97b admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:37:21.373224 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1193/2409] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:37:21 2022] POST /identity/v3/projects => generated 399 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:37:21.375184 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcc43ad-d3d6-4c44-a5ff-29ea277bb632 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:37:21.386470 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcc43ad-d3d6-4c44-a5ff-29ea277bb632 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:37:21.452082 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab76359-af14-42c0-8007-2163ce403898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:37:21.452769 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab76359-af14-42c0-8007-2163ce403898 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:37:21.453061 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab76359-af14-42c0-8007-2163ce403898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:37:21.453432 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab76359-af14-42c0-8007-2163ce403898 admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:37:21.454140 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab76359-af14-42c0-8007-2163ce403898 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:37:21.456110 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab76359-af14-42c0-8007-2163ce403898 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:37:21.481361 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1217/2410] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:37:21 2022] POST /identity/v3/users => generated 300 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:37:21.485333 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622ea2c9-0167-4550-9183-fad3ee51f97b admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:37:21.504951 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622ea2c9-0167-4550-9183-fad3ee51f97b admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:37:21.511412 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba48d226-beef-464b-a5de-986d8a87eeaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:37:21.512207 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba48d226-beef-464b-a5de-986d8a87eeaa admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:37:21.513272 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba48d226-beef-464b-a5de-986d8a87eeaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:37:21.513670 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba48d226-beef-464b-a5de-986d8a87eeaa admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:37:21.515213 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba48d226-beef-464b-a5de-986d8a87eeaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:37:21.516860 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba48d226-beef-464b-a5de-986d8a87eeaa admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:37:21.529933 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1194/2411] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:37:21 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:37:21.535498 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab76359-af14-42c0-8007-2163ce403898 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:37:21.549754 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab76359-af14-42c0-8007-2163ce403898 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:37:21.554731 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a0ea9d-026f-4d72-951a-e9465492fdf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:37:21.555399 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0ea9d-026f-4d72-951a-e9465492fdf5 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:37:21.555685 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0ea9d-026f-4d72-951a-e9465492fdf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:37:21.555964 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0ea9d-026f-4d72-951a-e9465492fdf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:37:21.557447 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a0ea9d-026f-4d72-951a-e9465492fdf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:37:21.559094 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a0ea9d-026f-4d72-951a-e9465492fdf5 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:37:21.569645 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1218/2412] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:37:21 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:37:21.573918 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba48d226-beef-464b-a5de-986d8a87eeaa admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:37:21.591324 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba48d226-beef-464b-a5de-986d8a87eeaa admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:37:21.596172 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d732ba-7097-4b0c-bc9c-58ec6a8fcb11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:37:21.597056 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d732ba-7097-4b0c-bc9c-58ec6a8fcb11 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:37:21.597387 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d732ba-7097-4b0c-bc9c-58ec6a8fcb11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:37:21.597671 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d732ba-7097-4b0c-bc9c-58ec6a8fcb11 admin admin] PATH_INFO: `/v3/projects/4ce3bd1d716a4f5e927a305a26833290/users/9cdd7caf95e34aad8fb4c6b92f33439e/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:37:21.612943 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d732ba-7097-4b0c-bc9c-58ec6a8fcb11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ce3bd1d716a4f5e927a305a26833290, user_id=9cdd7caf95e34aad8fb4c6b92f33439e, role_id=4cbf6ec846eb4b7c8cc52e9bfd6f076f)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:37:21.615651 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d732ba-7097-4b0c-bc9c-58ec6a8fcb11 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:37:21.629717 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1195/2413] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:37:21 2022] PUT /identity/v3/projects/4ce3bd1d716a4f5e927a305a26833290/users/9cdd7caf95e34aad8fb4c6b92f33439e/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:37:21.640153 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dfc258-32d0-4c2c-a356-3650b86bc39e None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:37:21.640504 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dfc258-32d0-4c2c-a356-3650b86bc39e None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:37:21.640795 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dfc258-32d0-4c2c-a356-3650b86bc39e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:37:21.676172 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-30dfc258-32d0-4c2c-a356-3650b86bc39e None None] MFA Rules not processed for user `9cdd7caf95e34aad8fb4c6b92f33439e`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:37:21.677424 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-30dfc258-32d0-4c2c-a356-3650b86bc39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:37:21.748780 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1219/2414] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:37:21 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:37:21.756916 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d732ba-7097-4b0c-bc9c-58ec6a8fcb11 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:37:21.759015 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-82d732ba-7097-4b0c-bc9c-58ec6a8fcb11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:37:21.823760 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d732ba-7097-4b0c-bc9c-58ec6a8fcb11 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:37:21.827726 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c87d97a-e665-4c80-97c0-f4a75d7ea3a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a3ed285ee4c4d04abf7daf0aeb9fb7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:37:21.828453 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c87d97a-e665-4c80-97c0-f4a75d7ea3a9 service cinder] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:37:21.828734 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c87d97a-e665-4c80-97c0-f4a75d7ea3a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:37:21.829016 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c87d97a-e665-4c80-97c0-f4a75d7ea3a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:37:21.838386 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c87d97a-e665-4c80-97c0-f4a75d7ea3a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:37:21.839922 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c87d97a-e665-4c80-97c0-f4a75d7ea3a9 service cinder] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:37:21.849039 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1196/2415] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:37:21 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:37:22.366373 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfebdb1-1466-431e-922c-18a183ff83b6 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:37:22.366864 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfebdb1-1466-431e-922c-18a183ff83b6 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:37:22.366960 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfebdb1-1466-431e-922c-18a183ff83b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:37:22.392223 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-ddfebdb1-1466-431e-922c-18a183ff83b6 None None] MFA Rules not processed for user `0834256bdfbc48ffbc5af6d6760ecdd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:37:22.394205 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-ddfebdb1-1466-431e-922c-18a183ff83b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:37:22.454132 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1220/2416] 10.222.0.26 () {58 vars in 1009 bytes} [Fri Jul 1 19:37:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:37:22.466217 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c87d97a-e665-4c80-97c0-f4a75d7ea3a9 service cinder] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:37:22.467618 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-9c87d97a-e665-4c80-97c0-f4a75d7ea3a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:37:22.508322 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:37:22.539497 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c87d97a-e665-4c80-97c0-f4a75d7ea3a9 service cinder] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:37:22.544728 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8332878-93b3-47b5-a577-2a3e82778c47 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e958c5b03a9346d59c32675c5271bf3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:37:22.545403 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8332878-93b3-47b5-a577-2a3e82778c47 service swift] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:37:22.545691 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8332878-93b3-47b5-a577-2a3e82778c47 service swift] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:37:22.545971 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8332878-93b3-47b5-a577-2a3e82778c47 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:37:22.555296 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8332878-93b3-47b5-a577-2a3e82778c47 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:37:22.557585 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8332878-93b3-47b5-a577-2a3e82778c47 service swift] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:37:22.566018 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1197/2417] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Jul 1 19:37:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 01 19:37:23.249682 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfebdb1-1466-431e-922c-18a183ff83b6 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:37:23.251247 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-ddfebdb1-1466-431e-922c-18a183ff83b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:37:23.256258 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:37:23.324319 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfebdb1-1466-431e-922c-18a183ff83b6 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:37:23.338533 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7098bc-01c4-49eb-b221-8f344fd32d8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:37:23.339363 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7098bc-01c4-49eb-b221-8f344fd32d8c service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:37:23.339903 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7098bc-01c4-49eb-b221-8f344fd32d8c service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:37:23.340411 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7098bc-01c4-49eb-b221-8f344fd32d8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:37:23.342632 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-0b7098bc-01c4-49eb-b221-8f344fd32d8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:37:23.433203 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7098bc-01c4-49eb-b221-8f344fd32d8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:37:23.435270 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7098bc-01c4-49eb-b221-8f344fd32d8c service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:37:23.471788 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1221/2418] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:37:23 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:37:23.558130 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8332878-93b3-47b5-a577-2a3e82778c47 service swift] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:37:23.559922 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-d8332878-93b3-47b5-a577-2a3e82778c47 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:37:23.730776 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8332878-93b3-47b5-a577-2a3e82778c47 service swift] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:37:23.736184 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2598ce-c0c2-4d01-8f5f-0e4b58a453b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:37:23.737127 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2598ce-c0c2-4d01-8f5f-0e4b58a453b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:37:23.737455 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2598ce-c0c2-4d01-8f5f-0e4b58a453b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:37:23.737740 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2598ce-c0c2-4d01-8f5f-0e4b58a453b6 admin admin] PATH_INFO: `/v3/users/b358de6b485a4220bf3b9f432f6ee438` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:37:23.738970 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2598ce-c0c2-4d01-8f5f-0e4b58a453b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b358de6b485a4220bf3b9f432f6ee438)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:37:23.741286 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2598ce-c0c2-4d01-8f5f-0e4b58a453b6 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:37:23.840665 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-7c2598ce-c0c2-4d01-8f5f-0e4b58a453b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b358de6b485a4220bf3b9f432f6ee438'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:37:23.841965 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-7c2598ce-c0c2-4d01-8f5f-0e4b58a453b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b358de6b485a4220bf3b9f432f6ee438'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:37:23.861303 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-7c2598ce-c0c2-4d01-8f5f-0e4b58a453b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b358de6b485a4220bf3b9f432f6ee438'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:37:23.887572 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-7c2598ce-c0c2-4d01-8f5f-0e4b58a453b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b358de6b485a4220bf3b9f432f6ee438'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:37:23.889174 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-7c2598ce-c0c2-4d01-8f5f-0e4b58a453b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b358de6b485a4220bf3b9f432f6ee438'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:37:23.926399 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1198/2419] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:37:23 2022] DELETE /identity/v3/users/b358de6b485a4220bf3b9f432f6ee438 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 19:37:23.928170 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452e552-5e0c-4c93-8926-9a047988936b None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:37:23.928471 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452e552-5e0c-4c93-8926-9a047988936b None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:37:23.928790 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452e552-5e0c-4c93-8926-9a047988936b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:37:23.957456 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-e452e552-5e0c-4c93-8926-9a047988936b None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:37:23.959287 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-e452e552-5e0c-4c93-8926-9a047988936b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:37:24.033000 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1222/2420] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:37:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:37:24.044029 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2598ce-c0c2-4d01-8f5f-0e4b58a453b6 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:37:24.046375 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-7c2598ce-c0c2-4d01-8f5f-0e4b58a453b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:37:24.116405 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:37:24.133059 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2598ce-c0c2-4d01-8f5f-0e4b58a453b6 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:37:24.140269 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf6b2bf-9b43-4103-b1e8-f914d18210b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:37:24.141064 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6b2bf-9b43-4103-b1e8-f914d18210b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:37:24.141431 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6b2bf-9b43-4103-b1e8-f914d18210b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:37:24.141714 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6b2bf-9b43-4103-b1e8-f914d18210b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:37:24.152811 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf6b2bf-9b43-4103-b1e8-f914d18210b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:37:24.154379 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf6b2bf-9b43-4103-b1e8-f914d18210b0 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:37:24.167406 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1199/2421] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:37:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:37:24.593957 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e452e552-5e0c-4c93-8926-9a047988936b None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:37:24.595461 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-e452e552-5e0c-4c93-8926-9a047988936b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:37:24.615960 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e452e552-5e0c-4c93-8926-9a047988936b None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:37:24.670161 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dff3af8-059e-4b3d-b36c-0457f963c54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:37:24.677365 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff3af8-059e-4b3d-b36c-0457f963c54e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:37:24.678049 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff3af8-059e-4b3d-b36c-0457f963c54e admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:37:24.678049 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff3af8-059e-4b3d-b36c-0457f963c54e admin admin] PATH_INFO: `/v3/projects/567e6d7bf50245c8b84457238ccb42a8` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:37:24.686438 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dff3af8-059e-4b3d-b36c-0457f963c54e admin admin] RBAC: Authorizing `identity:delete_project(project_id=567e6d7bf50245c8b84457238ccb42a8)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:37:24.691948 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dff3af8-059e-4b3d-b36c-0457f963c54e admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:37:24.824811 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:37:24.831431 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-2dff3af8-059e-4b3d-b36c-0457f963c54e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '567e6d7bf50245c8b84457238ccb42a8', 'request_id': 'req-2dff3af8-059e-4b3d-b36c-0457f963c54e'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:37:24.840629 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-2dff3af8-059e-4b3d-b36c-0457f963c54e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '567e6d7bf50245c8b84457238ccb42a8', 'request_id': 'req-2dff3af8-059e-4b3d-b36c-0457f963c54e'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:37:24.850985 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-2dff3af8-059e-4b3d-b36c-0457f963c54e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '567e6d7bf50245c8b84457238ccb42a8', 'request_id': 'req-2dff3af8-059e-4b3d-b36c-0457f963c54e'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:37:24.870538 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-2dff3af8-059e-4b3d-b36c-0457f963c54e admin admin] The token cache is being invalidate because project 567e6d7bf50245c8b84457238ccb42a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:37:24.870538 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-2dff3af8-059e-4b3d-b36c-0457f963c54e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:37:24.870914 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-2dff3af8-059e-4b3d-b36c-0457f963c54e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:37:24.873555 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1223/2422] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:37:24 2022] DELETE /identity/v3/projects/567e6d7bf50245c8b84457238ccb42a8 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:37:27.128710 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf6b2bf-9b43-4103-b1e8-f914d18210b0 service neutron] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:37:27.130734 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-cbf6b2bf-9b43-4103-b1e8-f914d18210b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:37:27.145327 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf6b2bf-9b43-4103-b1e8-f914d18210b0 service neutron] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:37:27.222703 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d3408b-4180-4e65-a390-3fc7a6be3223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:37:27.223602 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3408b-4180-4e65-a390-3fc7a6be3223 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:37:27.224056 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3408b-4180-4e65-a390-3fc7a6be3223 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:37:27.224344 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3408b-4180-4e65-a390-3fc7a6be3223 admin admin] PATH_INFO: `/v3/users/9cdd7caf95e34aad8fb4c6b92f33439e` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:37:27.225786 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d3408b-4180-4e65-a390-3fc7a6be3223 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cdd7caf95e34aad8fb4c6b92f33439e)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:37:27.227855 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d3408b-4180-4e65-a390-3fc7a6be3223 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:37:27.332715 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-20d3408b-4180-4e65-a390-3fc7a6be3223 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cdd7caf95e34aad8fb4c6b92f33439e'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:37:27.333498 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-20d3408b-4180-4e65-a390-3fc7a6be3223 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cdd7caf95e34aad8fb4c6b92f33439e'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:37:27.356769 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-20d3408b-4180-4e65-a390-3fc7a6be3223 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cdd7caf95e34aad8fb4c6b92f33439e'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:37:27.365115 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-20d3408b-4180-4e65-a390-3fc7a6be3223 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cdd7caf95e34aad8fb4c6b92f33439e'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:37:27.365747 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-20d3408b-4180-4e65-a390-3fc7a6be3223 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cdd7caf95e34aad8fb4c6b92f33439e'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:37:27.393121 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1200/2423] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:37:27 2022] DELETE /identity/v3/users/9cdd7caf95e34aad8fb4c6b92f33439e => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:37:27.394773 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cea518-803b-40b8-a456-26ea8e41fed0 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:37:27.395277 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cea518-803b-40b8-a456-26ea8e41fed0 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:37:27.395362 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cea518-803b-40b8-a456-26ea8e41fed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:37:27.419335 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-31cea518-803b-40b8-a456-26ea8e41fed0 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:37:27.420763 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-31cea518-803b-40b8-a456-26ea8e41fed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:37:27.490644 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1224/2424] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:37:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:37:27.501543 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d3408b-4180-4e65-a390-3fc7a6be3223 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:37:27.502992 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-20d3408b-4180-4e65-a390-3fc7a6be3223 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:37:27.577008 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d3408b-4180-4e65-a390-3fc7a6be3223 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:37:27.580834 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931604ee-994e-4a25-92d4-2b0e15c6dd56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:37:27.581618 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931604ee-994e-4a25-92d4-2b0e15c6dd56 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:37:27.582269 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931604ee-994e-4a25-92d4-2b0e15c6dd56 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:37:27.582387 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931604ee-994e-4a25-92d4-2b0e15c6dd56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:37:27.594171 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931604ee-994e-4a25-92d4-2b0e15c6dd56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:37:27.595717 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931604ee-994e-4a25-92d4-2b0e15c6dd56 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:37:27.606569 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1201/2425] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:37:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:37:27.949291 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cea518-803b-40b8-a456-26ea8e41fed0 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:37:27.951573 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-31cea518-803b-40b8-a456-26ea8e41fed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:37:27.974720 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cea518-803b-40b8-a456-26ea8e41fed0 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:37:27.980967 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7078656-bb5d-4dc8-981b-f99c5b29112e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:37:27.981851 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7078656-bb5d-4dc8-981b-f99c5b29112e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:37:27.982138 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7078656-bb5d-4dc8-981b-f99c5b29112e admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:37:27.982420 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7078656-bb5d-4dc8-981b-f99c5b29112e admin admin] PATH_INFO: `/v3/projects/4ce3bd1d716a4f5e927a305a26833290` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:37:27.983672 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7078656-bb5d-4dc8-981b-f99c5b29112e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ce3bd1d716a4f5e927a305a26833290)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:37:27.985715 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7078656-bb5d-4dc8-981b-f99c5b29112e admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:37:28.037427 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-b7078656-bb5d-4dc8-981b-f99c5b29112e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ce3bd1d716a4f5e927a305a26833290', 'request_id': 'req-b7078656-bb5d-4dc8-981b-f99c5b29112e'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:37:28.044756 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-b7078656-bb5d-4dc8-981b-f99c5b29112e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ce3bd1d716a4f5e927a305a26833290', 'request_id': 'req-b7078656-bb5d-4dc8-981b-f99c5b29112e'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:37:28.050696 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-b7078656-bb5d-4dc8-981b-f99c5b29112e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ce3bd1d716a4f5e927a305a26833290', 'request_id': 'req-b7078656-bb5d-4dc8-981b-f99c5b29112e'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:37:28.063454 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-b7078656-bb5d-4dc8-981b-f99c5b29112e admin admin] The token cache is being invalidate because project 4ce3bd1d716a4f5e927a305a26833290 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:37:28.063800 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-b7078656-bb5d-4dc8-981b-f99c5b29112e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:37:28.064515 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-b7078656-bb5d-4dc8-981b-f99c5b29112e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:37:28.066478 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1225/2426] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:37:27 2022] DELETE /identity/v3/projects/4ce3bd1d716a4f5e927a305a26833290 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:37:28.072538 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6683d05-14f9-401d-a4bf-c8080c1a27ae None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:37:28.073022 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6683d05-14f9-401d-a4bf-c8080c1a27ae None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:37:28.073445 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6683d05-14f9-401d-a4bf-c8080c1a27ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:37:28.091519 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:37:28.127676 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-c6683d05-14f9-401d-a4bf-c8080c1a27ae None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:37:28.129988 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-c6683d05-14f9-401d-a4bf-c8080c1a27ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:37:28.271888 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1202/2427] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:37:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:37:28.355603 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e5141-9f27-42dc-9fbf-d2e6dc8cb276 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:37:28.355940 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e5141-9f27-42dc-9fbf-d2e6dc8cb276 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:37:28.356279 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e5141-9f27-42dc-9fbf-d2e6dc8cb276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:37:28.375733 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-521e5141-9f27-42dc-9fbf-d2e6dc8cb276 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:37:28.376869 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-521e5141-9f27-42dc-9fbf-d2e6dc8cb276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:37:28.386448 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1226/2428] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:37:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:37:28.390740 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6683d05-14f9-401d-a4bf-c8080c1a27ae None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:37:28.404758 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6683d05-14f9-401d-a4bf-c8080c1a27ae None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:37:28.413654 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918621d2-84fa-4d63-9461-508fae6d0227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:37:28.414702 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918621d2-84fa-4d63-9461-508fae6d0227 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:37:28.415447 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918621d2-84fa-4d63-9461-508fae6d0227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:37:28.418185 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918621d2-84fa-4d63-9461-508fae6d0227 admin admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:37:28.419253 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918621d2-84fa-4d63-9461-508fae6d0227 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:37:28.420605 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918621d2-84fa-4d63-9461-508fae6d0227 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:37:28.422281 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918621d2-84fa-4d63-9461-508fae6d0227 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:37:28.437326 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1203/2429] 10.222.0.26 () {58 vars in 1152 bytes} [Fri Jul 1 19:37:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:37:28.445809 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e5141-9f27-42dc-9fbf-d2e6dc8cb276 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:37:28.457657 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e5141-9f27-42dc-9fbf-d2e6dc8cb276 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:37:28.462574 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bcf15c-fa02-447d-a8aa-e39bb2c0482a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:37:28.463853 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bcf15c-fa02-447d-a8aa-e39bb2c0482a admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:37:28.464135 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bcf15c-fa02-447d-a8aa-e39bb2c0482a admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:37:28.464409 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bcf15c-fa02-447d-a8aa-e39bb2c0482a admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:37:28.465108 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bcf15c-fa02-447d-a8aa-e39bb2c0482a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:37:28.467039 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bcf15c-fa02-447d-a8aa-e39bb2c0482a admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:37:28.513708 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1227/2430] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:37:28 2022] POST /identity/v3/projects => generated 385 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:37:28.518359 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918621d2-84fa-4d63-9461-508fae6d0227 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:37:28.534900 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918621d2-84fa-4d63-9461-508fae6d0227 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:37:28.631486 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dda851a-d83b-4b03-92ed-fff1606e55f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:37:28.632802 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda851a-d83b-4b03-92ed-fff1606e55f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:37:28.633773 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda851a-d83b-4b03-92ed-fff1606e55f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:37:28.633926 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda851a-d83b-4b03-92ed-fff1606e55f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:37:28.635763 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dda851a-d83b-4b03-92ed-fff1606e55f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:37:28.640071 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dda851a-d83b-4b03-92ed-fff1606e55f5 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:37:28.687684 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1204/2431] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:37:28 2022] POST /identity/v3/users => generated 293 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:37:28.689370 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bcf15c-fa02-447d-a8aa-e39bb2c0482a admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:37:28.700819 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bcf15c-fa02-447d-a8aa-e39bb2c0482a admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:37:28.705546 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06513c4c-fe60-4e50-a5fb-51fbbfa8f5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:37:28.706212 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06513c4c-fe60-4e50-a5fb-51fbbfa8f5c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:37:28.706500 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06513c4c-fe60-4e50-a5fb-51fbbfa8f5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:37:28.706786 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06513c4c-fe60-4e50-a5fb-51fbbfa8f5c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:37:28.707513 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06513c4c-fe60-4e50-a5fb-51fbbfa8f5c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:37:28.709110 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06513c4c-fe60-4e50-a5fb-51fbbfa8f5c3 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:37:28.720579 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1228/2432] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:37:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:37:28.724640 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dda851a-d83b-4b03-92ed-fff1606e55f5 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:37:28.735245 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dda851a-d83b-4b03-92ed-fff1606e55f5 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:37:28.740462 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d4800a-bed3-4ebe-9533-7a5c28722345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:37:28.741474 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d4800a-bed3-4ebe-9533-7a5c28722345 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:37:28.741758 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d4800a-bed3-4ebe-9533-7a5c28722345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:37:28.742228 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d4800a-bed3-4ebe-9533-7a5c28722345 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:37:28.743074 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d4800a-bed3-4ebe-9533-7a5c28722345 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:37:28.744809 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d4800a-bed3-4ebe-9533-7a5c28722345 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:37:28.760621 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1205/2433] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:37:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:37:28.761997 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06513c4c-fe60-4e50-a5fb-51fbbfa8f5c3 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:37:28.772692 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06513c4c-fe60-4e50-a5fb-51fbbfa8f5c3 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:37:28.779545 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8a9ff4-33fb-4e2f-8df7-1199f114fc3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:37:28.780666 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8a9ff4-33fb-4e2f-8df7-1199f114fc3c admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:37:28.781120 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8a9ff4-33fb-4e2f-8df7-1199f114fc3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:37:28.781515 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8a9ff4-33fb-4e2f-8df7-1199f114fc3c admin admin] PATH_INFO: `/v3/projects/17a85b2de06a4414ae2eb971df50d831/users/d3f1c36b7295447d9f207cf59dc50e66/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:37:28.798073 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8a9ff4-33fb-4e2f-8df7-1199f114fc3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=17a85b2de06a4414ae2eb971df50d831, user_id=d3f1c36b7295447d9f207cf59dc50e66, role_id=4cbf6ec846eb4b7c8cc52e9bfd6f076f)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:37:28.800819 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8a9ff4-33fb-4e2f-8df7-1199f114fc3c admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:37:28.803943 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:37:28.818217 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1229/2434] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:37:28 2022] PUT /identity/v3/projects/17a85b2de06a4414ae2eb971df50d831/users/d3f1c36b7295447d9f207cf59dc50e66/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:37:28.829657 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c0150-6b82-4fce-8606-1cbd1c269e82 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:37:28.829948 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c0150-6b82-4fce-8606-1cbd1c269e82 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:37:28.830391 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c0150-6b82-4fce-8606-1cbd1c269e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:37:28.850182 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-4a9c0150-6b82-4fce-8606-1cbd1c269e82 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:37:28.851397 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-4a9c0150-6b82-4fce-8606-1cbd1c269e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:37:28.915300 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1206/2435] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:37:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:37:28.924955 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8a9ff4-33fb-4e2f-8df7-1199f114fc3c admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:37:28.926845 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-5f8a9ff4-33fb-4e2f-8df7-1199f114fc3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:37:28.990525 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8a9ff4-33fb-4e2f-8df7-1199f114fc3c admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:37:28.995092 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1719cd-efbc-474f-a4eb-37c5016e1b8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:37:28.995989 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1719cd-efbc-474f-a4eb-37c5016e1b8b service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:37:28.996356 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1719cd-efbc-474f-a4eb-37c5016e1b8b service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:37:28.996716 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1719cd-efbc-474f-a4eb-37c5016e1b8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:37:29.007917 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1719cd-efbc-474f-a4eb-37c5016e1b8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:37:29.010084 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1719cd-efbc-474f-a4eb-37c5016e1b8b service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:37:29.020289 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1230/2436] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:37:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 19:37:33.818901 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dce9ba-410e-42b7-b707-2278ae4dabc8 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:37:33.819484 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dce9ba-410e-42b7-b707-2278ae4dabc8 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:37:33.819591 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dce9ba-410e-42b7-b707-2278ae4dabc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:37:33.832451 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:37:33.849933 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-d7dce9ba-410e-42b7-b707-2278ae4dabc8 None None] MFA Rules not processed for user `d3f1c36b7295447d9f207cf59dc50e66`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:37:33.851322 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-d7dce9ba-410e-42b7-b707-2278ae4dabc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:37:33.918706 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1207/2437] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:37:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:37:33.923187 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1719cd-efbc-474f-a4eb-37c5016e1b8b service neutron] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:37:33.933264 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1719cd-efbc-474f-a4eb-37c5016e1b8b service neutron] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:37:33.938218 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f16a88d-3b02-4e30-b8fb-5bea7f624e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:37:33.938945 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f16a88d-3b02-4e30-b8fb-5bea7f624e5e admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:37:33.939300 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f16a88d-3b02-4e30-b8fb-5bea7f624e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:37:33.939649 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f16a88d-3b02-4e30-b8fb-5bea7f624e5e admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:37:33.940435 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f16a88d-3b02-4e30-b8fb-5bea7f624e5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:37:33.942420 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f16a88d-3b02-4e30-b8fb-5bea7f624e5e admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:37:33.970529 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1231/2438] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:37:33 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:37:33.974542 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dce9ba-410e-42b7-b707-2278ae4dabc8 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:37:33.986202 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dce9ba-410e-42b7-b707-2278ae4dabc8 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:37:34.046046 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da87e76-a95e-47b6-88d7-c1638bb680ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:37:34.046755 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da87e76-a95e-47b6-88d7-c1638bb680ff admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:37:34.047042 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da87e76-a95e-47b6-88d7-c1638bb680ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:37:34.047319 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da87e76-a95e-47b6-88d7-c1638bb680ff admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:37:34.048031 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da87e76-a95e-47b6-88d7-c1638bb680ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:37:34.050043 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da87e76-a95e-47b6-88d7-c1638bb680ff admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:37:34.071490 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1208/2439] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:37:33 2022] POST /identity/v3/users => generated 298 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:37:34.076134 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f16a88d-3b02-4e30-b8fb-5bea7f624e5e admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:37:34.087083 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f16a88d-3b02-4e30-b8fb-5bea7f624e5e admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:37:34.092736 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b57e208-e589-4724-a596-fa8fcaab8164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:37:34.093432 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b57e208-e589-4724-a596-fa8fcaab8164 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:37:34.093720 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b57e208-e589-4724-a596-fa8fcaab8164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:37:34.093996 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b57e208-e589-4724-a596-fa8fcaab8164 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:37:34.094740 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b57e208-e589-4724-a596-fa8fcaab8164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:37:34.096336 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b57e208-e589-4724-a596-fa8fcaab8164 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:37:34.107631 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1232/2440] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:37:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:37:34.111797 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da87e76-a95e-47b6-88d7-c1638bb680ff admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:37:34.122602 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da87e76-a95e-47b6-88d7-c1638bb680ff admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:37:34.127699 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e010d6-10b6-4502-8f9c-9c1be367e287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:37:34.128665 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e010d6-10b6-4502-8f9c-9c1be367e287 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:37:34.128959 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e010d6-10b6-4502-8f9c-9c1be367e287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:37:34.129272 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e010d6-10b6-4502-8f9c-9c1be367e287 admin admin] PATH_INFO: `/v3/projects/c616bc48ec0d4c8aacf7ca29509602a5/users/0b40fc1e3cc84c3b9a6b98a49dccbe77/roles/6cb03785fb184ef587509b3174622f69` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:37:34.146806 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e010d6-10b6-4502-8f9c-9c1be367e287 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c616bc48ec0d4c8aacf7ca29509602a5, user_id=0b40fc1e3cc84c3b9a6b98a49dccbe77, role_id=6cb03785fb184ef587509b3174622f69)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:37:34.149552 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e010d6-10b6-4502-8f9c-9c1be367e287 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:37:34.180398 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1209/2441] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:37:34 2022] PUT /identity/v3/projects/c616bc48ec0d4c8aacf7ca29509602a5/users/0b40fc1e3cc84c3b9a6b98a49dccbe77/roles/6cb03785fb184ef587509b3174622f69 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:37:34.186307 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b57e208-e589-4724-a596-fa8fcaab8164 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:37:34.207986 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b57e208-e589-4724-a596-fa8fcaab8164 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:37:34.288998 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39fc977-749c-4d8d-a8e4-6bd1dfda5ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:37:34.290294 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39fc977-749c-4d8d-a8e4-6bd1dfda5ef9 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:37:34.290673 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39fc977-749c-4d8d-a8e4-6bd1dfda5ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:37:34.291608 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39fc977-749c-4d8d-a8e4-6bd1dfda5ef9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:37:34.292390 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39fc977-749c-4d8d-a8e4-6bd1dfda5ef9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:37:34.294499 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39fc977-749c-4d8d-a8e4-6bd1dfda5ef9 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:37:34.307473 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1233/2442] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:37:34 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:37:34.311898 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e010d6-10b6-4502-8f9c-9c1be367e287 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:37:34.325283 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e010d6-10b6-4502-8f9c-9c1be367e287 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:37:34.331761 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c915c-30a8-43e5-bbad-60a1aa0679a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:37:34.332678 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c915c-30a8-43e5-bbad-60a1aa0679a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:37:34.332967 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c915c-30a8-43e5-bbad-60a1aa0679a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:37:34.333263 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c915c-30a8-43e5-bbad-60a1aa0679a9 admin admin] PATH_INFO: `/v3/projects/c616bc48ec0d4c8aacf7ca29509602a5/users/0b40fc1e3cc84c3b9a6b98a49dccbe77/roles/6cb03785fb184ef587509b3174622f69` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:37:34.335346 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63c915c-30a8-43e5-bbad-60a1aa0679a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c616bc48ec0d4c8aacf7ca29509602a5, user_id=0b40fc1e3cc84c3b9a6b98a49dccbe77, role_id=6cb03785fb184ef587509b3174622f69)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:37:34.338840 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63c915c-30a8-43e5-bbad-60a1aa0679a9 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:37:34.350909 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1210/2443] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:37:34 2022] PUT /identity/v3/projects/c616bc48ec0d4c8aacf7ca29509602a5/users/0b40fc1e3cc84c3b9a6b98a49dccbe77/roles/6cb03785fb184ef587509b3174622f69 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:37:39.704549 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f68aa-1411-495c-8050-953d8c722c8a None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:37:39.705040 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f68aa-1411-495c-8050-953d8c722c8a None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:37:39.705191 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f68aa-1411-495c-8050-953d8c722c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:37:39.736132 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-535f68aa-1411-495c-8050-953d8c722c8a None None] MFA Rules not processed for user `0b40fc1e3cc84c3b9a6b98a49dccbe77`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:37:39.737420 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-535f68aa-1411-495c-8050-953d8c722c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:37:39.788236 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:37:39.816785 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1234/2444] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:37:39 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:37:39.830363 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c915c-30a8-43e5-bbad-60a1aa0679a9 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:37:39.834679 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-c63c915c-30a8-43e5-bbad-60a1aa0679a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:37:39.893686 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:37:39.898762 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c915c-30a8-43e5-bbad-60a1aa0679a9 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:37:39.907426 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe6aeec-3724-40bd-b2d2-8024ac3a55b8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bbcb2463f9c46ddaaa247e4876aca48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:37:39.910453 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6aeec-3724-40bd-b2d2-8024ac3a55b8 service glance] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:37:39.910453 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6aeec-3724-40bd-b2d2-8024ac3a55b8 service glance] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:37:39.910763 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6aeec-3724-40bd-b2d2-8024ac3a55b8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:37:39.981422 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe6aeec-3724-40bd-b2d2-8024ac3a55b8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:37:39.982894 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe6aeec-3724-40bd-b2d2-8024ac3a55b8 service glance] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:37:39.992229 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1211/2445] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:37:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:37:40.118156 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e01fc6a-f716-4969-b21c-49151dd5a7ae None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:37:40.119074 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e01fc6a-f716-4969-b21c-49151dd5a7ae None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:37:40.119448 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e01fc6a-f716-4969-b21c-49151dd5a7ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:37:40.150183 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-7e01fc6a-f716-4969-b21c-49151dd5a7ae None None] MFA Rules not processed for user `0834256bdfbc48ffbc5af6d6760ecdd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:37:40.151492 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-7e01fc6a-f716-4969-b21c-49151dd5a7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:37:40.217840 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1235/2446] 10.222.0.26 () {58 vars in 1009 bytes} [Fri Jul 1 19:37:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:37:40.236916 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe6aeec-3724-40bd-b2d2-8024ac3a55b8 service glance] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:37:40.239476 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-bbe6aeec-3724-40bd-b2d2-8024ac3a55b8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:37:40.324094 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe6aeec-3724-40bd-b2d2-8024ac3a55b8 service glance] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:37:40.330673 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212a60b9-b2e0-4532-8589-4afbe3f0e772 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e958c5b03a9346d59c32675c5271bf3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:37:40.331509 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a60b9-b2e0-4532-8589-4afbe3f0e772 service swift] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:37:40.331881 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a60b9-b2e0-4532-8589-4afbe3f0e772 service swift] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:37:40.332123 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a60b9-b2e0-4532-8589-4afbe3f0e772 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:37:40.344565 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212a60b9-b2e0-4532-8589-4afbe3f0e772 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:37:40.346245 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212a60b9-b2e0-4532-8589-4afbe3f0e772 service swift] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:37:40.357844 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1212/2447] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Jul 1 19:37:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 01 19:37:43.249131 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e00de-f0c4-450c-95e8-0a80afa3ac06 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:37:43.250202 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e00de-f0c4-450c-95e8-0a80afa3ac06 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:37:43.250689 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e00de-f0c4-450c-95e8-0a80afa3ac06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:37:43.280030 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-4e3e00de-f0c4-450c-95e8-0a80afa3ac06 None None] MFA Rules not processed for user `0834256bdfbc48ffbc5af6d6760ecdd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:37:43.282231 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-4e3e00de-f0c4-450c-95e8-0a80afa3ac06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:37:43.299722 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1236/2448] 10.222.0.26 () {58 vars in 967 bytes} [Fri Jul 1 19:37:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:37:43.349992 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212a60b9-b2e0-4532-8589-4afbe3f0e772 service swift] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:37:43.369397 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212a60b9-b2e0-4532-8589-4afbe3f0e772 service swift] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:37:43.376376 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e9e479-2c78-4dad-a017-b00fa84e7680 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e958c5b03a9346d59c32675c5271bf3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:37:43.377687 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e9e479-2c78-4dad-a017-b00fa84e7680 service swift] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:37:43.377687 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e9e479-2c78-4dad-a017-b00fa84e7680 service swift] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:37:43.377902 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e9e479-2c78-4dad-a017-b00fa84e7680 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:37:43.394857 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e9e479-2c78-4dad-a017-b00fa84e7680 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:37:43.394857 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e9e479-2c78-4dad-a017-b00fa84e7680 service swift] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:37:43.402080 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1213/2449] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Jul 1 19:37:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 01 19:37:50.784792 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d347236-4436-41ba-b9e7-78d3edc3d447 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:37:50.785424 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d347236-4436-41ba-b9e7-78d3edc3d447 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:37:50.785680 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d347236-4436-41ba-b9e7-78d3edc3d447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:37:50.805453 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-3d347236-4436-41ba-b9e7-78d3edc3d447 None None] MFA Rules not processed for user `91c82e59af62461e85d22fc4a8269c25`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:37:50.807325 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-3d347236-4436-41ba-b9e7-78d3edc3d447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:37:50.881435 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1237/2450] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:37:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:37:50.899196 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5445fb-1ef8-418d-a066-3d9d7ff3542a None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:37:50.900189 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5445fb-1ef8-418d-a066-3d9d7ff3542a None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:37:50.900477 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5445fb-1ef8-418d-a066-3d9d7ff3542a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:37:50.919042 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-da5445fb-1ef8-418d-a066-3d9d7ff3542a None None] MFA Rules not processed for user `d3f1c36b7295447d9f207cf59dc50e66`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:37:50.920274 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-da5445fb-1ef8-418d-a066-3d9d7ff3542a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:37:50.927567 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1214/2451] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:37:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:37:54.664785 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8828c7-92f4-4f91-8f7c-898eeeb2d940 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:37:54.665185 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8828c7-92f4-4f91-8f7c-898eeeb2d940 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:37:54.665385 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8828c7-92f4-4f91-8f7c-898eeeb2d940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:37:54.701947 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-eb8828c7-92f4-4f91-8f7c-898eeeb2d940 None None] MFA Rules not processed for user `0834256bdfbc48ffbc5af6d6760ecdd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:37:54.703698 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-eb8828c7-92f4-4f91-8f7c-898eeeb2d940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:37:54.713450 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1238/2452] 10.222.0.26 () {58 vars in 1009 bytes} [Fri Jul 1 19:37:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:37:54.730960 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5445fb-1ef8-418d-a066-3d9d7ff3542a None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:37:54.749306 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5445fb-1ef8-418d-a066-3d9d7ff3542a None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:37:54.756219 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958e334d-e61b-49cd-a682-7ed7f463d6f4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e958c5b03a9346d59c32675c5271bf3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:37:54.756957 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e334d-e61b-49cd-a682-7ed7f463d6f4 service swift] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:37:54.757521 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e334d-e61b-49cd-a682-7ed7f463d6f4 service swift] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:37:54.757987 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e334d-e61b-49cd-a682-7ed7f463d6f4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:37:54.769870 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958e334d-e61b-49cd-a682-7ed7f463d6f4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:37:54.772125 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958e334d-e61b-49cd-a682-7ed7f463d6f4 service swift] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:37:54.785859 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1215/2453] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Jul 1 19:37:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 01 19:38:04.685600 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=69 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:04.779029 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=73 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:26.246122 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8828c7-92f4-4f91-8f7c-898eeeb2d940 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:26.299857 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8828c7-92f4-4f91-8f7c-898eeeb2d940 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:26.303497 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf32e8c8-008c-4d44-ab43-b4405f545b52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:26.304139 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32e8c8-008c-4d44-ab43-b4405f545b52 service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:26.304429 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32e8c8-008c-4d44-ab43-b4405f545b52 service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:26.304718 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32e8c8-008c-4d44-ab43-b4405f545b52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:26.314286 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf32e8c8-008c-4d44-ab43-b4405f545b52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:26.315713 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf32e8c8-008c-4d44-ab43-b4405f545b52 service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:26.325111 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1239/2454] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:38:26 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:38:32.899183 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958e334d-e61b-49cd-a682-7ed7f463d6f4 service swift] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:32.900751 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-958e334d-e61b-49cd-a682-7ed7f463d6f4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:33.000902 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958e334d-e61b-49cd-a682-7ed7f463d6f4 service swift] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:33.006202 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2eeea4-3a8a-4f41-8b90-2296221c65ff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '941e65d95bcd4e66a6489280520c12de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:33.006849 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2eeea4-3a8a-4f41-8b90-2296221c65ff service placement] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:33.007162 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2eeea4-3a8a-4f41-8b90-2296221c65ff service placement] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:33.007439 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2eeea4-3a8a-4f41-8b90-2296221c65ff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:33.009215 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-7f2eeea4-3a8a-4f41-8b90-2296221c65ff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:33.020943 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2eeea4-3a8a-4f41-8b90-2296221c65ff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:33.022583 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2eeea4-3a8a-4f41-8b90-2296221c65ff service placement] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:33.032883 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1216/2455] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:38:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:38:35.932127 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea75789-ae22-4d04-accc-1ba96efab38e None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:35.932653 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea75789-ae22-4d04-accc-1ba96efab38e None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:35.932761 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea75789-ae22-4d04-accc-1ba96efab38e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:35.950535 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-dea75789-ae22-4d04-accc-1ba96efab38e None None] MFA Rules not processed for user `75b8c92fd65a49e493373b4a13c18290`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:35.951721 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-dea75789-ae22-4d04-accc-1ba96efab38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:36.005132 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1240/2456] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:38:35 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:38:43.028251 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=41 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:45.998266 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=51 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:59.980643 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c0904-be43-4017-ac9a-ad564698eb45 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:59.981254 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c0904-be43-4017-ac9a-ad564698eb45 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:59.981254 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c0904-be43-4017-ac9a-ad564698eb45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:59.998014 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-9d3c0904-be43-4017-ac9a-ad564698eb45 None None] MFA Rules not processed for user `1827b8d35e274416b3f6adbc28691ad6`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:59.999187 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-9d3c0904-be43-4017-ac9a-ad564698eb45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:00.052190 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1217/2457] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:38:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:39:10.045765 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=25 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:39:27.752551 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9256628-c403-4c70-adf4-c513553278b5 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:27.753142 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9256628-c403-4c70-adf4-c513553278b5 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:27.753142 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9256628-c403-4c70-adf4-c513553278b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:27.771082 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-c9256628-c403-4c70-adf4-c513553278b5 None None] MFA Rules not processed for user `91c82e59af62461e85d22fc4a8269c25`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:39:27.772286 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-c9256628-c403-4c70-adf4-c513553278b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:27.780040 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1241/2458] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:39:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:39:37.765662 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=3 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:39:49.291473 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15d985-9fbc-431c-925f-3492fcf26181 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:49.292167 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15d985-9fbc-431c-925f-3492fcf26181 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:49.292454 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15d985-9fbc-431c-925f-3492fcf26181 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:49.293878 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1218/2459] 10.222.0.26 () {54 vars in 921 bytes} [Fri Jul 1 19:39:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:39:49.300491 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c785af4-d152-44e9-af97-b96e9d4162b3 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:49.300975 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c785af4-d152-44e9-af97-b96e9d4162b3 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:49.301074 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c785af4-d152-44e9-af97-b96e9d4162b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:49.320473 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-6c785af4-d152-44e9-af97-b96e9d4162b3 None None] MFA Rules not processed for user `4557d17438a249ee8f75927449a1a059`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:39:49.321883 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-6c785af4-d152-44e9-af97-b96e9d4162b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:49.329795 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1242/2460] 10.222.0.26 () {58 vars in 1018 bytes} [Fri Jul 1 19:39:49 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:39:49.341774 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15d985-9fbc-431c-925f-3492fcf26181 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:49.343568 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-6e15d985-9fbc-431c-925f-3492fcf26181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:49.356541 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15d985-9fbc-431c-925f-3492fcf26181 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:49.360077 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe00f47-3a02-4a07-8777-12ddbddcbb92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:49.360716 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe00f47-3a02-4a07-8777-12ddbddcbb92 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:49.360997 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe00f47-3a02-4a07-8777-12ddbddcbb92 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:49.361365 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe00f47-3a02-4a07-8777-12ddbddcbb92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:49.368969 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe00f47-3a02-4a07-8777-12ddbddcbb92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:49.370438 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe00f47-3a02-4a07-8777-12ddbddcbb92 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:49.378395 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1219/2461] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:39:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:39:49.463091 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16875f36-cf35-4010-8eb8-ed21ef8367d6 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:49.463383 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16875f36-cf35-4010-8eb8-ed21ef8367d6 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:49.463659 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16875f36-cf35-4010-8eb8-ed21ef8367d6 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:49.465066 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1243/2462] 10.222.0.26 () {54 vars in 921 bytes} [Fri Jul 1 19:39:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:39:49.471839 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a01208-df6b-4b0d-b6e7-383eafdced89 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:49.472128 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a01208-df6b-4b0d-b6e7-383eafdced89 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:49.472406 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a01208-df6b-4b0d-b6e7-383eafdced89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:49.519121 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-d7a01208-df6b-4b0d-b6e7-383eafdced89 None None] MFA Rules not processed for user `13fd76fc7dd1410b9cde5adbaa6cb2e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:39:49.520238 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-d7a01208-df6b-4b0d-b6e7-383eafdced89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:49.593587 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1220/2463] 10.222.0.26 () {58 vars in 1018 bytes} [Fri Jul 1 19:39:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:39:49.603948 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16875f36-cf35-4010-8eb8-ed21ef8367d6 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:49.615184 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16875f36-cf35-4010-8eb8-ed21ef8367d6 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:49.618817 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3ad1b6-44ca-4343-89c5-344e09624edc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:49.619443 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ad1b6-44ca-4343-89c5-344e09624edc service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:49.619724 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ad1b6-44ca-4343-89c5-344e09624edc service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:49.619999 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ad1b6-44ca-4343-89c5-344e09624edc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:49.630130 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3ad1b6-44ca-4343-89c5-344e09624edc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:49.631591 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3ad1b6-44ca-4343-89c5-344e09624edc service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:49.642717 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1244/2464] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:39:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:39:50.476505 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a01208-df6b-4b0d-b6e7-383eafdced89 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:50.487838 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a01208-df6b-4b0d-b6e7-383eafdced89 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:50.491806 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f6eef-5c23-465c-bb99-d501a1178f5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:50.492541 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f6eef-5c23-465c-bb99-d501a1178f5f service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:50.492846 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f6eef-5c23-465c-bb99-d501a1178f5f service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:50.493525 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f6eef-5c23-465c-bb99-d501a1178f5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:50.495045 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-dd9f6eef-5c23-465c-bb99-d501a1178f5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:50.510867 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9f6eef-5c23-465c-bb99-d501a1178f5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:50.512313 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9f6eef-5c23-465c-bb99-d501a1178f5f service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:50.524303 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1221/2465] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:39:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:39:53.014624 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3ad1b6-44ca-4343-89c5-344e09624edc service neutron] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:53.023091 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3ad1b6-44ca-4343-89c5-344e09624edc service neutron] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:53.026776 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841512d9-4e84-4786-84e8-895eb6669229 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:53.027402 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841512d9-4e84-4786-84e8-895eb6669229 service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:53.027688 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841512d9-4e84-4786-84e8-895eb6669229 service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:53.027964 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841512d9-4e84-4786-84e8-895eb6669229 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:53.029738 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-841512d9-4e84-4786-84e8-895eb6669229 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:53.043032 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841512d9-4e84-4786-84e8-895eb6669229 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:53.044942 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841512d9-4e84-4786-84e8-895eb6669229 service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:53.055746 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1245/2466] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:39:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:39:53.457584 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ead26-1655-40f5-b4f3-b5dc9f280e3c None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:53.458062 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ead26-1655-40f5-b4f3-b5dc9f280e3c None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:53.458365 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ead26-1655-40f5-b4f3-b5dc9f280e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:53.516183 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-2f1ead26-1655-40f5-b4f3-b5dc9f280e3c None None] MFA Rules not processed for user `0834256bdfbc48ffbc5af6d6760ecdd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:39:53.517349 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-2f1ead26-1655-40f5-b4f3-b5dc9f280e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:53.535529 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1222/2467] 10.222.0.26 () {58 vars in 1009 bytes} [Fri Jul 1 19:39:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:39:53.577999 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841512d9-4e84-4786-84e8-895eb6669229 service neutron] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:53.600659 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841512d9-4e84-4786-84e8-895eb6669229 service neutron] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:53.606074 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529bebd3-0be3-4966-ae2a-2099c7e8813b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e958c5b03a9346d59c32675c5271bf3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:53.607545 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529bebd3-0be3-4966-ae2a-2099c7e8813b service swift] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:53.608009 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529bebd3-0be3-4966-ae2a-2099c7e8813b service swift] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:53.608506 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529bebd3-0be3-4966-ae2a-2099c7e8813b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:53.617525 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529bebd3-0be3-4966-ae2a-2099c7e8813b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:53.619120 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529bebd3-0be3-4966-ae2a-2099c7e8813b service swift] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:53.630386 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1246/2468] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Jul 1 19:39:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 01 19:40:03.532235 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=76 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:40:03.628290 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=25 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:40:06.158299 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1ead26-1655-40f5-b4f3-b5dc9f280e3c None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:40:06.169135 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1ead26-1655-40f5-b4f3-b5dc9f280e3c None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:40:06.178997 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e62cc35-b1c5-409d-a4ec-7cf339c3230f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:40:06.179923 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62cc35-b1c5-409d-a4ec-7cf339c3230f service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:06.180374 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62cc35-b1c5-409d-a4ec-7cf339c3230f service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:06.181023 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62cc35-b1c5-409d-a4ec-7cf339c3230f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:06.183217 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-7e62cc35-b1c5-409d-a4ec-7cf339c3230f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:40:06.198126 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e62cc35-b1c5-409d-a4ec-7cf339c3230f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:40:06.199575 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e62cc35-b1c5-409d-a4ec-7cf339c3230f service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:40:06.210053 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1223/2469] 10.222.0.26 () {60 vars in 1396 bytes} [Fri Jul 1 19:40:06 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3256 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:40:08.075969 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529bebd3-0be3-4966-ae2a-2099c7e8813b service swift] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:40:08.085947 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529bebd3-0be3-4966-ae2a-2099c7e8813b service swift] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:40:08.089545 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d0f0e-067e-4995-a324-6b01c9d0829e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:40:08.090183 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d0f0e-067e-4995-a324-6b01c9d0829e service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:08.090470 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d0f0e-067e-4995-a324-6b01c9d0829e service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:08.090746 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d0f0e-067e-4995-a324-6b01c9d0829e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:08.092527 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-c48d0f0e-067e-4995-a324-6b01c9d0829e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:40:08.102889 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48d0f0e-067e-4995-a324-6b01c9d0829e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:40:08.104468 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48d0f0e-067e-4995-a324-6b01c9d0829e service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:40:08.113717 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1247/2470] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:40:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:40:09.597431 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e62cc35-b1c5-409d-a4ec-7cf339c3230f service neutron] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:40:09.606314 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e62cc35-b1c5-409d-a4ec-7cf339c3230f service neutron] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:40:09.609949 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b98d8d-d6c3-4771-b6bd-bdd690649e60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:40:09.610585 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b98d8d-d6c3-4771-b6bd-bdd690649e60 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:09.610908 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b98d8d-d6c3-4771-b6bd-bdd690649e60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:09.611189 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b98d8d-d6c3-4771-b6bd-bdd690649e60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:09.612960 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-82b98d8d-d6c3-4771-b6bd-bdd690649e60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:40:09.622299 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b98d8d-d6c3-4771-b6bd-bdd690649e60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:40:09.623756 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b98d8d-d6c3-4771-b6bd-bdd690649e60 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:40:09.632383 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1224/2471] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:40:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:40:09.940890 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d0f0e-067e-4995-a324-6b01c9d0829e service neutron] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:40:09.953031 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d0f0e-067e-4995-a324-6b01c9d0829e service neutron] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:40:09.959581 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b83b52-106e-4a4b-a773-ac77a571d853 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '941e65d95bcd4e66a6489280520c12de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:40:09.960248 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b83b52-106e-4a4b-a773-ac77a571d853 service placement] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:09.960531 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b83b52-106e-4a4b-a773-ac77a571d853 service placement] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:09.960808 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b83b52-106e-4a4b-a773-ac77a571d853 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:09.962653 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-b4b83b52-106e-4a4b-a773-ac77a571d853 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:40:09.975062 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b83b52-106e-4a4b-a773-ac77a571d853 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:40:09.976637 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b83b52-106e-4a4b-a773-ac77a571d853 service placement] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:40:09.990056 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1248/2472] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:40:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:40:11.836628 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b98d8d-d6c3-4771-b6bd-bdd690649e60 service neutron] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:40:11.838677 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-82b98d8d-d6c3-4771-b6bd-bdd690649e60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:40:11.931186 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b98d8d-d6c3-4771-b6bd-bdd690649e60 service neutron] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:40:11.936847 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0156e02-0874-4d30-9857-00060c6d7a87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a3ed285ee4c4d04abf7daf0aeb9fb7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:40:11.937661 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0156e02-0874-4d30-9857-00060c6d7a87 service cinder] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:11.938190 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0156e02-0874-4d30-9857-00060c6d7a87 service cinder] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:11.938504 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0156e02-0874-4d30-9857-00060c6d7a87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:11.940759 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-f0156e02-0874-4d30-9857-00060c6d7a87 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:40:11.952714 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0156e02-0874-4d30-9857-00060c6d7a87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:40:11.954345 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0156e02-0874-4d30-9857-00060c6d7a87 service cinder] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:40:11.964225 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1225/2473] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:40:11 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:40:13.599309 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f7cc5e-c859-464a-917a-4948a762f43f None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:13.600200 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f7cc5e-c859-464a-917a-4948a762f43f None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:13.600646 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f7cc5e-c859-464a-917a-4948a762f43f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:13.622135 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-a2f7cc5e-c859-464a-917a-4948a762f43f None None] MFA Rules not processed for user `0834256bdfbc48ffbc5af6d6760ecdd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:40:13.623402 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-a2f7cc5e-c859-464a-917a-4948a762f43f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:40:13.649726 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1249/2474] 10.222.0.26 () {58 vars in 967 bytes} [Fri Jul 1 19:40:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:40:13.650479 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0156e02-0874-4d30-9857-00060c6d7a87 service cinder] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:40:13.671328 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0156e02-0874-4d30-9857-00060c6d7a87 service cinder] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:40:13.678343 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c8999-8c26-4cf2-b4aa-c218c9e296b7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e958c5b03a9346d59c32675c5271bf3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:40:13.679007 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c8999-8c26-4cf2-b4aa-c218c9e296b7 service swift] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:13.679468 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c8999-8c26-4cf2-b4aa-c218c9e296b7 service swift] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:13.679753 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c8999-8c26-4cf2-b4aa-c218c9e296b7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:13.689945 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1c8999-8c26-4cf2-b4aa-c218c9e296b7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:40:13.691585 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1c8999-8c26-4cf2-b4aa-c218c9e296b7 service swift] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:40:13.711602 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1226/2475] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Jul 1 19:40:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 01 19:40:16.258125 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1a17a-a9c9-49c5-9bef-9274139e931a None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:16.258629 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1a17a-a9c9-49c5-9bef-9274139e931a None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:16.258724 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1a17a-a9c9-49c5-9bef-9274139e931a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:16.276286 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-d6e1a17a-a9c9-49c5-9bef-9274139e931a None None] MFA Rules not processed for user `0834256bdfbc48ffbc5af6d6760ecdd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:40:16.277509 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-d6e1a17a-a9c9-49c5-9bef-9274139e931a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:40:16.285827 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1250/2476] 10.222.0.26 () {58 vars in 1009 bytes} [Fri Jul 1 19:40:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:40:16.299470 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c8999-8c26-4cf2-b4aa-c218c9e296b7 service swift] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:40:16.311109 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c8999-8c26-4cf2-b4aa-c218c9e296b7 service swift] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:40:16.317966 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42223dd2-94df-47dc-970d-b6dafe8ac832 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e958c5b03a9346d59c32675c5271bf3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:40:16.318791 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42223dd2-94df-47dc-970d-b6dafe8ac832 service swift] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:16.319176 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42223dd2-94df-47dc-970d-b6dafe8ac832 service swift] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:16.319578 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42223dd2-94df-47dc-970d-b6dafe8ac832 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:16.329779 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42223dd2-94df-47dc-970d-b6dafe8ac832 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:40:16.331744 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42223dd2-94df-47dc-970d-b6dafe8ac832 service swift] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:40:16.349459 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1227/2477] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Jul 1 19:40:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 01 19:40:18.206704 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8cef7-27f9-4788-aba1-02187afe576e None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:18.207248 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8cef7-27f9-4788-aba1-02187afe576e None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:18.207248 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8cef7-27f9-4788-aba1-02187afe576e None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:18.208583 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1251/2478] 10.222.0.26 () {54 vars in 921 bytes} [Fri Jul 1 19:40:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 19:40:18.238358 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c2c4f-08c4-4c2b-bea3-293119a8bcc4 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:18.239741 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c2c4f-08c4-4c2b-bea3-293119a8bcc4 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:18.240241 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c2c4f-08c4-4c2b-bea3-293119a8bcc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:18.299929 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-3b2c2c4f-08c4-4c2b-bea3-293119a8bcc4 None None] MFA Rules not processed for user `941e65d95bcd4e66a6489280520c12de`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:40:18.301173 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-3b2c2c4f-08c4-4c2b-bea3-293119a8bcc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:40:18.311514 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1228/2479] 10.222.0.26 () {58 vars in 1018 bytes} [Fri Jul 1 19:40:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:40:18.341623 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e8cef7-27f9-4788-aba1-02187afe576e None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:40:18.344411 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-11e8cef7-27f9-4788-aba1-02187afe576e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:40:18.386884 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e8cef7-27f9-4788-aba1-02187afe576e None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:40:18.401819 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73764a4-f51f-486d-b39c-e8eb80785815 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '941e65d95bcd4e66a6489280520c12de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:40:18.402649 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73764a4-f51f-486d-b39c-e8eb80785815 service placement] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:18.403013 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73764a4-f51f-486d-b39c-e8eb80785815 service placement] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:18.403296 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73764a4-f51f-486d-b39c-e8eb80785815 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:18.438063 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73764a4-f51f-486d-b39c-e8eb80785815 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:40:18.439734 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73764a4-f51f-486d-b39c-e8eb80785815 service placement] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:40:18.466579 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1252/2480] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:40:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:40:22.508410 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c2c4f-08c4-4c2b-bea3-293119a8bcc4 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:40:22.634336 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c2c4f-08c4-4c2b-bea3-293119a8bcc4 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:40:22.640910 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc8a68b-d750-489f-bc52-4c7bf0444e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:40:22.642190 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc8a68b-d750-489f-bc52-4c7bf0444e7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:22.642579 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc8a68b-d750-489f-bc52-4c7bf0444e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:22.642945 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc8a68b-d750-489f-bc52-4c7bf0444e7c admin admin] PATH_INFO: `/v3/users/d3f1c36b7295447d9f207cf59dc50e66` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:22.644308 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc8a68b-d750-489f-bc52-4c7bf0444e7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3f1c36b7295447d9f207cf59dc50e66)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:40:22.657671 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc8a68b-d750-489f-bc52-4c7bf0444e7c admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:40:22.676165 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:40:22.726078 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-bdc8a68b-d750-489f-bc52-4c7bf0444e7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3f1c36b7295447d9f207cf59dc50e66'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:40:22.726818 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-bdc8a68b-d750-489f-bc52-4c7bf0444e7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3f1c36b7295447d9f207cf59dc50e66'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:40:22.742804 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-bdc8a68b-d750-489f-bc52-4c7bf0444e7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3f1c36b7295447d9f207cf59dc50e66'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:40:22.756668 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-bdc8a68b-d750-489f-bc52-4c7bf0444e7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3f1c36b7295447d9f207cf59dc50e66'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:40:22.759131 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-bdc8a68b-d750-489f-bc52-4c7bf0444e7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3f1c36b7295447d9f207cf59dc50e66'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:40:22.784065 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1229/2481] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:40:22 2022] DELETE /identity/v3/users/d3f1c36b7295447d9f207cf59dc50e66 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:40:22.997860 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73764a4-f51f-486d-b39c-e8eb80785815 service placement] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:40:23.017887 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73764a4-f51f-486d-b39c-e8eb80785815 service placement] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:40:23.098018 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3066ae04-40da-4d08-ad01-bb02ed35f4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:40:23.098887 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066ae04-40da-4d08-ad01-bb02ed35f4b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:23.099177 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066ae04-40da-4d08-ad01-bb02ed35f4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:23.099459 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066ae04-40da-4d08-ad01-bb02ed35f4b7 admin admin] PATH_INFO: `/v3/projects/17a85b2de06a4414ae2eb971df50d831` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:23.100675 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3066ae04-40da-4d08-ad01-bb02ed35f4b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17a85b2de06a4414ae2eb971df50d831)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:40:23.102621 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3066ae04-40da-4d08-ad01-bb02ed35f4b7 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:40:23.155257 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-3066ae04-40da-4d08-ad01-bb02ed35f4b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17a85b2de06a4414ae2eb971df50d831', 'request_id': 'req-3066ae04-40da-4d08-ad01-bb02ed35f4b7'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:40:23.170278 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-3066ae04-40da-4d08-ad01-bb02ed35f4b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17a85b2de06a4414ae2eb971df50d831', 'request_id': 'req-3066ae04-40da-4d08-ad01-bb02ed35f4b7'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:40:23.181687 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-3066ae04-40da-4d08-ad01-bb02ed35f4b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17a85b2de06a4414ae2eb971df50d831', 'request_id': 'req-3066ae04-40da-4d08-ad01-bb02ed35f4b7'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:40:23.195830 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-3066ae04-40da-4d08-ad01-bb02ed35f4b7 admin admin] The token cache is being invalidate because project 17a85b2de06a4414ae2eb971df50d831 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:40:23.196124 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-3066ae04-40da-4d08-ad01-bb02ed35f4b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:40:23.196747 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-3066ae04-40da-4d08-ad01-bb02ed35f4b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:40:23.198364 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1253/2482] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:40:22 2022] DELETE /identity/v3/projects/17a85b2de06a4414ae2eb971df50d831 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:40:23.202465 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc8a68b-d750-489f-bc52-4c7bf0444e7c admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:40:23.204029 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-bdc8a68b-d750-489f-bc52-4c7bf0444e7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:40:23.217120 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc8a68b-d750-489f-bc52-4c7bf0444e7c admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:40:23.279900 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922cc375-8d2b-43c0-9dcf-078d001a4b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:40:23.281351 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922cc375-8d2b-43c0-9dcf-078d001a4b65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:23.281645 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922cc375-8d2b-43c0-9dcf-078d001a4b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:23.281927 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922cc375-8d2b-43c0-9dcf-078d001a4b65 admin admin] PATH_INFO: `/v3/users/0b40fc1e3cc84c3b9a6b98a49dccbe77` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:23.283152 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922cc375-8d2b-43c0-9dcf-078d001a4b65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b40fc1e3cc84c3b9a6b98a49dccbe77)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:40:23.285222 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922cc375-8d2b-43c0-9dcf-078d001a4b65 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:40:23.345329 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-922cc375-8d2b-43c0-9dcf-078d001a4b65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b40fc1e3cc84c3b9a6b98a49dccbe77'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:40:23.346078 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-922cc375-8d2b-43c0-9dcf-078d001a4b65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b40fc1e3cc84c3b9a6b98a49dccbe77'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:40:23.353754 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-922cc375-8d2b-43c0-9dcf-078d001a4b65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b40fc1e3cc84c3b9a6b98a49dccbe77'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:40:23.362874 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-922cc375-8d2b-43c0-9dcf-078d001a4b65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b40fc1e3cc84c3b9a6b98a49dccbe77'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:40:23.363604 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-922cc375-8d2b-43c0-9dcf-078d001a4b65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b40fc1e3cc84c3b9a6b98a49dccbe77'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:40:23.387594 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1230/2483] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:40:23 2022] DELETE /identity/v3/users/0b40fc1e3cc84c3b9a6b98a49dccbe77 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:40:23.591408 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3066ae04-40da-4d08-ad01-bb02ed35f4b7 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:40:23.592975 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-3066ae04-40da-4d08-ad01-bb02ed35f4b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:40:23.606089 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3066ae04-40da-4d08-ad01-bb02ed35f4b7 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:40:23.652305 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:40:23.692660 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b74418b-cf3d-4c5f-a976-fb1bf925908a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:40:23.693877 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74418b-cf3d-4c5f-a976-fb1bf925908a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:23.694285 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74418b-cf3d-4c5f-a976-fb1bf925908a admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:23.694649 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74418b-cf3d-4c5f-a976-fb1bf925908a admin admin] PATH_INFO: `/v3/projects/c616bc48ec0d4c8aacf7ca29509602a5` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:23.701298 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b74418b-cf3d-4c5f-a976-fb1bf925908a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c616bc48ec0d4c8aacf7ca29509602a5)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:40:23.701298 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b74418b-cf3d-4c5f-a976-fb1bf925908a admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:40:23.806369 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-9b74418b-cf3d-4c5f-a976-fb1bf925908a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c616bc48ec0d4c8aacf7ca29509602a5', 'request_id': 'req-9b74418b-cf3d-4c5f-a976-fb1bf925908a'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:40:23.813609 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-9b74418b-cf3d-4c5f-a976-fb1bf925908a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c616bc48ec0d4c8aacf7ca29509602a5', 'request_id': 'req-9b74418b-cf3d-4c5f-a976-fb1bf925908a'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:40:23.820709 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-9b74418b-cf3d-4c5f-a976-fb1bf925908a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c616bc48ec0d4c8aacf7ca29509602a5', 'request_id': 'req-9b74418b-cf3d-4c5f-a976-fb1bf925908a'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:40:23.854744 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-9b74418b-cf3d-4c5f-a976-fb1bf925908a admin admin] The token cache is being invalidate because project c616bc48ec0d4c8aacf7ca29509602a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:40:23.855052 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-9b74418b-cf3d-4c5f-a976-fb1bf925908a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:40:23.855736 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-9b74418b-cf3d-4c5f-a976-fb1bf925908a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:40:23.857425 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1254/2484] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:40:23 2022] DELETE /identity/v3/projects/c616bc48ec0d4c8aacf7ca29509602a5 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 19:40:26.998159 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922cc375-8d2b-43c0-9dcf-078d001a4b65 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:40:27.000050 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-922cc375-8d2b-43c0-9dcf-078d001a4b65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:40:27.011269 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:40:27.079694 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922cc375-8d2b-43c0-9dcf-078d001a4b65 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:40:27.151694 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd57c9d7-f28c-48aa-9e9c-e4c95c7537b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13fd76fc7dd1410b9cde5adbaa6cb2e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:40:27.152366 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57c9d7-f28c-48aa-9e9c-e4c95c7537b5 service nova] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:27.152656 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57c9d7-f28c-48aa-9e9c-e4c95c7537b5 service nova] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:27.152931 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57c9d7-f28c-48aa-9e9c-e4c95c7537b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:27.154757 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-fd57c9d7-f28c-48aa-9e9c-e4c95c7537b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:40:27.168149 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd57c9d7-f28c-48aa-9e9c-e4c95c7537b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:40:27.169816 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd57c9d7-f28c-48aa-9e9c-e4c95c7537b5 service nova] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:40:27.181937 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1231/2485] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:40:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:40:30.396313 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b74418b-cf3d-4c5f-a976-fb1bf925908a admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:40:30.398400 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-9b74418b-cf3d-4c5f-a976-fb1bf925908a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:40:30.419980 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b74418b-cf3d-4c5f-a976-fb1bf925908a admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:40:30.427090 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f4cb9-7ce6-4545-bdef-0aae18bf3cd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13fd76fc7dd1410b9cde5adbaa6cb2e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:40:30.428111 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f4cb9-7ce6-4545-bdef-0aae18bf3cd3 service nova] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:30.428676 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f4cb9-7ce6-4545-bdef-0aae18bf3cd3 service nova] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:30.429207 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f4cb9-7ce6-4545-bdef-0aae18bf3cd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:30.431295 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-388f4cb9-7ce6-4545-bdef-0aae18bf3cd3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:40:30.445773 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388f4cb9-7ce6-4545-bdef-0aae18bf3cd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:40:30.447379 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388f4cb9-7ce6-4545-bdef-0aae18bf3cd3 service nova] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:40:30.459262 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1255/2486] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:40:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:40:32.382774 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1826c52-f34e-4f09-9b95-6d5b525fc69d None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:32.383314 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1826c52-f34e-4f09-9b95-6d5b525fc69d None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:32.384059 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1826c52-f34e-4f09-9b95-6d5b525fc69d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:32.405224 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-f1826c52-f34e-4f09-9b95-6d5b525fc69d None None] MFA Rules not processed for user `0834256bdfbc48ffbc5af6d6760ecdd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:40:32.406446 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-f1826c52-f34e-4f09-9b95-6d5b525fc69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:40:32.465080 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1232/2487] 10.222.0.26 () {58 vars in 967 bytes} [Fri Jul 1 19:40:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:40:32.477146 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f4cb9-7ce6-4545-bdef-0aae18bf3cd3 service nova] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:40:32.478557 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-388f4cb9-7ce6-4545-bdef-0aae18bf3cd3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:40:32.594907 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f4cb9-7ce6-4545-bdef-0aae18bf3cd3 service nova] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:40:32.607020 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0e5b1d-824e-4c10-b994-c846a0c8b9c2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e958c5b03a9346d59c32675c5271bf3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:40:32.607782 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e5b1d-824e-4c10-b994-c846a0c8b9c2 service swift] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:32.608080 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e5b1d-824e-4c10-b994-c846a0c8b9c2 service swift] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:32.608886 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e5b1d-824e-4c10-b994-c846a0c8b9c2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:32.638975 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0e5b1d-824e-4c10-b994-c846a0c8b9c2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:40:32.644806 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0e5b1d-824e-4c10-b994-c846a0c8b9c2 service swift] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:40:32.662621 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1256/2488] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Jul 1 19:40:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 01 19:40:34.957388 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1826c52-f34e-4f09-9b95-6d5b525fc69d None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:40:34.958815 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-f1826c52-f34e-4f09-9b95-6d5b525fc69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:40:35.000842 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:40:35.016369 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1826c52-f34e-4f09-9b95-6d5b525fc69d None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:40:35.019952 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7adf6d-feac-49a5-b1f5-7c49b5e14ea4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:40:35.020587 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7adf6d-feac-49a5-b1f5-7c49b5e14ea4 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:35.020873 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7adf6d-feac-49a5-b1f5-7c49b5e14ea4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:35.021153 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7adf6d-feac-49a5-b1f5-7c49b5e14ea4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:35.022966 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-8e7adf6d-feac-49a5-b1f5-7c49b5e14ea4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:40:35.083763 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7adf6d-feac-49a5-b1f5-7c49b5e14ea4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:40:35.085211 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7adf6d-feac-49a5-b1f5-7c49b5e14ea4 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:40:35.096073 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1233/2489] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:40:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:40:38.166462 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0e5b1d-824e-4c10-b994-c846a0c8b9c2 service swift] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:40:38.167969 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-5a0e5b1d-824e-4c10-b994-c846a0c8b9c2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:40:38.213898 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:40:38.231870 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7adf6d-feac-49a5-b1f5-7c49b5e14ea4 service neutron] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:40:38.234244 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-8e7adf6d-feac-49a5-b1f5-7c49b5e14ea4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:40:38.251461 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7adf6d-feac-49a5-b1f5-7c49b5e14ea4 service neutron] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:40:38.256141 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62feefbc-d017-4f34-838e-5370fc9d97db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:40:38.257002 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62feefbc-d017-4f34-838e-5370fc9d97db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:38.257315 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62feefbc-d017-4f34-838e-5370fc9d97db admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:38.257595 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62feefbc-d017-4f34-838e-5370fc9d97db admin admin] PATH_INFO: `/v3/users/1827b8d35e274416b3f6adbc28691ad6` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:38.258917 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62feefbc-d017-4f34-838e-5370fc9d97db admin admin] RBAC: Authorizing `identity:delete_user(user_id=1827b8d35e274416b3f6adbc28691ad6)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:40:38.260500 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0e5b1d-824e-4c10-b994-c846a0c8b9c2 service swift] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:40:38.260869 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62feefbc-d017-4f34-838e-5370fc9d97db admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:40:38.268079 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d516180-9043-46ee-bdad-c91027f7b6d7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '941e65d95bcd4e66a6489280520c12de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:40:38.268870 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d516180-9043-46ee-bdad-c91027f7b6d7 service placement] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:38.269226 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d516180-9043-46ee-bdad-c91027f7b6d7 service placement] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:38.269617 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d516180-9043-46ee-bdad-c91027f7b6d7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:38.271549 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-9d516180-9043-46ee-bdad-c91027f7b6d7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:40:38.284894 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d516180-9043-46ee-bdad-c91027f7b6d7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:40:38.286853 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d516180-9043-46ee-bdad-c91027f7b6d7 service placement] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:40:38.297302 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1257/2490] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:40:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:40:38.311704 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-62feefbc-d017-4f34-838e-5370fc9d97db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1827b8d35e274416b3f6adbc28691ad6'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:40:38.312365 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-62feefbc-d017-4f34-838e-5370fc9d97db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1827b8d35e274416b3f6adbc28691ad6'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:40:38.319667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-62feefbc-d017-4f34-838e-5370fc9d97db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1827b8d35e274416b3f6adbc28691ad6'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:40:38.327945 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-62feefbc-d017-4f34-838e-5370fc9d97db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1827b8d35e274416b3f6adbc28691ad6'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:40:38.328884 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-62feefbc-d017-4f34-838e-5370fc9d97db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1827b8d35e274416b3f6adbc28691ad6'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:40:38.348365 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1234/2491] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:40:38 2022] DELETE /identity/v3/users/1827b8d35e274416b3f6adbc28691ad6 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:40:38.520020 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d516180-9043-46ee-bdad-c91027f7b6d7 service placement] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:40:38.533963 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d516180-9043-46ee-bdad-c91027f7b6d7 service placement] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:40:38.593665 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc6fe90-f00c-40c7-a5d2-045ee47244ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:40:38.594653 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc6fe90-f00c-40c7-a5d2-045ee47244ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:38.594934 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc6fe90-f00c-40c7-a5d2-045ee47244ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:38.595210 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc6fe90-f00c-40c7-a5d2-045ee47244ba admin admin] PATH_INFO: `/v3/projects/8b5daf2a3ae343bd97cdfd34ec5ea7af` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:38.596657 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc6fe90-f00c-40c7-a5d2-045ee47244ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b5daf2a3ae343bd97cdfd34ec5ea7af)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:40:38.598565 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc6fe90-f00c-40c7-a5d2-045ee47244ba admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:40:38.651620 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-afc6fe90-f00c-40c7-a5d2-045ee47244ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b5daf2a3ae343bd97cdfd34ec5ea7af', 'request_id': 'req-afc6fe90-f00c-40c7-a5d2-045ee47244ba'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:40:38.660288 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-afc6fe90-f00c-40c7-a5d2-045ee47244ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b5daf2a3ae343bd97cdfd34ec5ea7af', 'request_id': 'req-afc6fe90-f00c-40c7-a5d2-045ee47244ba'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:40:38.666284 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-afc6fe90-f00c-40c7-a5d2-045ee47244ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b5daf2a3ae343bd97cdfd34ec5ea7af', 'request_id': 'req-afc6fe90-f00c-40c7-a5d2-045ee47244ba'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:40:38.679972 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-afc6fe90-f00c-40c7-a5d2-045ee47244ba admin admin] The token cache is being invalidate because project 8b5daf2a3ae343bd97cdfd34ec5ea7af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:40:38.680269 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-afc6fe90-f00c-40c7-a5d2-045ee47244ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:40:38.680881 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-afc6fe90-f00c-40c7-a5d2-045ee47244ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:40:38.683237 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1258/2492] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:40:38 2022] DELETE /identity/v3/projects/8b5daf2a3ae343bd97cdfd34ec5ea7af => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 19:40:38.688389 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa35bca-854f-43e5-b53e-cbae091aba3d None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:38.688776 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa35bca-854f-43e5-b53e-cbae091aba3d None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:38.688958 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa35bca-854f-43e5-b53e-cbae091aba3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:38.707664 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-2aa35bca-854f-43e5-b53e-cbae091aba3d None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:40:38.708936 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-2aa35bca-854f-43e5-b53e-cbae091aba3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:40:38.761550 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:40:38.772622 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1235/2493] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:40:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:40:38.781564 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c885b-0bd1-408a-a202-2930d34e6975 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:38.781808 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c885b-0bd1-408a-a202-2930d34e6975 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:38.782091 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c885b-0bd1-408a-a202-2930d34e6975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:38.802181 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-c19c885b-0bd1-408a-a202-2930d34e6975 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:40:38.803394 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-c19c885b-0bd1-408a-a202-2930d34e6975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:40:38.812116 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1259/2494] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:40:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:40:38.816482 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa35bca-854f-43e5-b53e-cbae091aba3d None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:40:38.826096 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa35bca-854f-43e5-b53e-cbae091aba3d None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:40:38.830668 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4e2df4-1e37-44f8-86a5-b9f900610ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:40:38.831314 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e2df4-1e37-44f8-86a5-b9f900610ba6 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:38.831595 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e2df4-1e37-44f8-86a5-b9f900610ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:38.831870 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e2df4-1e37-44f8-86a5-b9f900610ba6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:38.832620 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4e2df4-1e37-44f8-86a5-b9f900610ba6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:40:38.832947 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4e2df4-1e37-44f8-86a5-b9f900610ba6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:40:38.834574 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4e2df4-1e37-44f8-86a5-b9f900610ba6 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:40:38.845855 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1236/2495] 10.222.0.26 () {58 vars in 1152 bytes} [Fri Jul 1 19:40:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:40:38.850115 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c885b-0bd1-408a-a202-2930d34e6975 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:40:38.859774 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c885b-0bd1-408a-a202-2930d34e6975 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:40:38.864433 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8480402f-8785-465c-a945-a89a93ab4754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:40:38.865081 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480402f-8785-465c-a945-a89a93ab4754 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:38.865413 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480402f-8785-465c-a945-a89a93ab4754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:38.865696 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480402f-8785-465c-a945-a89a93ab4754 admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:38.866386 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8480402f-8785-465c-a945-a89a93ab4754 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:40:38.868304 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8480402f-8785-465c-a945-a89a93ab4754 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:40:38.894920 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1260/2496] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:40:38 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:40:38.900633 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4e2df4-1e37-44f8-86a5-b9f900610ba6 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:40:38.910762 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4e2df4-1e37-44f8-86a5-b9f900610ba6 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:40:38.966375 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6c15c3-d0a1-45ac-86eb-bf161a51fe3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:40:38.967066 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c15c3-d0a1-45ac-86eb-bf161a51fe3f admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:38.967377 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c15c3-d0a1-45ac-86eb-bf161a51fe3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:38.967656 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c15c3-d0a1-45ac-86eb-bf161a51fe3f admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:38.968400 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6c15c3-d0a1-45ac-86eb-bf161a51fe3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:40:38.970374 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6c15c3-d0a1-45ac-86eb-bf161a51fe3f admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:40:38.989947 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1237/2497] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:40:38 2022] POST /identity/v3/users => generated 291 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:40:38.994093 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8480402f-8785-465c-a945-a89a93ab4754 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:40:39.006314 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8480402f-8785-465c-a945-a89a93ab4754 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:40:39.010888 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970c1f96-1ba4-431c-84f7-deb89296727b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:40:39.011537 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c1f96-1ba4-431c-84f7-deb89296727b admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:39.011821 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c1f96-1ba4-431c-84f7-deb89296727b admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:39.012094 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c1f96-1ba4-431c-84f7-deb89296727b admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:39.012886 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970c1f96-1ba4-431c-84f7-deb89296727b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:40:39.014453 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970c1f96-1ba4-431c-84f7-deb89296727b admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:40:39.026160 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1261/2498] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:40:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:40:39.029638 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6c15c3-d0a1-45ac-86eb-bf161a51fe3f admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:40:39.039950 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6c15c3-d0a1-45ac-86eb-bf161a51fe3f admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:40:39.044546 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e559dc8d-be95-4702-babd-7a8bdb517995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:40:39.045201 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559dc8d-be95-4702-babd-7a8bdb517995 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:39.045520 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559dc8d-be95-4702-babd-7a8bdb517995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:39.046303 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559dc8d-be95-4702-babd-7a8bdb517995 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:39.047036 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e559dc8d-be95-4702-babd-7a8bdb517995 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:40:39.048639 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e559dc8d-be95-4702-babd-7a8bdb517995 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:40:39.058526 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1238/2499] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:40:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:40:39.063138 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970c1f96-1ba4-431c-84f7-deb89296727b admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:40:39.072891 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970c1f96-1ba4-431c-84f7-deb89296727b admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:40:39.077951 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4bec98-bde4-45ee-baee-5b01587af1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:40:39.079335 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4bec98-bde4-45ee-baee-5b01587af1d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:39.079335 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4bec98-bde4-45ee-baee-5b01587af1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:39.079335 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4bec98-bde4-45ee-baee-5b01587af1d8 admin admin] PATH_INFO: `/v3/projects/048068946174439abfc39772e2e57e1f/users/28af2ec0d8804103bf603a85352fca09/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:39.090981 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:40:39.096555 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4bec98-bde4-45ee-baee-5b01587af1d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=048068946174439abfc39772e2e57e1f, user_id=28af2ec0d8804103bf603a85352fca09, role_id=4cbf6ec846eb4b7c8cc52e9bfd6f076f)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:40:39.099423 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4bec98-bde4-45ee-baee-5b01587af1d8 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:40:39.113167 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1262/2500] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:40:39 2022] PUT /identity/v3/projects/048068946174439abfc39772e2e57e1f/users/28af2ec0d8804103bf603a85352fca09/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:40:39.123071 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5156ce8b-d6b9-4557-a9cf-18dbc802a0e0 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:39.123367 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5156ce8b-d6b9-4557-a9cf-18dbc802a0e0 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:39.123652 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5156ce8b-d6b9-4557-a9cf-18dbc802a0e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:39.152564 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-5156ce8b-d6b9-4557-a9cf-18dbc802a0e0 None None] MFA Rules not processed for user `28af2ec0d8804103bf603a85352fca09`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:40:39.153795 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-5156ce8b-d6b9-4557-a9cf-18dbc802a0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:40:39.222728 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1239/2501] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:40:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:40:39.227299 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4bec98-bde4-45ee-baee-5b01587af1d8 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:40:39.297030 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4bec98-bde4-45ee-baee-5b01587af1d8 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:40:39.301644 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bda5b9b-efa5-4617-835d-82a7bfd95e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:40:39.302372 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda5b9b-efa5-4617-835d-82a7bfd95e71 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:39.302743 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda5b9b-efa5-4617-835d-82a7bfd95e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:39.303083 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda5b9b-efa5-4617-835d-82a7bfd95e71 admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:39.303843 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bda5b9b-efa5-4617-835d-82a7bfd95e71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:40:39.305849 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bda5b9b-efa5-4617-835d-82a7bfd95e71 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:40:39.335485 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1263/2502] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:40:39 2022] POST /identity/v3/projects => generated 383 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:40:39.339399 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5156ce8b-d6b9-4557-a9cf-18dbc802a0e0 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:40:39.350845 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5156ce8b-d6b9-4557-a9cf-18dbc802a0e0 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:40:39.410573 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:40:39.418746 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95352ed-09f5-4c27-a331-f6a5a3fd39af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:40:39.419436 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95352ed-09f5-4c27-a331-f6a5a3fd39af admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:39.419973 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95352ed-09f5-4c27-a331-f6a5a3fd39af admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:39.420252 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95352ed-09f5-4c27-a331-f6a5a3fd39af admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:39.421552 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95352ed-09f5-4c27-a331-f6a5a3fd39af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:40:39.423535 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95352ed-09f5-4c27-a331-f6a5a3fd39af admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:40:39.446118 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1240/2503] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:40:39 2022] POST /identity/v3/users => generated 298 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:40:39.447452 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bda5b9b-efa5-4617-835d-82a7bfd95e71 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:40:39.459083 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bda5b9b-efa5-4617-835d-82a7bfd95e71 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:40:39.463446 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8eb100-2839-4d5f-8be5-2f73c941ca8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:40:39.464185 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8eb100-2839-4d5f-8be5-2f73c941ca8f admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:39.464549 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8eb100-2839-4d5f-8be5-2f73c941ca8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:39.464901 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8eb100-2839-4d5f-8be5-2f73c941ca8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:39.465742 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8eb100-2839-4d5f-8be5-2f73c941ca8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:40:39.467408 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8eb100-2839-4d5f-8be5-2f73c941ca8f admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:40:39.479003 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1264/2504] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:40:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:40:39.483298 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95352ed-09f5-4c27-a331-f6a5a3fd39af admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:40:39.494943 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95352ed-09f5-4c27-a331-f6a5a3fd39af admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:40:39.499910 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcbb916-cffb-453a-9b46-56d72b7e6a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:40:39.500786 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcbb916-cffb-453a-9b46-56d72b7e6a5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:39.501069 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcbb916-cffb-453a-9b46-56d72b7e6a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:39.501382 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcbb916-cffb-453a-9b46-56d72b7e6a5a admin admin] PATH_INFO: `/v3/projects/e1842c76d8504a1e8b3c1ab9bf047369/users/dacf95ddb83f433881ea2936657a9bcb/roles/6cb03785fb184ef587509b3174622f69` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:39.517085 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcbb916-cffb-453a-9b46-56d72b7e6a5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1842c76d8504a1e8b3c1ab9bf047369, user_id=dacf95ddb83f433881ea2936657a9bcb, role_id=6cb03785fb184ef587509b3174622f69)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:40:39.519788 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcbb916-cffb-453a-9b46-56d72b7e6a5a admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:40:39.533965 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1241/2505] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:40:39 2022] PUT /identity/v3/projects/e1842c76d8504a1e8b3c1ab9bf047369/users/dacf95ddb83f433881ea2936657a9bcb/roles/6cb03785fb184ef587509b3174622f69 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:40:39.538309 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8eb100-2839-4d5f-8be5-2f73c941ca8f admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:40:39.548659 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8eb100-2839-4d5f-8be5-2f73c941ca8f admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:40:39.606484 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba69921-49c0-414e-9a34-68176ec338a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:40:39.607217 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba69921-49c0-414e-9a34-68176ec338a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:39.607508 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba69921-49c0-414e-9a34-68176ec338a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:39.607810 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba69921-49c0-414e-9a34-68176ec338a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:39.608577 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba69921-49c0-414e-9a34-68176ec338a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:40:39.610289 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba69921-49c0-414e-9a34-68176ec338a0 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:40:39.620275 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1265/2506] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:40:39 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:40:39.625424 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcbb916-cffb-453a-9b46-56d72b7e6a5a admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:40:39.636607 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcbb916-cffb-453a-9b46-56d72b7e6a5a admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:40:39.643145 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052e8906-8267-4beb-a500-4a83fe0ec027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:40:39.644167 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e8906-8267-4beb-a500-4a83fe0ec027 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:39.644504 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e8906-8267-4beb-a500-4a83fe0ec027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:39.644850 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e8906-8267-4beb-a500-4a83fe0ec027 admin admin] PATH_INFO: `/v3/projects/e1842c76d8504a1e8b3c1ab9bf047369/users/dacf95ddb83f433881ea2936657a9bcb/roles/6cb03785fb184ef587509b3174622f69` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:39.646954 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052e8906-8267-4beb-a500-4a83fe0ec027 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1842c76d8504a1e8b3c1ab9bf047369, user_id=dacf95ddb83f433881ea2936657a9bcb, role_id=6cb03785fb184ef587509b3174622f69)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:40:39.649751 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052e8906-8267-4beb-a500-4a83fe0ec027 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:40:39.667074 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1242/2507] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:40:39 2022] PUT /identity/v3/projects/e1842c76d8504a1e8b3c1ab9bf047369/users/dacf95ddb83f433881ea2936657a9bcb/roles/6cb03785fb184ef587509b3174622f69 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:40:39.678779 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b0a23-f579-4fc1-8e3a-e8bab2735df6 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:39.679560 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b0a23-f579-4fc1-8e3a-e8bab2735df6 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:39.680608 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b0a23-f579-4fc1-8e3a-e8bab2735df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:39.713844 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-e70b0a23-f579-4fc1-8e3a-e8bab2735df6 None None] MFA Rules not processed for user `dacf95ddb83f433881ea2936657a9bcb`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:40:39.715110 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-e70b0a23-f579-4fc1-8e3a-e8bab2735df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:40:39.771170 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:40:39.801356 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1266/2508] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:40:39 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:40:39.812640 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052e8906-8267-4beb-a500-4a83fe0ec027 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:40:39.814398 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-052e8906-8267-4beb-a500-4a83fe0ec027 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:40:39.881096 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052e8906-8267-4beb-a500-4a83fe0ec027 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:40:39.884721 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c2eb0-fdf1-40b3-bc41-ecc213087ae1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a3ed285ee4c4d04abf7daf0aeb9fb7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:40:39.885438 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c2eb0-fdf1-40b3-bc41-ecc213087ae1 service cinder] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:39.885709 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c2eb0-fdf1-40b3-bc41-ecc213087ae1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:39.885982 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c2eb0-fdf1-40b3-bc41-ecc213087ae1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:39.896609 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47c2eb0-fdf1-40b3-bc41-ecc213087ae1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:40:39.898250 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47c2eb0-fdf1-40b3-bc41-ecc213087ae1 service cinder] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:40:39.908895 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1243/2509] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:40:39 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:40:39.997799 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b0a23-f579-4fc1-8e3a-e8bab2735df6 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:40:40.009466 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b0a23-f579-4fc1-8e3a-e8bab2735df6 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:40:40.013214 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa14a148-1182-4ddf-9253-5a2ab107b3ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a3ed285ee4c4d04abf7daf0aeb9fb7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:40:40.013908 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa14a148-1182-4ddf-9253-5a2ab107b3ee service cinder] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:40.014194 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa14a148-1182-4ddf-9253-5a2ab107b3ee service cinder] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:40.014476 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa14a148-1182-4ddf-9253-5a2ab107b3ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:40.074239 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa14a148-1182-4ddf-9253-5a2ab107b3ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:40:40.075684 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa14a148-1182-4ddf-9253-5a2ab107b3ee service cinder] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:40:40.086085 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1267/2510] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:40:39 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:40:40.351662 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c2eb0-fdf1-40b3-bc41-ecc213087ae1 service cinder] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:40:40.414900 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c2eb0-fdf1-40b3-bc41-ecc213087ae1 service cinder] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:40:40.419588 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a225b6f3-4d7a-448b-a9ad-629d66e8e580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:40:40.420536 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a225b6f3-4d7a-448b-a9ad-629d66e8e580 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:40.421485 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a225b6f3-4d7a-448b-a9ad-629d66e8e580 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:40.422534 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a225b6f3-4d7a-448b-a9ad-629d66e8e580 admin admin] PATH_INFO: `/v3/users/28af2ec0d8804103bf603a85352fca09` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:40.423739 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a225b6f3-4d7a-448b-a9ad-629d66e8e580 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28af2ec0d8804103bf603a85352fca09)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:40:40.425880 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a225b6f3-4d7a-448b-a9ad-629d66e8e580 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:40:40.479528 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-a225b6f3-4d7a-448b-a9ad-629d66e8e580 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28af2ec0d8804103bf603a85352fca09'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:40:40.480222 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-a225b6f3-4d7a-448b-a9ad-629d66e8e580 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28af2ec0d8804103bf603a85352fca09'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:40:40.485762 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:40:40.488997 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-a225b6f3-4d7a-448b-a9ad-629d66e8e580 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28af2ec0d8804103bf603a85352fca09'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:40:40.497781 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-a225b6f3-4d7a-448b-a9ad-629d66e8e580 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28af2ec0d8804103bf603a85352fca09'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:40:40.498588 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-a225b6f3-4d7a-448b-a9ad-629d66e8e580 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28af2ec0d8804103bf603a85352fca09'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:40:40.518302 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1244/2511] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:40:40 2022] DELETE /identity/v3/users/28af2ec0d8804103bf603a85352fca09 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:40:40.522877 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c942800b-dec4-4e12-9852-5eddb3867720 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:40.523362 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c942800b-dec4-4e12-9852-5eddb3867720 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:40.523460 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c942800b-dec4-4e12-9852-5eddb3867720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:40.541741 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-c942800b-dec4-4e12-9852-5eddb3867720 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:40:40.542953 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-c942800b-dec4-4e12-9852-5eddb3867720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:40:40.613923 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1268/2512] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:40:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:40:40.624695 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a225b6f3-4d7a-448b-a9ad-629d66e8e580 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:40:40.626458 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-a225b6f3-4d7a-448b-a9ad-629d66e8e580 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:40:40.697869 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a225b6f3-4d7a-448b-a9ad-629d66e8e580 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:40:40.701758 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51480b7-3028-4ea8-a69b-cb72287818a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:40:40.702437 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51480b7-3028-4ea8-a69b-cb72287818a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:40.702724 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51480b7-3028-4ea8-a69b-cb72287818a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:40.703007 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51480b7-3028-4ea8-a69b-cb72287818a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:40.712953 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51480b7-3028-4ea8-a69b-cb72287818a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:40:40.714445 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51480b7-3028-4ea8-a69b-cb72287818a8 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:40:40.725026 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1245/2513] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:40:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 19:40:40.995941 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c942800b-dec4-4e12-9852-5eddb3867720 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:40:40.997527 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-c942800b-dec4-4e12-9852-5eddb3867720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:40:41.009886 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c942800b-dec4-4e12-9852-5eddb3867720 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:40:41.015468 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7639b41b-16b1-4565-8341-9d756c189aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:40:41.016421 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639b41b-16b1-4565-8341-9d756c189aee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:41.016962 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639b41b-16b1-4565-8341-9d756c189aee admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:41.017131 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639b41b-16b1-4565-8341-9d756c189aee admin admin] PATH_INFO: `/v3/projects/048068946174439abfc39772e2e57e1f` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:41.018553 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7639b41b-16b1-4565-8341-9d756c189aee admin admin] RBAC: Authorizing `identity:delete_project(project_id=048068946174439abfc39772e2e57e1f)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:40:41.020563 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7639b41b-16b1-4565-8341-9d756c189aee admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:40:41.077879 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-7639b41b-16b1-4565-8341-9d756c189aee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '048068946174439abfc39772e2e57e1f', 'request_id': 'req-7639b41b-16b1-4565-8341-9d756c189aee'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:40:41.084350 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-7639b41b-16b1-4565-8341-9d756c189aee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '048068946174439abfc39772e2e57e1f', 'request_id': 'req-7639b41b-16b1-4565-8341-9d756c189aee'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:40:41.090411 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-7639b41b-16b1-4565-8341-9d756c189aee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '048068946174439abfc39772e2e57e1f', 'request_id': 'req-7639b41b-16b1-4565-8341-9d756c189aee'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:40:41.104328 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-7639b41b-16b1-4565-8341-9d756c189aee admin admin] The token cache is being invalidate because project 048068946174439abfc39772e2e57e1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:40:41.104619 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-7639b41b-16b1-4565-8341-9d756c189aee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:40:41.105354 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-7639b41b-16b1-4565-8341-9d756c189aee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:40:41.106964 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1269/2514] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:40:40 2022] DELETE /identity/v3/projects/048068946174439abfc39772e2e57e1f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:40:41.111056 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51480b7-3028-4ea8-a69b-cb72287818a8 service neutron] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:40:41.120574 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51480b7-3028-4ea8-a69b-cb72287818a8 service neutron] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:40:41.177457 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa731682-9794-46d0-ae4c-27e9a3655fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:40:41.178322 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa731682-9794-46d0-ae4c-27e9a3655fe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:41.178606 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa731682-9794-46d0-ae4c-27e9a3655fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:41.178882 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa731682-9794-46d0-ae4c-27e9a3655fe9 admin admin] PATH_INFO: `/v3/users/dacf95ddb83f433881ea2936657a9bcb` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:41.180072 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa731682-9794-46d0-ae4c-27e9a3655fe9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dacf95ddb83f433881ea2936657a9bcb)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:40:41.182058 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa731682-9794-46d0-ae4c-27e9a3655fe9 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:40:41.229807 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-fa731682-9794-46d0-ae4c-27e9a3655fe9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dacf95ddb83f433881ea2936657a9bcb'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:40:41.230458 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-fa731682-9794-46d0-ae4c-27e9a3655fe9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dacf95ddb83f433881ea2936657a9bcb'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:40:41.237213 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-fa731682-9794-46d0-ae4c-27e9a3655fe9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dacf95ddb83f433881ea2936657a9bcb'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:40:41.244709 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-fa731682-9794-46d0-ae4c-27e9a3655fe9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dacf95ddb83f433881ea2936657a9bcb'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:40:41.245351 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-fa731682-9794-46d0-ae4c-27e9a3655fe9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dacf95ddb83f433881ea2936657a9bcb'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:40:41.253077 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:40:41.265210 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1246/2515] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:40:41 2022] DELETE /identity/v3/users/dacf95ddb83f433881ea2936657a9bcb => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:40:41.534874 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7639b41b-16b1-4565-8341-9d756c189aee admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:40:41.536594 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-7639b41b-16b1-4565-8341-9d756c189aee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:40:41.549798 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7639b41b-16b1-4565-8341-9d756c189aee admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:40:41.553528 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:40:41.610102 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e10c7ab-fa0d-48e0-bb0d-8fbb33184dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:40:41.610964 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10c7ab-fa0d-48e0-bb0d-8fbb33184dc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:41.611253 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10c7ab-fa0d-48e0-bb0d-8fbb33184dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:41.611536 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10c7ab-fa0d-48e0-bb0d-8fbb33184dc2 admin admin] PATH_INFO: `/v3/projects/e1842c76d8504a1e8b3c1ab9bf047369` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:41.612749 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e10c7ab-fa0d-48e0-bb0d-8fbb33184dc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1842c76d8504a1e8b3c1ab9bf047369)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:40:41.614698 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e10c7ab-fa0d-48e0-bb0d-8fbb33184dc2 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:40:41.665451 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-1e10c7ab-fa0d-48e0-bb0d-8fbb33184dc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1842c76d8504a1e8b3c1ab9bf047369', 'request_id': 'req-1e10c7ab-fa0d-48e0-bb0d-8fbb33184dc2'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:40:41.671932 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-1e10c7ab-fa0d-48e0-bb0d-8fbb33184dc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1842c76d8504a1e8b3c1ab9bf047369', 'request_id': 'req-1e10c7ab-fa0d-48e0-bb0d-8fbb33184dc2'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:40:41.678070 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-1e10c7ab-fa0d-48e0-bb0d-8fbb33184dc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1842c76d8504a1e8b3c1ab9bf047369', 'request_id': 'req-1e10c7ab-fa0d-48e0-bb0d-8fbb33184dc2'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:40:41.691931 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-1e10c7ab-fa0d-48e0-bb0d-8fbb33184dc2 admin admin] The token cache is being invalidate because project e1842c76d8504a1e8b3c1ab9bf047369 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:40:41.692215 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-1e10c7ab-fa0d-48e0-bb0d-8fbb33184dc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:40:41.692831 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-1e10c7ab-fa0d-48e0-bb0d-8fbb33184dc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:40:41.694391 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1270/2516] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:40:41 2022] DELETE /identity/v3/projects/e1842c76d8504a1e8b3c1ab9bf047369 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:40:41.699901 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ff7539-c297-4e00-80ff-886d400b9faa None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:41.700372 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ff7539-c297-4e00-80ff-886d400b9faa None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:41.700488 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ff7539-c297-4e00-80ff-886d400b9faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:41.718536 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-b6ff7539-c297-4e00-80ff-886d400b9faa None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:40:41.719732 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-b6ff7539-c297-4e00-80ff-886d400b9faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:40:41.779920 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1247/2517] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:40:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:40:41.787759 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cbb436-c425-40a6-939b-25c6e64c0cad None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:41.788052 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cbb436-c425-40a6-939b-25c6e64c0cad None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:41.788338 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cbb436-c425-40a6-939b-25c6e64c0cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:41.807553 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-74cbb436-c425-40a6-939b-25c6e64c0cad None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:40:41.808767 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-74cbb436-c425-40a6-939b-25c6e64c0cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:40:41.817627 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1271/2518] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:40:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:40:41.821890 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ff7539-c297-4e00-80ff-886d400b9faa None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:40:41.831876 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ff7539-c297-4e00-80ff-886d400b9faa None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:40:41.836609 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df9e55b-e8c0-43ef-88d4-023a3452fde3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:40:41.837293 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9e55b-e8c0-43ef-88d4-023a3452fde3 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:41.837577 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9e55b-e8c0-43ef-88d4-023a3452fde3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:41.837850 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9e55b-e8c0-43ef-88d4-023a3452fde3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:41.838606 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df9e55b-e8c0-43ef-88d4-023a3452fde3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:40:41.838914 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df9e55b-e8c0-43ef-88d4-023a3452fde3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:40:41.840547 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df9e55b-e8c0-43ef-88d4-023a3452fde3 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:40:41.852612 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1248/2519] 10.222.0.26 () {58 vars in 1152 bytes} [Fri Jul 1 19:40:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:40:41.857044 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cbb436-c425-40a6-939b-25c6e64c0cad None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:40:41.867866 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cbb436-c425-40a6-939b-25c6e64c0cad None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:40:41.872686 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49401f9b-a5fd-4b2d-8c32-6b4b5886f60f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:40:41.873350 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49401f9b-a5fd-4b2d-8c32-6b4b5886f60f admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:41.873652 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49401f9b-a5fd-4b2d-8c32-6b4b5886f60f admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:41.874551 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49401f9b-a5fd-4b2d-8c32-6b4b5886f60f admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:41.875259 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49401f9b-a5fd-4b2d-8c32-6b4b5886f60f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:40:41.877133 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49401f9b-a5fd-4b2d-8c32-6b4b5886f60f admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:40:41.901741 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1272/2520] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:40:41 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 19:40:41.905977 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df9e55b-e8c0-43ef-88d4-023a3452fde3 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:40:41.916101 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df9e55b-e8c0-43ef-88d4-023a3452fde3 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:40:41.971971 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93b0ebc-db41-4f85-a4dc-b15d51ba1b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:40:41.972630 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b0ebc-db41-4f85-a4dc-b15d51ba1b81 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:41.972910 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b0ebc-db41-4f85-a4dc-b15d51ba1b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:41.973183 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b0ebc-db41-4f85-a4dc-b15d51ba1b81 admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:41.973900 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93b0ebc-db41-4f85-a4dc-b15d51ba1b81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:40:41.975811 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93b0ebc-db41-4f85-a4dc-b15d51ba1b81 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:40:41.995984 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1249/2521] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:40:41 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:40:42.000697 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49401f9b-a5fd-4b2d-8c32-6b4b5886f60f admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:40:42.010805 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49401f9b-a5fd-4b2d-8c32-6b4b5886f60f admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:40:42.015440 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a3ba26-ba08-4a95-9c9c-e713f704a54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:40:42.016086 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3ba26-ba08-4a95-9c9c-e713f704a54c admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:42.016368 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3ba26-ba08-4a95-9c9c-e713f704a54c admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:42.016644 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3ba26-ba08-4a95-9c9c-e713f704a54c admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:42.017482 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a3ba26-ba08-4a95-9c9c-e713f704a54c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:40:42.018996 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a3ba26-ba08-4a95-9c9c-e713f704a54c admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:40:42.029481 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1273/2522] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:40:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:40:42.033350 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93b0ebc-db41-4f85-a4dc-b15d51ba1b81 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:40:42.043196 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93b0ebc-db41-4f85-a4dc-b15d51ba1b81 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:40:42.048432 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dd0af0-bbc9-4b18-95dd-3e71e49ae834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:40:42.049069 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd0af0-bbc9-4b18-95dd-3e71e49ae834 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:42.049392 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd0af0-bbc9-4b18-95dd-3e71e49ae834 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:42.049669 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd0af0-bbc9-4b18-95dd-3e71e49ae834 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:42.050379 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dd0af0-bbc9-4b18-95dd-3e71e49ae834 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:40:42.051954 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dd0af0-bbc9-4b18-95dd-3e71e49ae834 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:40:42.062241 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1250/2523] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:40:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:40:42.066220 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a3ba26-ba08-4a95-9c9c-e713f704a54c admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:40:42.076187 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a3ba26-ba08-4a95-9c9c-e713f704a54c admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:40:42.081172 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4a21bc-9768-47ef-874e-1fae9e3c8d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:40:42.082064 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4a21bc-9768-47ef-874e-1fae9e3c8d5d admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:42.082355 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4a21bc-9768-47ef-874e-1fae9e3c8d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:42.082710 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4a21bc-9768-47ef-874e-1fae9e3c8d5d admin admin] PATH_INFO: `/v3/projects/c618595c5dce40818bbc46b85f6aaadc/users/95fa114315ad4595b1d304e313fad813/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:42.097567 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4a21bc-9768-47ef-874e-1fae9e3c8d5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c618595c5dce40818bbc46b85f6aaadc, user_id=95fa114315ad4595b1d304e313fad813, role_id=4cbf6ec846eb4b7c8cc52e9bfd6f076f)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:40:42.100246 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4a21bc-9768-47ef-874e-1fae9e3c8d5d admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:40:42.113396 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1274/2524] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:40:42 2022] PUT /identity/v3/projects/c618595c5dce40818bbc46b85f6aaadc/users/95fa114315ad4595b1d304e313fad813/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:40:42.123727 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c1834-7e0d-4282-9409-1a933137e927 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:42.124707 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c1834-7e0d-4282-9409-1a933137e927 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:42.125107 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c1834-7e0d-4282-9409-1a933137e927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:42.150758 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-887c1834-7e0d-4282-9409-1a933137e927 None None] MFA Rules not processed for user `95fa114315ad4595b1d304e313fad813`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:40:42.151942 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-887c1834-7e0d-4282-9409-1a933137e927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:40:42.195713 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:40:42.216281 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1251/2525] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:40:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:40:42.227849 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4a21bc-9768-47ef-874e-1fae9e3c8d5d admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:40:42.229604 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-8a4a21bc-9768-47ef-874e-1fae9e3c8d5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:40:42.264542 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:40:42.288110 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4a21bc-9768-47ef-874e-1fae9e3c8d5d admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:40:42.291825 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06052d1e-19ed-4b42-b257-60e7c7a12264 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a3ed285ee4c4d04abf7daf0aeb9fb7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:40:42.292498 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06052d1e-19ed-4b42-b257-60e7c7a12264 service cinder] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:42.292783 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06052d1e-19ed-4b42-b257-60e7c7a12264 service cinder] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:42.293060 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06052d1e-19ed-4b42-b257-60e7c7a12264 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:42.301864 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06052d1e-19ed-4b42-b257-60e7c7a12264 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:40:42.303286 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06052d1e-19ed-4b42-b257-60e7c7a12264 service cinder] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:40:42.311939 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1275/2526] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:40:42 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 19:40:42.330677 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c1834-7e0d-4282-9409-1a933137e927 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:40:42.394235 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c1834-7e0d-4282-9409-1a933137e927 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:40:42.398845 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b569e-34f6-48e7-8eb6-3270c95ad16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:40:42.399712 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b569e-34f6-48e7-8eb6-3270c95ad16e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:42.399999 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b569e-34f6-48e7-8eb6-3270c95ad16e admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:42.400281 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b569e-34f6-48e7-8eb6-3270c95ad16e admin admin] PATH_INFO: `/v3/users/95fa114315ad4595b1d304e313fad813` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:42.401518 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5b569e-34f6-48e7-8eb6-3270c95ad16e admin admin] RBAC: Authorizing `identity:delete_user(user_id=95fa114315ad4595b1d304e313fad813)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:40:42.403476 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5b569e-34f6-48e7-8eb6-3270c95ad16e admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:40:42.450539 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-af5b569e-34f6-48e7-8eb6-3270c95ad16e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95fa114315ad4595b1d304e313fad813'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:40:42.451138 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-af5b569e-34f6-48e7-8eb6-3270c95ad16e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95fa114315ad4595b1d304e313fad813'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:40:42.458373 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-af5b569e-34f6-48e7-8eb6-3270c95ad16e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95fa114315ad4595b1d304e313fad813'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:40:42.465690 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-af5b569e-34f6-48e7-8eb6-3270c95ad16e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95fa114315ad4595b1d304e313fad813'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:40:42.466526 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-af5b569e-34f6-48e7-8eb6-3270c95ad16e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95fa114315ad4595b1d304e313fad813'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:40:42.485062 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1252/2527] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:40:42 2022] DELETE /identity/v3/users/95fa114315ad4595b1d304e313fad813 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:40:42.489603 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e713a9-5be3-456a-b282-3464aa66a7f7 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:42.489900 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e713a9-5be3-456a-b282-3464aa66a7f7 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:42.490227 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e713a9-5be3-456a-b282-3464aa66a7f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:42.506979 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-16e713a9-5be3-456a-b282-3464aa66a7f7 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:40:42.508169 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-16e713a9-5be3-456a-b282-3464aa66a7f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:40:42.566228 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1276/2528] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:40:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:40:42.575767 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b569e-34f6-48e7-8eb6-3270c95ad16e admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:40:42.577702 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-af5b569e-34f6-48e7-8eb6-3270c95ad16e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:40:42.636351 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b569e-34f6-48e7-8eb6-3270c95ad16e admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:40:42.640973 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9a9037-1a55-4f10-a584-9986f0c51a3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:40:42.641289 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a9037-1a55-4f10-a584-9986f0c51a3c service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:42.641585 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a9037-1a55-4f10-a584-9986f0c51a3c service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:42.641867 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a9037-1a55-4f10-a584-9986f0c51a3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:42.651209 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9a9037-1a55-4f10-a584-9986f0c51a3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:40:42.652660 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9a9037-1a55-4f10-a584-9986f0c51a3c service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:40:42.663352 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1253/2529] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:40:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:40:42.929958 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e713a9-5be3-456a-b282-3464aa66a7f7 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:40:42.931431 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-16e713a9-5be3-456a-b282-3464aa66a7f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:40:42.945625 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e713a9-5be3-456a-b282-3464aa66a7f7 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:40:42.950336 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb83c1c-f069-472f-a14e-4c87c123fded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:40:42.951192 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb83c1c-f069-472f-a14e-4c87c123fded admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:42.951478 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb83c1c-f069-472f-a14e-4c87c123fded admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:42.951755 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb83c1c-f069-472f-a14e-4c87c123fded admin admin] PATH_INFO: `/v3/projects/c618595c5dce40818bbc46b85f6aaadc` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:42.953961 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb83c1c-f069-472f-a14e-4c87c123fded admin admin] RBAC: Authorizing `identity:delete_project(project_id=c618595c5dce40818bbc46b85f6aaadc)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:40:42.955872 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb83c1c-f069-472f-a14e-4c87c123fded admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:40:43.010218 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-deb83c1c-f069-472f-a14e-4c87c123fded admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c618595c5dce40818bbc46b85f6aaadc', 'request_id': 'req-deb83c1c-f069-472f-a14e-4c87c123fded'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:40:43.017289 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-deb83c1c-f069-472f-a14e-4c87c123fded admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c618595c5dce40818bbc46b85f6aaadc', 'request_id': 'req-deb83c1c-f069-472f-a14e-4c87c123fded'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:40:43.022959 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-deb83c1c-f069-472f-a14e-4c87c123fded admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c618595c5dce40818bbc46b85f6aaadc', 'request_id': 'req-deb83c1c-f069-472f-a14e-4c87c123fded'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:40:43.035255 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-deb83c1c-f069-472f-a14e-4c87c123fded admin admin] The token cache is being invalidate because project c618595c5dce40818bbc46b85f6aaadc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:40:43.035548 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-deb83c1c-f069-472f-a14e-4c87c123fded admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:40:43.036488 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-deb83c1c-f069-472f-a14e-4c87c123fded admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:40:43.038356 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1277/2530] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:40:42 2022] DELETE /identity/v3/projects/c618595c5dce40818bbc46b85f6aaadc => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:40:43.043019 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f2ca35-3bea-4b26-9a0d-d5899a273e19 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:43.043494 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f2ca35-3bea-4b26-9a0d-d5899a273e19 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:43.043708 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f2ca35-3bea-4b26-9a0d-d5899a273e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:43.062334 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-43f2ca35-3bea-4b26-9a0d-d5899a273e19 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:40:43.063531 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-43f2ca35-3bea-4b26-9a0d-d5899a273e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:40:43.067994 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:40:43.126890 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1254/2531] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:40:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:40:43.134524 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c239b916-b583-4dab-9864-b41665e81e64 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:43.134817 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c239b916-b583-4dab-9864-b41665e81e64 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:43.135102 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c239b916-b583-4dab-9864-b41665e81e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:43.153540 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-c239b916-b583-4dab-9864-b41665e81e64 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:40:43.154734 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-c239b916-b583-4dab-9864-b41665e81e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:40:43.162884 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1278/2532] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:40:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:40:43.168321 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f2ca35-3bea-4b26-9a0d-d5899a273e19 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:40:43.177839 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f2ca35-3bea-4b26-9a0d-d5899a273e19 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:40:43.182340 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f63fd-3f53-42b0-a7be-3197f4c7964b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:40:43.182976 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f63fd-3f53-42b0-a7be-3197f4c7964b admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:43.183309 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f63fd-3f53-42b0-a7be-3197f4c7964b admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:43.183587 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f63fd-3f53-42b0-a7be-3197f4c7964b admin admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:43.184301 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695f63fd-3f53-42b0-a7be-3197f4c7964b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:40:43.184607 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695f63fd-3f53-42b0-a7be-3197f4c7964b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:40:43.186764 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695f63fd-3f53-42b0-a7be-3197f4c7964b admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:40:43.198398 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1255/2533] 10.222.0.26 () {58 vars in 1152 bytes} [Fri Jul 1 19:40:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:40:43.203212 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c239b916-b583-4dab-9864-b41665e81e64 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:40:43.212360 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c239b916-b583-4dab-9864-b41665e81e64 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:40:43.216991 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449b3783-d9f7-443a-94f8-9b69e7d39d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:40:43.217693 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b3783-d9f7-443a-94f8-9b69e7d39d4a admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:43.218122 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b3783-d9f7-443a-94f8-9b69e7d39d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:43.218399 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b3783-d9f7-443a-94f8-9b69e7d39d4a admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:43.219097 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449b3783-d9f7-443a-94f8-9b69e7d39d4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:40:43.220988 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449b3783-d9f7-443a-94f8-9b69e7d39d4a admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:40:43.245741 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1279/2534] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:40:43 2022] POST /identity/v3/projects => generated 361 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:40:43.250286 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f63fd-3f53-42b0-a7be-3197f4c7964b admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:40:43.260044 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f63fd-3f53-42b0-a7be-3197f4c7964b admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:40:43.317073 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42470427-1b47-4581-8eef-e3967aa0fef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:40:43.317767 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42470427-1b47-4581-8eef-e3967aa0fef4 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:43.318053 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42470427-1b47-4581-8eef-e3967aa0fef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:43.318335 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42470427-1b47-4581-8eef-e3967aa0fef4 admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:43.319032 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42470427-1b47-4581-8eef-e3967aa0fef4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:40:43.320996 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42470427-1b47-4581-8eef-e3967aa0fef4 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:40:43.340012 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1256/2535] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:40:43 2022] POST /identity/v3/users => generated 281 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:40:43.344098 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449b3783-d9f7-443a-94f8-9b69e7d39d4a admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:40:43.354241 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449b3783-d9f7-443a-94f8-9b69e7d39d4a admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:40:43.359570 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a23ebc1-d7e1-4ece-8db0-2e758e8e649f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:40:43.360239 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23ebc1-d7e1-4ece-8db0-2e758e8e649f admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:43.360528 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23ebc1-d7e1-4ece-8db0-2e758e8e649f admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:43.360806 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23ebc1-d7e1-4ece-8db0-2e758e8e649f admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:43.361684 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a23ebc1-d7e1-4ece-8db0-2e758e8e649f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:40:43.363276 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a23ebc1-d7e1-4ece-8db0-2e758e8e649f admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:40:43.374685 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1280/2536] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:40:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:40:43.378642 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42470427-1b47-4581-8eef-e3967aa0fef4 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:40:43.388624 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42470427-1b47-4581-8eef-e3967aa0fef4 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:40:43.393343 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729bdec0-7bc9-425d-b26e-437335286561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:40:43.394000 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729bdec0-7bc9-425d-b26e-437335286561 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:43.394290 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729bdec0-7bc9-425d-b26e-437335286561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:43.394568 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729bdec0-7bc9-425d-b26e-437335286561 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:43.395290 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729bdec0-7bc9-425d-b26e-437335286561 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:40:43.396888 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729bdec0-7bc9-425d-b26e-437335286561 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:40:43.406906 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1257/2537] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:40:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 19:40:43.411094 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a23ebc1-d7e1-4ece-8db0-2e758e8e649f admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:40:43.421372 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a23ebc1-d7e1-4ece-8db0-2e758e8e649f admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:40:43.426499 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d71da6b-2df4-44eb-aaf0-d73b389a2d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:40:43.427478 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d71da6b-2df4-44eb-aaf0-d73b389a2d59 admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:43.427804 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d71da6b-2df4-44eb-aaf0-d73b389a2d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:43.428119 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d71da6b-2df4-44eb-aaf0-d73b389a2d59 admin admin] PATH_INFO: `/v3/projects/3172977dee24413cb40235c63e0b3078/users/4f4fcc83e6c34db9aa8338e908fc97ef/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:43.443440 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d71da6b-2df4-44eb-aaf0-d73b389a2d59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3172977dee24413cb40235c63e0b3078, user_id=4f4fcc83e6c34db9aa8338e908fc97ef, role_id=4cbf6ec846eb4b7c8cc52e9bfd6f076f)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:40:43.446131 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d71da6b-2df4-44eb-aaf0-d73b389a2d59 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:40:43.449027 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:40:43.460279 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1281/2538] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:40:43 2022] PUT /identity/v3/projects/3172977dee24413cb40235c63e0b3078/users/4f4fcc83e6c34db9aa8338e908fc97ef/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:40:43.470218 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd56de7-7194-4224-a0d4-4aa6baf2a254 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:43.470513 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd56de7-7194-4224-a0d4-4aa6baf2a254 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:43.470798 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd56de7-7194-4224-a0d4-4aa6baf2a254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:43.499899 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-9cd56de7-7194-4224-a0d4-4aa6baf2a254 None None] MFA Rules not processed for user `4f4fcc83e6c34db9aa8338e908fc97ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:40:43.501113 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-9cd56de7-7194-4224-a0d4-4aa6baf2a254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:40:43.564362 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1258/2539] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:40:43 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:40:43.597057 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d71da6b-2df4-44eb-aaf0-d73b389a2d59 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:40:43.598816 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-9d71da6b-2df4-44eb-aaf0-d73b389a2d59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:40:43.656601 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d71da6b-2df4-44eb-aaf0-d73b389a2d59 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:40:43.660228 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7714a2f5-491f-4fee-ad39-efb9ef6e6689 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a3ed285ee4c4d04abf7daf0aeb9fb7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:40:43.661149 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7714a2f5-491f-4fee-ad39-efb9ef6e6689 service cinder] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:43.661460 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7714a2f5-491f-4fee-ad39-efb9ef6e6689 service cinder] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:43.661736 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7714a2f5-491f-4fee-ad39-efb9ef6e6689 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:43.669906 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7714a2f5-491f-4fee-ad39-efb9ef6e6689 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:40:43.671972 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7714a2f5-491f-4fee-ad39-efb9ef6e6689 service cinder] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:40:43.680714 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1282/2540] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:40:43 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:40:43.694388 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd56de7-7194-4224-a0d4-4aa6baf2a254 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:40:43.699625 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:40:43.755925 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd56de7-7194-4224-a0d4-4aa6baf2a254 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:40:43.760528 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eee238-4989-4b59-a1e9-56479d20980a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:40:43.761425 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eee238-4989-4b59-a1e9-56479d20980a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:43.761713 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eee238-4989-4b59-a1e9-56479d20980a admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:43.761990 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eee238-4989-4b59-a1e9-56479d20980a admin admin] PATH_INFO: `/v3/users/4f4fcc83e6c34db9aa8338e908fc97ef` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:43.763181 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eee238-4989-4b59-a1e9-56479d20980a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f4fcc83e6c34db9aa8338e908fc97ef)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:40:43.765160 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eee238-4989-4b59-a1e9-56479d20980a admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:40:43.811864 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-62eee238-4989-4b59-a1e9-56479d20980a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f4fcc83e6c34db9aa8338e908fc97ef'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:40:43.812608 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-62eee238-4989-4b59-a1e9-56479d20980a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f4fcc83e6c34db9aa8338e908fc97ef'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:40:43.819718 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-62eee238-4989-4b59-a1e9-56479d20980a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f4fcc83e6c34db9aa8338e908fc97ef'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:40:43.826765 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-62eee238-4989-4b59-a1e9-56479d20980a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f4fcc83e6c34db9aa8338e908fc97ef'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:40:43.827413 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-62eee238-4989-4b59-a1e9-56479d20980a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f4fcc83e6c34db9aa8338e908fc97ef'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:40:43.844816 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1259/2541] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:40:43 2022] DELETE /identity/v3/users/4f4fcc83e6c34db9aa8338e908fc97ef => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:40:43.849261 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08840246-8217-46ae-8cf0-11531f2101fa None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:43.849576 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08840246-8217-46ae-8cf0-11531f2101fa None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:43.849854 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08840246-8217-46ae-8cf0-11531f2101fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:43.867143 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-08840246-8217-46ae-8cf0-11531f2101fa None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:40:43.868442 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-08840246-8217-46ae-8cf0-11531f2101fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:40:43.928885 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1283/2542] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:40:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:40:43.938593 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eee238-4989-4b59-a1e9-56479d20980a admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:40:43.940095 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-62eee238-4989-4b59-a1e9-56479d20980a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:40:44.000034 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eee238-4989-4b59-a1e9-56479d20980a admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:40:44.003672 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67372df-1f5d-4eb2-9986-d0dbdc62fda6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:40:44.004327 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67372df-1f5d-4eb2-9986-d0dbdc62fda6 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:44.004611 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67372df-1f5d-4eb2-9986-d0dbdc62fda6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:44.004885 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67372df-1f5d-4eb2-9986-d0dbdc62fda6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:44.014999 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67372df-1f5d-4eb2-9986-d0dbdc62fda6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:40:44.016501 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67372df-1f5d-4eb2-9986-d0dbdc62fda6 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:40:44.026279 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1260/2543] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:40:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:40:44.303655 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08840246-8217-46ae-8cf0-11531f2101fa None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:40:44.305208 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-08840246-8217-46ae-8cf0-11531f2101fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:40:44.322784 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08840246-8217-46ae-8cf0-11531f2101fa None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:40:44.328940 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4250de-42c2-4423-8d59-3276fa5c2956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:40:44.329929 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4250de-42c2-4423-8d59-3276fa5c2956 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:44.330155 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4250de-42c2-4423-8d59-3276fa5c2956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:44.330444 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4250de-42c2-4423-8d59-3276fa5c2956 admin admin] PATH_INFO: `/v3/projects/3172977dee24413cb40235c63e0b3078` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:44.331906 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4250de-42c2-4423-8d59-3276fa5c2956 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3172977dee24413cb40235c63e0b3078)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:40:44.333950 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4250de-42c2-4423-8d59-3276fa5c2956 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:40:44.404774 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-8e4250de-42c2-4423-8d59-3276fa5c2956 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3172977dee24413cb40235c63e0b3078', 'request_id': 'req-8e4250de-42c2-4423-8d59-3276fa5c2956'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:40:44.411638 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-8e4250de-42c2-4423-8d59-3276fa5c2956 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3172977dee24413cb40235c63e0b3078', 'request_id': 'req-8e4250de-42c2-4423-8d59-3276fa5c2956'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:40:44.420101 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-8e4250de-42c2-4423-8d59-3276fa5c2956 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3172977dee24413cb40235c63e0b3078', 'request_id': 'req-8e4250de-42c2-4423-8d59-3276fa5c2956'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:40:44.436000 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-8e4250de-42c2-4423-8d59-3276fa5c2956 admin admin] The token cache is being invalidate because project 3172977dee24413cb40235c63e0b3078 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:40:44.436946 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-8e4250de-42c2-4423-8d59-3276fa5c2956 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:40:44.437746 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-8e4250de-42c2-4423-8d59-3276fa5c2956 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:40:44.440352 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1284/2544] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:40:44 2022] DELETE /identity/v3/projects/3172977dee24413cb40235c63e0b3078 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:40:44.444889 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bff326-5a29-409b-a557-a49d3c1ce81f None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:44.445419 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bff326-5a29-409b-a557-a49d3c1ce81f None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:44.445526 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bff326-5a29-409b-a557-a49d3c1ce81f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:44.464594 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-b9bff326-5a29-409b-a557-a49d3c1ce81f None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:40:44.465830 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-b9bff326-5a29-409b-a557-a49d3c1ce81f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:40:44.487203 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:40:44.531935 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1261/2545] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:40:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:40:44.539744 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb5f30-a7e4-4fa4-bf51-ac240ee74b6c None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:44.540039 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb5f30-a7e4-4fa4-bf51-ac240ee74b6c None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:44.540325 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb5f30-a7e4-4fa4-bf51-ac240ee74b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:44.560350 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-96bb5f30-a7e4-4fa4-bf51-ac240ee74b6c None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:40:44.562118 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-96bb5f30-a7e4-4fa4-bf51-ac240ee74b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:40:44.570521 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1285/2546] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:40:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:40:44.574996 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bff326-5a29-409b-a557-a49d3c1ce81f None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:40:44.586371 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bff326-5a29-409b-a557-a49d3c1ce81f None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:40:44.591340 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523487bb-4500-405d-a15b-5b87440cf0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:40:44.591990 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523487bb-4500-405d-a15b-5b87440cf0f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:44.592300 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523487bb-4500-405d-a15b-5b87440cf0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:44.592601 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523487bb-4500-405d-a15b-5b87440cf0f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:44.593361 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523487bb-4500-405d-a15b-5b87440cf0f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:40:44.593672 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523487bb-4500-405d-a15b-5b87440cf0f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:40:44.595266 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523487bb-4500-405d-a15b-5b87440cf0f5 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:40:44.606855 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1262/2547] 10.222.0.26 () {58 vars in 1152 bytes} [Fri Jul 1 19:40:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:40:44.611269 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bb5f30-a7e4-4fa4-bf51-ac240ee74b6c None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:40:44.620706 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bb5f30-a7e4-4fa4-bf51-ac240ee74b6c None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:40:44.625798 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c57da06-d7fc-44d7-b5ab-cf86ef28ad30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:40:44.626454 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c57da06-d7fc-44d7-b5ab-cf86ef28ad30 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:44.626738 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c57da06-d7fc-44d7-b5ab-cf86ef28ad30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:44.627016 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c57da06-d7fc-44d7-b5ab-cf86ef28ad30 admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:44.627717 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c57da06-d7fc-44d7-b5ab-cf86ef28ad30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:40:44.629640 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c57da06-d7fc-44d7-b5ab-cf86ef28ad30 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:40:44.646838 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:40:44.662707 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1286/2548] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:40:44 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:40:44.666766 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523487bb-4500-405d-a15b-5b87440cf0f5 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:40:44.676781 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523487bb-4500-405d-a15b-5b87440cf0f5 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:40:44.737665 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c9dd7-b653-4dbe-bc9b-c167b83a238c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:40:44.738349 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c9dd7-b653-4dbe-bc9b-c167b83a238c admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:44.738637 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c9dd7-b653-4dbe-bc9b-c167b83a238c admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:44.738917 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c9dd7-b653-4dbe-bc9b-c167b83a238c admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:44.739633 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c9dd7-b653-4dbe-bc9b-c167b83a238c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:40:44.741626 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c9dd7-b653-4dbe-bc9b-c167b83a238c admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:40:44.763435 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1263/2549] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:40:44 2022] POST /identity/v3/users => generated 286 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:40:44.769018 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c57da06-d7fc-44d7-b5ab-cf86ef28ad30 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:40:44.782639 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c57da06-d7fc-44d7-b5ab-cf86ef28ad30 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:40:44.788367 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283dc0bc-950f-46b9-ac1b-82db50956d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:40:44.789050 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283dc0bc-950f-46b9-ac1b-82db50956d2c admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:44.789369 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283dc0bc-950f-46b9-ac1b-82db50956d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:44.789656 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283dc0bc-950f-46b9-ac1b-82db50956d2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:44.790399 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283dc0bc-950f-46b9-ac1b-82db50956d2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:40:44.792014 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283dc0bc-950f-46b9-ac1b-82db50956d2c admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:40:44.805187 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1287/2550] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:40:44 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:40:44.808915 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c9dd7-b653-4dbe-bc9b-c167b83a238c admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:40:44.820141 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c9dd7-b653-4dbe-bc9b-c167b83a238c admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:40:44.825149 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bb95e6-c1b7-4d23-afba-093415d80bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:40:44.825799 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb95e6-c1b7-4d23-afba-093415d80bbd admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:44.826089 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb95e6-c1b7-4d23-afba-093415d80bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:44.826380 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb95e6-c1b7-4d23-afba-093415d80bbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:44.827157 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bb95e6-c1b7-4d23-afba-093415d80bbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:40:44.828852 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bb95e6-c1b7-4d23-afba-093415d80bbd admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:40:44.840072 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1264/2551] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:40:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 19:40:44.843979 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283dc0bc-950f-46b9-ac1b-82db50956d2c admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:40:44.853891 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283dc0bc-950f-46b9-ac1b-82db50956d2c admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:40:44.859220 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1d818b-23e8-4da0-94ae-60326cbb2a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:40:44.860090 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d818b-23e8-4da0-94ae-60326cbb2a33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:44.860375 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d818b-23e8-4da0-94ae-60326cbb2a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:44.860656 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d818b-23e8-4da0-94ae-60326cbb2a33 admin admin] PATH_INFO: `/v3/projects/6eeb9b0247554eec8d166c864d257325/users/4131419a2c9d4119a10433f4d26cd32c/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:44.877092 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1d818b-23e8-4da0-94ae-60326cbb2a33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6eeb9b0247554eec8d166c864d257325, user_id=4131419a2c9d4119a10433f4d26cd32c, role_id=4cbf6ec846eb4b7c8cc52e9bfd6f076f)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:40:44.879812 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1d818b-23e8-4da0-94ae-60326cbb2a33 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:40:44.893641 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1288/2552] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:40:44 2022] PUT /identity/v3/projects/6eeb9b0247554eec8d166c864d257325/users/4131419a2c9d4119a10433f4d26cd32c/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:40:44.898637 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d9581-489b-489d-8e24-24d46aa337b0 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:44.898937 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d9581-489b-489d-8e24-24d46aa337b0 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:44.899248 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d9581-489b-489d-8e24-24d46aa337b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:44.917351 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-a00d9581-489b-489d-8e24-24d46aa337b0 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:40:44.918560 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-a00d9581-489b-489d-8e24-24d46aa337b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:40:44.981731 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1265/2553] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:40:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:40:44.992430 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1d818b-23e8-4da0-94ae-60326cbb2a33 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:40:44.994210 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-6d1d818b-23e8-4da0-94ae-60326cbb2a33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:40:45.053761 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1d818b-23e8-4da0-94ae-60326cbb2a33 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:40:45.057501 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900f5919-df93-4e54-a299-b3815a4e9a50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:40:45.058153 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f5919-df93-4e54-a299-b3815a4e9a50 service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:45.058441 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f5919-df93-4e54-a299-b3815a4e9a50 service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:45.058724 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f5919-df93-4e54-a299-b3815a4e9a50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:45.068435 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900f5919-df93-4e54-a299-b3815a4e9a50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:40:45.069907 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900f5919-df93-4e54-a299-b3815a4e9a50 service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:40:45.079616 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1289/2554] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:40:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:40:45.676548 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f68251-2cfb-494b-bcac-d82442775ae4 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:45.677075 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f68251-2cfb-494b-bcac-d82442775ae4 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:45.677158 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f68251-2cfb-494b-bcac-d82442775ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:45.706670 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-f5f68251-2cfb-494b-bcac-d82442775ae4 None None] MFA Rules not processed for user `4131419a2c9d4119a10433f4d26cd32c`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:40:45.707897 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-f5f68251-2cfb-494b-bcac-d82442775ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:40:45.733523 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:40:45.790492 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1266/2555] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:40:45 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:40:45.802096 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900f5919-df93-4e54-a299-b3815a4e9a50 service neutron] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:40:45.803627 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-900f5919-df93-4e54-a299-b3815a4e9a50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:40:45.870552 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900f5919-df93-4e54-a299-b3815a4e9a50 service neutron] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:40:45.874263 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23385bf-6294-45c2-bda0-0238f599316b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a3ed285ee4c4d04abf7daf0aeb9fb7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:40:45.875057 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23385bf-6294-45c2-bda0-0238f599316b service cinder] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:45.875319 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23385bf-6294-45c2-bda0-0238f599316b service cinder] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:45.875605 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23385bf-6294-45c2-bda0-0238f599316b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:45.885879 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23385bf-6294-45c2-bda0-0238f599316b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:40:45.893772 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23385bf-6294-45c2-bda0-0238f599316b service cinder] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:40:45.903324 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1290/2556] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:40:45 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:40:47.268839 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89100b6b-ddde-4f86-b63c-4892907f11df None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:47.269788 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89100b6b-ddde-4f86-b63c-4892907f11df None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:47.269986 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89100b6b-ddde-4f86-b63c-4892907f11df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:47.290552 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-89100b6b-ddde-4f86-b63c-4892907f11df None None] MFA Rules not processed for user `4131419a2c9d4119a10433f4d26cd32c`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:40:47.291878 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-89100b6b-ddde-4f86-b63c-4892907f11df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:40:47.300820 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1267/2557] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:40:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:40:47.564076 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23385bf-6294-45c2-bda0-0238f599316b service cinder] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:40:47.565598 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-b23385bf-6294-45c2-bda0-0238f599316b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:40:47.578504 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23385bf-6294-45c2-bda0-0238f599316b service cinder] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:40:47.582138 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae36113b-4045-4e85-a638-b95812dd5a31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:40:47.582797 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae36113b-4045-4e85-a638-b95812dd5a31 service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:47.583083 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae36113b-4045-4e85-a638-b95812dd5a31 service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:47.583352 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae36113b-4045-4e85-a638-b95812dd5a31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:47.585301 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-ae36113b-4045-4e85-a638-b95812dd5a31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:40:47.595643 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae36113b-4045-4e85-a638-b95812dd5a31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:40:47.597064 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae36113b-4045-4e85-a638-b95812dd5a31 service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:40:47.605444 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1291/2558] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:40:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:40:48.699301 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89100b6b-ddde-4f86-b63c-4892907f11df None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:40:48.700805 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-89100b6b-ddde-4f86-b63c-4892907f11df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:40:48.715861 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89100b6b-ddde-4f86-b63c-4892907f11df None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:40:48.720904 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ee4fd8-3e35-4ca9-918c-c93fa33d4c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:40:48.721811 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee4fd8-3e35-4ca9-918c-c93fa33d4c23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:48.722096 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee4fd8-3e35-4ca9-918c-c93fa33d4c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:48.722374 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee4fd8-3e35-4ca9-918c-c93fa33d4c23 admin admin] PATH_INFO: `/v3/users/91c82e59af62461e85d22fc4a8269c25` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:48.723565 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ee4fd8-3e35-4ca9-918c-c93fa33d4c23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91c82e59af62461e85d22fc4a8269c25)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:40:48.725560 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ee4fd8-3e35-4ca9-918c-c93fa33d4c23 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:40:48.777311 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-d0ee4fd8-3e35-4ca9-918c-c93fa33d4c23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91c82e59af62461e85d22fc4a8269c25'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:40:48.778035 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-d0ee4fd8-3e35-4ca9-918c-c93fa33d4c23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91c82e59af62461e85d22fc4a8269c25'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:40:48.788932 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-d0ee4fd8-3e35-4ca9-918c-c93fa33d4c23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91c82e59af62461e85d22fc4a8269c25'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:40:48.798628 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-d0ee4fd8-3e35-4ca9-918c-c93fa33d4c23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91c82e59af62461e85d22fc4a8269c25'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:40:48.799696 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-d0ee4fd8-3e35-4ca9-918c-c93fa33d4c23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91c82e59af62461e85d22fc4a8269c25'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:40:48.817487 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1268/2559] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:40:48 2022] DELETE /identity/v3/users/91c82e59af62461e85d22fc4a8269c25 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:40:48.986479 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae36113b-4045-4e85-a638-b95812dd5a31 service neutron] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:40:49.008886 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae36113b-4045-4e85-a638-b95812dd5a31 service neutron] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:40:49.090976 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:40:49.103655 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb49c5-a457-4e8f-8f5d-c7cd88fcf2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:40:49.104690 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb49c5-a457-4e8f-8f5d-c7cd88fcf2ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:49.105159 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb49c5-a457-4e8f-8f5d-c7cd88fcf2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:49.105476 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb49c5-a457-4e8f-8f5d-c7cd88fcf2ec admin admin] PATH_INFO: `/v3/projects/979d163b3c0a484b95c2dfe3248247d9` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:49.106706 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cb49c5-a457-4e8f-8f5d-c7cd88fcf2ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=979d163b3c0a484b95c2dfe3248247d9)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:40:49.108762 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cb49c5-a457-4e8f-8f5d-c7cd88fcf2ec admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:40:49.172882 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-d1cb49c5-a457-4e8f-8f5d-c7cd88fcf2ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '979d163b3c0a484b95c2dfe3248247d9', 'request_id': 'req-d1cb49c5-a457-4e8f-8f5d-c7cd88fcf2ec'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:40:49.180224 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-d1cb49c5-a457-4e8f-8f5d-c7cd88fcf2ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '979d163b3c0a484b95c2dfe3248247d9', 'request_id': 'req-d1cb49c5-a457-4e8f-8f5d-c7cd88fcf2ec'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:40:49.188080 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-d1cb49c5-a457-4e8f-8f5d-c7cd88fcf2ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '979d163b3c0a484b95c2dfe3248247d9', 'request_id': 'req-d1cb49c5-a457-4e8f-8f5d-c7cd88fcf2ec'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:40:49.204087 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-d1cb49c5-a457-4e8f-8f5d-c7cd88fcf2ec admin admin] The token cache is being invalidate because project 979d163b3c0a484b95c2dfe3248247d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:40:49.204382 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-d1cb49c5-a457-4e8f-8f5d-c7cd88fcf2ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:40:49.205001 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-d1cb49c5-a457-4e8f-8f5d-c7cd88fcf2ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:40:49.206562 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1292/2560] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:40:48 2022] DELETE /identity/v3/projects/979d163b3c0a484b95c2dfe3248247d9 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:40:49.211607 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1fc614-7c89-4771-b5a4-09ee5c296d12 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:49.211902 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1fc614-7c89-4771-b5a4-09ee5c296d12 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:49.212183 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1fc614-7c89-4771-b5a4-09ee5c296d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:49.231538 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-4b1fc614-7c89-4771-b5a4-09ee5c296d12 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:40:49.233024 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-4b1fc614-7c89-4771-b5a4-09ee5c296d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:40:49.302329 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1269/2561] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:40:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:40:49.310498 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a3a49-36c0-41ca-ba46-c395f9163af1 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:49.310796 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a3a49-36c0-41ca-ba46-c395f9163af1 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:49.311140 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a3a49-36c0-41ca-ba46-c395f9163af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:49.330116 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-599a3a49-36c0-41ca-ba46-c395f9163af1 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:40:49.331332 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-599a3a49-36c0-41ca-ba46-c395f9163af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:40:49.340406 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1293/2562] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:40:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:40:49.344664 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1fc614-7c89-4771-b5a4-09ee5c296d12 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:40:49.354461 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1fc614-7c89-4771-b5a4-09ee5c296d12 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:40:49.359823 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ed7a4d-62fc-4bb3-a7f5-d6078db4f9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:40:49.360504 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed7a4d-62fc-4bb3-a7f5-d6078db4f9d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:49.360772 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed7a4d-62fc-4bb3-a7f5-d6078db4f9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:49.361055 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed7a4d-62fc-4bb3-a7f5-d6078db4f9d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:49.361827 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ed7a4d-62fc-4bb3-a7f5-d6078db4f9d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:40:49.362143 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ed7a4d-62fc-4bb3-a7f5-d6078db4f9d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:40:49.363825 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ed7a4d-62fc-4bb3-a7f5-d6078db4f9d2 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:40:49.381018 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1270/2563] 10.222.0.26 () {58 vars in 1152 bytes} [Fri Jul 1 19:40:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:40:49.382322 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a3a49-36c0-41ca-ba46-c395f9163af1 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:40:49.391982 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a3a49-36c0-41ca-ba46-c395f9163af1 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:40:49.399170 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeb03a0-20ce-48ab-89fc-95d08e8b56a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:40:49.399835 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb03a0-20ce-48ab-89fc-95d08e8b56a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:49.400122 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb03a0-20ce-48ab-89fc-95d08e8b56a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:49.400399 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb03a0-20ce-48ab-89fc-95d08e8b56a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:49.401090 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeb03a0-20ce-48ab-89fc-95d08e8b56a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:40:49.403053 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeb03a0-20ce-48ab-89fc-95d08e8b56a5 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:40:49.432645 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1294/2564] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:40:49 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:40:49.437506 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ed7a4d-62fc-4bb3-a7f5-d6078db4f9d2 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:40:49.447800 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ed7a4d-62fc-4bb3-a7f5-d6078db4f9d2 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:40:49.460594 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:40:49.510693 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d3713e-cb5b-44f0-b907-4979a5df6b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:40:49.511368 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d3713e-cb5b-44f0-b907-4979a5df6b4c admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:49.511657 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d3713e-cb5b-44f0-b907-4979a5df6b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:49.511940 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d3713e-cb5b-44f0-b907-4979a5df6b4c admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:49.512657 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d3713e-cb5b-44f0-b907-4979a5df6b4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:40:49.514654 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d3713e-cb5b-44f0-b907-4979a5df6b4c admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:40:49.538644 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1271/2565] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:40:49 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:40:49.540189 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeb03a0-20ce-48ab-89fc-95d08e8b56a5 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:40:49.551038 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeb03a0-20ce-48ab-89fc-95d08e8b56a5 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:40:49.555689 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2559e88c-dec4-4fa8-b0d6-2868628fd359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:40:49.556286 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559e88c-dec4-4fa8-b0d6-2868628fd359 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:49.556572 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559e88c-dec4-4fa8-b0d6-2868628fd359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:49.556848 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559e88c-dec4-4fa8-b0d6-2868628fd359 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:49.557611 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2559e88c-dec4-4fa8-b0d6-2868628fd359 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:40:49.559203 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2559e88c-dec4-4fa8-b0d6-2868628fd359 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:40:49.570333 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1295/2566] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:40:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:40:49.574413 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d3713e-cb5b-44f0-b907-4979a5df6b4c admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:40:49.584253 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d3713e-cb5b-44f0-b907-4979a5df6b4c admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:40:49.588840 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89602400-3ffd-4f70-8e30-f5a6f4154e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:40:49.589533 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89602400-3ffd-4f70-8e30-f5a6f4154e2e admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:49.589822 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89602400-3ffd-4f70-8e30-f5a6f4154e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:49.590103 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89602400-3ffd-4f70-8e30-f5a6f4154e2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:49.590853 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89602400-3ffd-4f70-8e30-f5a6f4154e2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:40:49.592633 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89602400-3ffd-4f70-8e30-f5a6f4154e2e admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:40:49.606107 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1272/2567] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:40:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:40:49.607400 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2559e88c-dec4-4fa8-b0d6-2868628fd359 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:40:49.618195 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2559e88c-dec4-4fa8-b0d6-2868628fd359 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:40:49.630286 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dfacf8-801e-4180-8add-a2b1b6fc3ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:40:49.631195 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfacf8-801e-4180-8add-a2b1b6fc3ccc admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:49.631482 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfacf8-801e-4180-8add-a2b1b6fc3ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:49.632141 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfacf8-801e-4180-8add-a2b1b6fc3ccc admin admin] PATH_INFO: `/v3/projects/79f31fb931fe4c139341706de494a759/users/1eae281b1ee147a09134db72c64282ec/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:49.647976 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dfacf8-801e-4180-8add-a2b1b6fc3ccc admin admin] RBAC: Authorizing `identity:create_grant(project_id=79f31fb931fe4c139341706de494a759, user_id=1eae281b1ee147a09134db72c64282ec, role_id=4cbf6ec846eb4b7c8cc52e9bfd6f076f)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:40:49.650685 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dfacf8-801e-4180-8add-a2b1b6fc3ccc admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:40:49.665745 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1296/2568] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:40:49 2022] PUT /identity/v3/projects/79f31fb931fe4c139341706de494a759/users/1eae281b1ee147a09134db72c64282ec/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:40:49.670930 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd61bbe-b66b-4100-a8e0-e8d63f676fb7 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:49.671230 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd61bbe-b66b-4100-a8e0-e8d63f676fb7 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:49.671602 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd61bbe-b66b-4100-a8e0-e8d63f676fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:49.691367 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-2dd61bbe-b66b-4100-a8e0-e8d63f676fb7 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:40:49.692458 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-2dd61bbe-b66b-4100-a8e0-e8d63f676fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:40:49.758971 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1273/2569] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:40:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:40:49.769374 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dfacf8-801e-4180-8add-a2b1b6fc3ccc admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:40:49.771123 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-85dfacf8-801e-4180-8add-a2b1b6fc3ccc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:40:49.830069 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dfacf8-801e-4180-8add-a2b1b6fc3ccc admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:40:49.833899 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a0f538-64a2-47bc-bb7e-dce8ef0336ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:40:49.834547 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0f538-64a2-47bc-bb7e-dce8ef0336ac service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:49.834830 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0f538-64a2-47bc-bb7e-dce8ef0336ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:49.835105 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0f538-64a2-47bc-bb7e-dce8ef0336ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:49.847741 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a0f538-64a2-47bc-bb7e-dce8ef0336ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:40:49.849197 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a0f538-64a2-47bc-bb7e-dce8ef0336ac service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:40:49.860109 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1297/2570] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:40:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:40:54.078662 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c1340-cad8-46dd-b88b-6d715615da2d None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:54.079535 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c1340-cad8-46dd-b88b-6d715615da2d None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:54.080160 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c1340-cad8-46dd-b88b-6d715615da2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:54.114289 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-9d4c1340-cad8-46dd-b88b-6d715615da2d None None] MFA Rules not processed for user `1eae281b1ee147a09134db72c64282ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:40:54.115940 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-9d4c1340-cad8-46dd-b88b-6d715615da2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:40:54.194354 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1274/2571] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:40:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:40:54.202577 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a0f538-64a2-47bc-bb7e-dce8ef0336ac service neutron] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:40:54.204287 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-62a0f538-64a2-47bc-bb7e-dce8ef0336ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:40:54.237571 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:40:54.303752 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a0f538-64a2-47bc-bb7e-dce8ef0336ac service neutron] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:40:54.311750 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f930c422-76aa-4a01-9203-e19c9bf8d217 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13fd76fc7dd1410b9cde5adbaa6cb2e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:40:54.312204 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f930c422-76aa-4a01-9203-e19c9bf8d217 service nova] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:54.312609 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f930c422-76aa-4a01-9203-e19c9bf8d217 service nova] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:54.312987 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f930c422-76aa-4a01-9203-e19c9bf8d217 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:54.321893 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f930c422-76aa-4a01-9203-e19c9bf8d217 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:40:54.323633 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f930c422-76aa-4a01-9203-e19c9bf8d217 service nova] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:40:54.336414 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1298/2572] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:40:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:40:55.755438 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa0a11c-c544-42ed-b1fe-e825eb0d6b7e None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:55.755999 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa0a11c-c544-42ed-b1fe-e825eb0d6b7e None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:55.755999 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa0a11c-c544-42ed-b1fe-e825eb0d6b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:55.774092 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-faa0a11c-c544-42ed-b1fe-e825eb0d6b7e None None] MFA Rules not processed for user `1eae281b1ee147a09134db72c64282ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:40:55.775309 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-faa0a11c-c544-42ed-b1fe-e825eb0d6b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:40:55.782399 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1275/2573] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:40:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:41:03.338211 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d10f1e-5cbd-4508-97b2-ca36e1aa1107 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:03.338700 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d10f1e-5cbd-4508-97b2-ca36e1aa1107 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:03.338795 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d10f1e-5cbd-4508-97b2-ca36e1aa1107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:03.355675 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-01d10f1e-5cbd-4508-97b2-ca36e1aa1107 None None] MFA Rules not processed for user `4131419a2c9d4119a10433f4d26cd32c`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:41:03.356874 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-01d10f1e-5cbd-4508-97b2-ca36e1aa1107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:03.413429 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1299/2574] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:41:03 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:41:05.768617 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:10.717172 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa0a11c-c544-42ed-b1fe-e825eb0d6b7e None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:10.731849 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa0a11c-c544-42ed-b1fe-e825eb0d6b7e None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:10.738142 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af220c0b-c3b7-4b2e-a791-42717e6b0e7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13fd76fc7dd1410b9cde5adbaa6cb2e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:10.738796 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af220c0b-c3b7-4b2e-a791-42717e6b0e7d service nova] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:10.739085 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af220c0b-c3b7-4b2e-a791-42717e6b0e7d service nova] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:10.739361 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af220c0b-c3b7-4b2e-a791-42717e6b0e7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:10.741497 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-af220c0b-c3b7-4b2e-a791-42717e6b0e7d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:10.755439 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af220c0b-c3b7-4b2e-a791-42717e6b0e7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:10.757126 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af220c0b-c3b7-4b2e-a791-42717e6b0e7d service nova] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:10.768700 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1276/2575] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:41:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:41:13.406519 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=50 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:15.448450 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d10f1e-5cbd-4508-97b2-ca36e1aa1107 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:15.450050 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-01d10f1e-5cbd-4508-97b2-ca36e1aa1107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:15.462072 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d10f1e-5cbd-4508-97b2-ca36e1aa1107 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:15.465697 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1e589a-8dd6-429b-ab2a-1dca267110d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:15.466340 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1e589a-8dd6-429b-ab2a-1dca267110d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:15.466624 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1e589a-8dd6-429b-ab2a-1dca267110d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:15.466903 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1e589a-8dd6-429b-ab2a-1dca267110d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:15.469408 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-bc1e589a-8dd6-429b-ab2a-1dca267110d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:15.483902 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1e589a-8dd6-429b-ab2a-1dca267110d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:15.485342 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1e589a-8dd6-429b-ab2a-1dca267110d1 service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:15.496074 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1300/2576] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:41:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:41:18.989524 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af220c0b-c3b7-4b2e-a791-42717e6b0e7d service nova] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:18.991505 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-af220c0b-c3b7-4b2e-a791-42717e6b0e7d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:19.013093 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af220c0b-c3b7-4b2e-a791-42717e6b0e7d service nova] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:19.018346 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b74d9-85a9-47f4-b3cd-d0295f371e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:19.019605 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b74d9-85a9-47f4-b3cd-d0295f371e2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:19.019897 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b74d9-85a9-47f4-b3cd-d0295f371e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:19.020185 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b74d9-85a9-47f4-b3cd-d0295f371e2e admin admin] PATH_INFO: `/v3/users/75b8c92fd65a49e493373b4a13c18290` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:19.021511 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88b74d9-85a9-47f4-b3cd-d0295f371e2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=75b8c92fd65a49e493373b4a13c18290)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:19.023471 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88b74d9-85a9-47f4-b3cd-d0295f371e2e admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:19.077734 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-d88b74d9-85a9-47f4-b3cd-d0295f371e2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75b8c92fd65a49e493373b4a13c18290'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:19.078468 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-d88b74d9-85a9-47f4-b3cd-d0295f371e2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75b8c92fd65a49e493373b4a13c18290'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:19.089969 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-d88b74d9-85a9-47f4-b3cd-d0295f371e2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75b8c92fd65a49e493373b4a13c18290'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:19.098940 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-d88b74d9-85a9-47f4-b3cd-d0295f371e2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75b8c92fd65a49e493373b4a13c18290'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:19.099661 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-d88b74d9-85a9-47f4-b3cd-d0295f371e2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75b8c92fd65a49e493373b4a13c18290'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:19.120417 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1277/2577] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:41:18 2022] DELETE /identity/v3/users/75b8c92fd65a49e493373b4a13c18290 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:41:19.330138 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1e589a-8dd6-429b-ab2a-1dca267110d1 service neutron] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:19.342826 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1e589a-8dd6-429b-ab2a-1dca267110d1 service neutron] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:19.440405 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff5d5ff-6e30-48a8-8196-528c6fe87e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:19.441531 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff5d5ff-6e30-48a8-8196-528c6fe87e70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:19.441848 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff5d5ff-6e30-48a8-8196-528c6fe87e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:19.442153 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff5d5ff-6e30-48a8-8196-528c6fe87e70 admin admin] PATH_INFO: `/v3/projects/82aa323d169e4cd18abbf365aef1fd84` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:19.443667 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff5d5ff-6e30-48a8-8196-528c6fe87e70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82aa323d169e4cd18abbf365aef1fd84)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:19.445738 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff5d5ff-6e30-48a8-8196-528c6fe87e70 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:19.505402 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-0ff5d5ff-6e30-48a8-8196-528c6fe87e70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82aa323d169e4cd18abbf365aef1fd84', 'request_id': 'req-0ff5d5ff-6e30-48a8-8196-528c6fe87e70'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:19.512059 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-0ff5d5ff-6e30-48a8-8196-528c6fe87e70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82aa323d169e4cd18abbf365aef1fd84', 'request_id': 'req-0ff5d5ff-6e30-48a8-8196-528c6fe87e70'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:19.518360 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-0ff5d5ff-6e30-48a8-8196-528c6fe87e70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82aa323d169e4cd18abbf365aef1fd84', 'request_id': 'req-0ff5d5ff-6e30-48a8-8196-528c6fe87e70'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:19.533956 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-0ff5d5ff-6e30-48a8-8196-528c6fe87e70 admin admin] The token cache is being invalidate because project 82aa323d169e4cd18abbf365aef1fd84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:41:19.534282 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-0ff5d5ff-6e30-48a8-8196-528c6fe87e70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:19.535473 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-0ff5d5ff-6e30-48a8-8196-528c6fe87e70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:19.540719 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1301/2578] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:41:19 2022] DELETE /identity/v3/projects/82aa323d169e4cd18abbf365aef1fd84 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:41:19.542407 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e8c54f-f405-474c-af9a-6ab3568a3cc9 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:19.542707 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e8c54f-f405-474c-af9a-6ab3568a3cc9 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:19.542986 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e8c54f-f405-474c-af9a-6ab3568a3cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:19.562983 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-15e8c54f-f405-474c-af9a-6ab3568a3cc9 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:41:19.564195 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-15e8c54f-f405-474c-af9a-6ab3568a3cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:19.637481 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1278/2579] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:41:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:41:19.645285 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793b1d96-92ee-497e-8067-b8dcb311422f None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:19.645518 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793b1d96-92ee-497e-8067-b8dcb311422f None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:19.645986 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793b1d96-92ee-497e-8067-b8dcb311422f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:19.664935 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-793b1d96-92ee-497e-8067-b8dcb311422f None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:41:19.666179 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-793b1d96-92ee-497e-8067-b8dcb311422f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:19.674769 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1302/2580] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:41:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:41:19.678969 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e8c54f-f405-474c-af9a-6ab3568a3cc9 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:19.688777 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e8c54f-f405-474c-af9a-6ab3568a3cc9 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:19.693656 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2fb33e-0945-4ea5-acee-0f70fd04aeb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:19.694316 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2fb33e-0945-4ea5-acee-0f70fd04aeb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:19.694604 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2fb33e-0945-4ea5-acee-0f70fd04aeb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:19.694881 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2fb33e-0945-4ea5-acee-0f70fd04aeb5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:19.695635 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2fb33e-0945-4ea5-acee-0f70fd04aeb5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:41:19.695944 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2fb33e-0945-4ea5-acee-0f70fd04aeb5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:19.697584 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2fb33e-0945-4ea5-acee-0f70fd04aeb5 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:19.709591 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1279/2581] 10.222.0.26 () {58 vars in 1152 bytes} [Fri Jul 1 19:41:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:41:19.713789 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793b1d96-92ee-497e-8067-b8dcb311422f None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:19.724959 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793b1d96-92ee-497e-8067-b8dcb311422f None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:19.729605 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1b4400-0950-42f6-a64d-4b1dcdff8290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:19.730459 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b4400-0950-42f6-a64d-4b1dcdff8290 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:19.730746 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b4400-0950-42f6-a64d-4b1dcdff8290 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:19.731019 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b4400-0950-42f6-a64d-4b1dcdff8290 admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:19.731763 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1b4400-0950-42f6-a64d-4b1dcdff8290 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:19.734283 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1b4400-0950-42f6-a64d-4b1dcdff8290 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:19.769451 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1303/2582] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:41:19 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:41:19.773618 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2fb33e-0945-4ea5-acee-0f70fd04aeb5 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:19.784240 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2fb33e-0945-4ea5-acee-0f70fd04aeb5 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:19.860317 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:19.883034 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64518d60-59d9-48a7-9d70-44613c01d955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:19.883720 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64518d60-59d9-48a7-9d70-44613c01d955 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:19.884008 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64518d60-59d9-48a7-9d70-44613c01d955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:19.884291 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64518d60-59d9-48a7-9d70-44613c01d955 admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:19.885022 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64518d60-59d9-48a7-9d70-44613c01d955 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:19.887111 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64518d60-59d9-48a7-9d70-44613c01d955 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:19.917877 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1280/2583] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:41:19 2022] POST /identity/v3/users => generated 287 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:41:19.920592 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1b4400-0950-42f6-a64d-4b1dcdff8290 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:19.933322 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1b4400-0950-42f6-a64d-4b1dcdff8290 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:19.939281 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bec79b-f053-4212-865f-3edd7735235b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:19.940008 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bec79b-f053-4212-865f-3edd7735235b admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:19.940300 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bec79b-f053-4212-865f-3edd7735235b admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:19.940585 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bec79b-f053-4212-865f-3edd7735235b admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:19.941354 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bec79b-f053-4212-865f-3edd7735235b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:19.943033 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bec79b-f053-4212-865f-3edd7735235b admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:19.957608 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1304/2584] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:41:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 19:41:19.959336 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64518d60-59d9-48a7-9d70-44613c01d955 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:19.975354 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64518d60-59d9-48a7-9d70-44613c01d955 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:19.981658 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c727feb-9f33-463a-914a-0bea6dca9232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:19.982347 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c727feb-9f33-463a-914a-0bea6dca9232 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:19.983291 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c727feb-9f33-463a-914a-0bea6dca9232 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:19.983661 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c727feb-9f33-463a-914a-0bea6dca9232 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:19.984561 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c727feb-9f33-463a-914a-0bea6dca9232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:19.986240 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c727feb-9f33-463a-914a-0bea6dca9232 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:19.999241 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1281/2585] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:41:19 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:41:20.003079 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bec79b-f053-4212-865f-3edd7735235b admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:20.020884 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bec79b-f053-4212-865f-3edd7735235b admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:20.025653 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06328115-d4b1-404a-8a54-69c552fa31dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:20.026546 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06328115-d4b1-404a-8a54-69c552fa31dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:20.026834 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06328115-d4b1-404a-8a54-69c552fa31dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:20.027165 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06328115-d4b1-404a-8a54-69c552fa31dc admin admin] PATH_INFO: `/v3/projects/7426498247c943aa9f188ad6eb4a301e/users/b20db383a505439daa2bc43199d8b7f6/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:20.048964 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06328115-d4b1-404a-8a54-69c552fa31dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7426498247c943aa9f188ad6eb4a301e, user_id=b20db383a505439daa2bc43199d8b7f6, role_id=4cbf6ec846eb4b7c8cc52e9bfd6f076f)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:20.052020 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06328115-d4b1-404a-8a54-69c552fa31dc admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:20.079760 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1305/2586] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:41:20 2022] PUT /identity/v3/projects/7426498247c943aa9f188ad6eb4a301e/users/b20db383a505439daa2bc43199d8b7f6/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:41:20.081146 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cae5d8a-6dd9-4d10-925e-ec3287df714d None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:20.081476 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cae5d8a-6dd9-4d10-925e-ec3287df714d None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:20.081758 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cae5d8a-6dd9-4d10-925e-ec3287df714d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:20.113771 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-5cae5d8a-6dd9-4d10-925e-ec3287df714d None None] MFA Rules not processed for user `b20db383a505439daa2bc43199d8b7f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:41:20.115812 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-5cae5d8a-6dd9-4d10-925e-ec3287df714d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:20.187468 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1282/2587] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:41:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:41:20.198281 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06328115-d4b1-404a-8a54-69c552fa31dc admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:20.200039 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-06328115-d4b1-404a-8a54-69c552fa31dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:20.207344 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:20.277100 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06328115-d4b1-404a-8a54-69c552fa31dc admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:20.283443 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b46571-46f1-42c3-8acc-c169a41d90d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13fd76fc7dd1410b9cde5adbaa6cb2e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:20.284084 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b46571-46f1-42c3-8acc-c169a41d90d7 service nova] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:20.284366 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b46571-46f1-42c3-8acc-c169a41d90d7 service nova] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:20.284643 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b46571-46f1-42c3-8acc-c169a41d90d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:20.292889 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b46571-46f1-42c3-8acc-c169a41d90d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:20.294491 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b46571-46f1-42c3-8acc-c169a41d90d7 service nova] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:20.303795 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1306/2588] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:41:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:41:20.412345 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c02eb-a1ce-427b-827b-20ebe6f150e2 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:20.412775 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c02eb-a1ce-427b-827b-20ebe6f150e2 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:20.413517 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c02eb-a1ce-427b-827b-20ebe6f150e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:20.439535 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-7a8c02eb-a1ce-427b-827b-20ebe6f150e2 None None] MFA Rules not processed for user `0834256bdfbc48ffbc5af6d6760ecdd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:41:20.440834 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-7a8c02eb-a1ce-427b-827b-20ebe6f150e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:20.525713 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1283/2589] 10.222.0.26 () {58 vars in 1009 bytes} [Fri Jul 1 19:41:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:41:20.551815 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b46571-46f1-42c3-8acc-c169a41d90d7 service nova] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:20.553775 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-b2b46571-46f1-42c3-8acc-c169a41d90d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:20.651504 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b46571-46f1-42c3-8acc-c169a41d90d7 service nova] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:20.661821 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb1c1fc-02e6-408c-b115-ff9db69e98b4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e958c5b03a9346d59c32675c5271bf3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:20.663016 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1c1fc-02e6-408c-b115-ff9db69e98b4 service swift] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:20.663679 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1c1fc-02e6-408c-b115-ff9db69e98b4 service swift] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:20.664163 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1c1fc-02e6-408c-b115-ff9db69e98b4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:20.677590 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb1c1fc-02e6-408c-b115-ff9db69e98b4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:20.680315 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb1c1fc-02e6-408c-b115-ff9db69e98b4 service swift] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:20.697295 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1307/2590] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Jul 1 19:41:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 01 19:41:23.253569 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8c02eb-a1ce-427b-827b-20ebe6f150e2 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:23.354119 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8c02eb-a1ce-427b-827b-20ebe6f150e2 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:23.362358 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882344a7-37fc-4376-a16e-d890f9e49a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:23.363648 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882344a7-37fc-4376-a16e-d890f9e49a09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:23.363939 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882344a7-37fc-4376-a16e-d890f9e49a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:23.364284 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882344a7-37fc-4376-a16e-d890f9e49a09 admin admin] PATH_INFO: `/v3/users/b20db383a505439daa2bc43199d8b7f6` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:23.366157 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882344a7-37fc-4376-a16e-d890f9e49a09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b20db383a505439daa2bc43199d8b7f6)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:23.368914 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882344a7-37fc-4376-a16e-d890f9e49a09 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:23.372641 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:23.443219 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-882344a7-37fc-4376-a16e-d890f9e49a09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b20db383a505439daa2bc43199d8b7f6'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:23.444163 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-882344a7-37fc-4376-a16e-d890f9e49a09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b20db383a505439daa2bc43199d8b7f6'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:23.452535 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-882344a7-37fc-4376-a16e-d890f9e49a09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b20db383a505439daa2bc43199d8b7f6'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:23.463049 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-882344a7-37fc-4376-a16e-d890f9e49a09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b20db383a505439daa2bc43199d8b7f6'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:23.464526 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-882344a7-37fc-4376-a16e-d890f9e49a09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b20db383a505439daa2bc43199d8b7f6'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:23.493492 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1284/2591] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:41:23 2022] DELETE /identity/v3/users/b20db383a505439daa2bc43199d8b7f6 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:41:23.495865 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ffc13-d346-4936-bd1e-8d950ea994ee None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:23.496339 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ffc13-d346-4936-bd1e-8d950ea994ee None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:23.496606 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ffc13-d346-4936-bd1e-8d950ea994ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:23.526101 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-301ffc13-d346-4936-bd1e-8d950ea994ee None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:41:23.527646 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-301ffc13-d346-4936-bd1e-8d950ea994ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:23.652356 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1308/2592] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:41:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:41:23.660649 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882344a7-37fc-4376-a16e-d890f9e49a09 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:23.662345 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-882344a7-37fc-4376-a16e-d890f9e49a09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:23.738996 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882344a7-37fc-4376-a16e-d890f9e49a09 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:23.743360 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a7622a-d9e0-4231-abcd-bde0708e6f67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:23.744122 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a7622a-d9e0-4231-abcd-bde0708e6f67 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:23.744511 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a7622a-d9e0-4231-abcd-bde0708e6f67 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:23.744973 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a7622a-d9e0-4231-abcd-bde0708e6f67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:23.755952 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a7622a-d9e0-4231-abcd-bde0708e6f67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:23.757621 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a7622a-d9e0-4231-abcd-bde0708e6f67 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:23.774385 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1285/2593] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:41:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:41:23.925489 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301ffc13-d346-4936-bd1e-8d950ea994ee None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:23.926892 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-301ffc13-d346-4936-bd1e-8d950ea994ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:23.949149 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301ffc13-d346-4936-bd1e-8d950ea994ee None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:23.955001 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ec667-4f57-4b14-980b-61d70ca34906 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:23.955709 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ec667-4f57-4b14-980b-61d70ca34906 service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:23.956239 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ec667-4f57-4b14-980b-61d70ca34906 service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:23.956622 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ec667-4f57-4b14-980b-61d70ca34906 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:23.959046 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-436ec667-4f57-4b14-980b-61d70ca34906 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:23.991164 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436ec667-4f57-4b14-980b-61d70ca34906 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:23.993911 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436ec667-4f57-4b14-980b-61d70ca34906 service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:24.006375 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1309/2594] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:41:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:41:24.381082 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a7622a-d9e0-4231-abcd-bde0708e6f67 service neutron] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:24.383990 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-99a7622a-d9e0-4231-abcd-bde0708e6f67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:24.401416 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a7622a-d9e0-4231-abcd-bde0708e6f67 service neutron] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:24.407731 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e87ca9-7112-4b23-abd5-0c0846b98c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:24.409084 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e87ca9-7112-4b23-abd5-0c0846b98c86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:24.410237 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e87ca9-7112-4b23-abd5-0c0846b98c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:24.410712 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e87ca9-7112-4b23-abd5-0c0846b98c86 admin admin] PATH_INFO: `/v3/projects/7426498247c943aa9f188ad6eb4a301e` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:24.419441 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e87ca9-7112-4b23-abd5-0c0846b98c86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7426498247c943aa9f188ad6eb4a301e)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:24.422846 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e87ca9-7112-4b23-abd5-0c0846b98c86 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:24.492350 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-e4e87ca9-7112-4b23-abd5-0c0846b98c86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7426498247c943aa9f188ad6eb4a301e', 'request_id': 'req-e4e87ca9-7112-4b23-abd5-0c0846b98c86'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:24.499360 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-e4e87ca9-7112-4b23-abd5-0c0846b98c86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7426498247c943aa9f188ad6eb4a301e', 'request_id': 'req-e4e87ca9-7112-4b23-abd5-0c0846b98c86'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:24.514623 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-e4e87ca9-7112-4b23-abd5-0c0846b98c86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7426498247c943aa9f188ad6eb4a301e', 'request_id': 'req-e4e87ca9-7112-4b23-abd5-0c0846b98c86'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:24.539800 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-e4e87ca9-7112-4b23-abd5-0c0846b98c86 admin admin] The token cache is being invalidate because project 7426498247c943aa9f188ad6eb4a301e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:41:24.540482 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-e4e87ca9-7112-4b23-abd5-0c0846b98c86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:24.542779 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-e4e87ca9-7112-4b23-abd5-0c0846b98c86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:24.548922 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1286/2595] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:41:24 2022] DELETE /identity/v3/projects/7426498247c943aa9f188ad6eb4a301e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:41:24.553447 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3bae7-3953-4d52-86e1-a732fb6a9491 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:24.553973 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3bae7-3953-4d52-86e1-a732fb6a9491 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:24.554377 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3bae7-3953-4d52-86e1-a732fb6a9491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:24.571505 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:24.590508 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-1cb3bae7-3953-4d52-86e1-a732fb6a9491 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:41:24.596841 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-1cb3bae7-3953-4d52-86e1-a732fb6a9491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:24.678271 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1310/2596] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:41:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:41:24.687408 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c3d6f-18e2-4dfe-9e53-0159177e81bb None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:24.687949 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c3d6f-18e2-4dfe-9e53-0159177e81bb None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:24.688928 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c3d6f-18e2-4dfe-9e53-0159177e81bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:24.718168 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:24.744772 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-e18c3d6f-18e2-4dfe-9e53-0159177e81bb None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:41:24.746804 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-e18c3d6f-18e2-4dfe-9e53-0159177e81bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:24.759108 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1287/2597] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:41:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:41:24.763535 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb3bae7-3953-4d52-86e1-a732fb6a9491 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:24.776385 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb3bae7-3953-4d52-86e1-a732fb6a9491 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:24.786264 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1449621-c6bf-452b-8a37-c161a8cf71e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:24.787470 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1449621-c6bf-452b-8a37-c161a8cf71e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:24.788110 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1449621-c6bf-452b-8a37-c161a8cf71e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:24.788583 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1449621-c6bf-452b-8a37-c161a8cf71e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:24.789558 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1449621-c6bf-452b-8a37-c161a8cf71e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:41:24.790073 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1449621-c6bf-452b-8a37-c161a8cf71e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:24.792419 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1449621-c6bf-452b-8a37-c161a8cf71e5 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:24.808972 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1311/2598] 10.222.0.26 () {58 vars in 1152 bytes} [Fri Jul 1 19:41:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:41:24.813781 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18c3d6f-18e2-4dfe-9e53-0159177e81bb None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:24.824462 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18c3d6f-18e2-4dfe-9e53-0159177e81bb None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:24.830847 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e528a08c-1235-486b-8049-97cae6048a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:24.831602 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e528a08c-1235-486b-8049-97cae6048a00 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:24.831957 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e528a08c-1235-486b-8049-97cae6048a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:24.832322 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e528a08c-1235-486b-8049-97cae6048a00 admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:24.833259 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e528a08c-1235-486b-8049-97cae6048a00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:24.835329 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e528a08c-1235-486b-8049-97cae6048a00 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:24.874932 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1288/2599] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:41:24 2022] POST /identity/v3/projects => generated 365 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:41:24.878632 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1449621-c6bf-452b-8a37-c161a8cf71e5 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:24.891090 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1449621-c6bf-452b-8a37-c161a8cf71e5 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:24.967099 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64b05d6-f7f5-494a-b64c-d55da40c68b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:24.967928 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b05d6-f7f5-494a-b64c-d55da40c68b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:24.968280 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b05d6-f7f5-494a-b64c-d55da40c68b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:24.968887 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b05d6-f7f5-494a-b64c-d55da40c68b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:24.969821 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64b05d6-f7f5-494a-b64c-d55da40c68b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:24.972153 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64b05d6-f7f5-494a-b64c-d55da40c68b9 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:25.002586 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1312/2600] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:41:24 2022] POST /identity/v3/users => generated 283 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:41:25.006175 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e528a08c-1235-486b-8049-97cae6048a00 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:25.018407 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e528a08c-1235-486b-8049-97cae6048a00 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:25.023740 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d103ed-7083-4499-b1a8-24a62ce4e98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:25.024536 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d103ed-7083-4499-b1a8-24a62ce4e98f admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:25.024908 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d103ed-7083-4499-b1a8-24a62ce4e98f admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:25.025295 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d103ed-7083-4499-b1a8-24a62ce4e98f admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:25.026027 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d103ed-7083-4499-b1a8-24a62ce4e98f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:25.027626 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d103ed-7083-4499-b1a8-24a62ce4e98f admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:25.043203 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1289/2601] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:41:25 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:41:25.047423 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64b05d6-f7f5-494a-b64c-d55da40c68b9 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:25.058573 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64b05d6-f7f5-494a-b64c-d55da40c68b9 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:25.064577 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06b8231-8b11-45a8-9f09-4a396cf42ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:25.065268 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b8231-8b11-45a8-9f09-4a396cf42ce9 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:25.065591 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b8231-8b11-45a8-9f09-4a396cf42ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:25.066186 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b8231-8b11-45a8-9f09-4a396cf42ce9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:25.066930 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06b8231-8b11-45a8-9f09-4a396cf42ce9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:25.068535 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06b8231-8b11-45a8-9f09-4a396cf42ce9 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:25.084653 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1313/2602] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:41:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:41:25.086282 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d103ed-7083-4499-b1a8-24a62ce4e98f admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:25.097676 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d103ed-7083-4499-b1a8-24a62ce4e98f admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:25.104874 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cab963-2f40-464d-a8e0-38dcb225ed06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:25.105949 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cab963-2f40-464d-a8e0-38dcb225ed06 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:25.106224 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cab963-2f40-464d-a8e0-38dcb225ed06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:25.106508 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cab963-2f40-464d-a8e0-38dcb225ed06 admin admin] PATH_INFO: `/v3/projects/70bd74f746d9459488a72d26ffb8c0ae/users/21fc208ab01e4cac89215b25b3009112/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:25.131633 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cab963-2f40-464d-a8e0-38dcb225ed06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70bd74f746d9459488a72d26ffb8c0ae, user_id=21fc208ab01e4cac89215b25b3009112, role_id=4cbf6ec846eb4b7c8cc52e9bfd6f076f)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:25.134391 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cab963-2f40-464d-a8e0-38dcb225ed06 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:25.161830 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1290/2603] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:41:25 2022] PUT /identity/v3/projects/70bd74f746d9459488a72d26ffb8c0ae/users/21fc208ab01e4cac89215b25b3009112/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:41:25.164383 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9600a66-405e-4370-a1f5-6b2168ac32df None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:25.164852 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9600a66-405e-4370-a1f5-6b2168ac32df None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:25.165358 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9600a66-405e-4370-a1f5-6b2168ac32df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:25.194295 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-d9600a66-405e-4370-a1f5-6b2168ac32df None None] MFA Rules not processed for user `21fc208ab01e4cac89215b25b3009112`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:41:25.195625 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-d9600a66-405e-4370-a1f5-6b2168ac32df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:25.297588 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1314/2604] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:41:25 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:41:25.304941 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cab963-2f40-464d-a8e0-38dcb225ed06 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:25.307140 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-13cab963-2f40-464d-a8e0-38dcb225ed06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:25.413161 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cab963-2f40-464d-a8e0-38dcb225ed06 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:25.417985 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05fb18d-6262-4851-829b-13136c37930c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a3ed285ee4c4d04abf7daf0aeb9fb7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:25.419160 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05fb18d-6262-4851-829b-13136c37930c service cinder] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:25.420288 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05fb18d-6262-4851-829b-13136c37930c service cinder] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:25.420822 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05fb18d-6262-4851-829b-13136c37930c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:25.435262 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05fb18d-6262-4851-829b-13136c37930c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:25.437690 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05fb18d-6262-4851-829b-13136c37930c service cinder] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:25.449058 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1291/2605] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:41:25 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:41:32.492618 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9600a66-405e-4370-a1f5-6b2168ac32df None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:32.494197 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-d9600a66-405e-4370-a1f5-6b2168ac32df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:32.501205 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:32.583109 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9600a66-405e-4370-a1f5-6b2168ac32df None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:32.588902 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed23aa2b-3f8e-4cb1-95ce-8821032a9671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:32.590156 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed23aa2b-3f8e-4cb1-95ce-8821032a9671 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:32.590470 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed23aa2b-3f8e-4cb1-95ce-8821032a9671 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:32.590847 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed23aa2b-3f8e-4cb1-95ce-8821032a9671 admin admin] PATH_INFO: `/v3/users/56cb1c16dec440388b3527abedbfc90a` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:32.592590 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed23aa2b-3f8e-4cb1-95ce-8821032a9671 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56cb1c16dec440388b3527abedbfc90a)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:32.594902 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed23aa2b-3f8e-4cb1-95ce-8821032a9671 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:32.703101 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-ed23aa2b-3f8e-4cb1-95ce-8821032a9671 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56cb1c16dec440388b3527abedbfc90a'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:32.705261 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-ed23aa2b-3f8e-4cb1-95ce-8821032a9671 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56cb1c16dec440388b3527abedbfc90a'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:32.739050 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-ed23aa2b-3f8e-4cb1-95ce-8821032a9671 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56cb1c16dec440388b3527abedbfc90a'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:32.753613 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-ed23aa2b-3f8e-4cb1-95ce-8821032a9671 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56cb1c16dec440388b3527abedbfc90a'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:32.767648 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-ed23aa2b-3f8e-4cb1-95ce-8821032a9671 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56cb1c16dec440388b3527abedbfc90a'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:32.803023 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1315/2606] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:41:32 2022] DELETE /identity/v3/users/56cb1c16dec440388b3527abedbfc90a => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:41:33.197758 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05fb18d-6262-4851-829b-13136c37930c service cinder] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:33.213606 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05fb18d-6262-4851-829b-13136c37930c service cinder] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:33.320601 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17f02c8-b07c-4345-9163-d373655d2a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:33.323623 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f02c8-b07c-4345-9163-d373655d2a53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:33.326965 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f02c8-b07c-4345-9163-d373655d2a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:33.327831 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f02c8-b07c-4345-9163-d373655d2a53 admin admin] PATH_INFO: `/v3/projects/8d3902cb9b104765933506e688bb94ec` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:33.330667 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17f02c8-b07c-4345-9163-d373655d2a53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d3902cb9b104765933506e688bb94ec)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:33.335920 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17f02c8-b07c-4345-9163-d373655d2a53 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:33.416843 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:33.423947 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-e17f02c8-b07c-4345-9163-d373655d2a53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d3902cb9b104765933506e688bb94ec', 'request_id': 'req-e17f02c8-b07c-4345-9163-d373655d2a53'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:33.431548 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-e17f02c8-b07c-4345-9163-d373655d2a53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d3902cb9b104765933506e688bb94ec', 'request_id': 'req-e17f02c8-b07c-4345-9163-d373655d2a53'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:33.439881 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-e17f02c8-b07c-4345-9163-d373655d2a53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d3902cb9b104765933506e688bb94ec', 'request_id': 'req-e17f02c8-b07c-4345-9163-d373655d2a53'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:33.454255 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-e17f02c8-b07c-4345-9163-d373655d2a53 admin admin] The token cache is being invalidate because project 8d3902cb9b104765933506e688bb94ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:41:33.454546 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-e17f02c8-b07c-4345-9163-d373655d2a53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:33.455227 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-e17f02c8-b07c-4345-9163-d373655d2a53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:33.457155 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1292/2607] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:41:33 2022] DELETE /identity/v3/projects/8d3902cb9b104765933506e688bb94ec => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:41:33.461439 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed23aa2b-3f8e-4cb1-95ce-8821032a9671 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:33.463829 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-ed23aa2b-3f8e-4cb1-95ce-8821032a9671 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:33.485266 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed23aa2b-3f8e-4cb1-95ce-8821032a9671 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:33.556775 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08349286-0383-4734-b887-916e9a798673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:33.557904 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08349286-0383-4734-b887-916e9a798673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:33.558267 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08349286-0383-4734-b887-916e9a798673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:33.558859 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08349286-0383-4734-b887-916e9a798673 admin admin] PATH_INFO: `/v3/users/ab6b3f8513874ea3b87e5a4511360eb8` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:33.560284 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08349286-0383-4734-b887-916e9a798673 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab6b3f8513874ea3b87e5a4511360eb8)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:33.562839 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08349286-0383-4734-b887-916e9a798673 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:33.596224 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:33.632637 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-08349286-0383-4734-b887-916e9a798673 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab6b3f8513874ea3b87e5a4511360eb8'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:33.633660 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-08349286-0383-4734-b887-916e9a798673 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab6b3f8513874ea3b87e5a4511360eb8'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:33.653876 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-08349286-0383-4734-b887-916e9a798673 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab6b3f8513874ea3b87e5a4511360eb8'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:33.663542 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-08349286-0383-4734-b887-916e9a798673 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab6b3f8513874ea3b87e5a4511360eb8'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:33.672348 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-08349286-0383-4734-b887-916e9a798673 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab6b3f8513874ea3b87e5a4511360eb8'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:33.679869 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1316/2608] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:41:33 2022] DELETE /identity/v3/users/ab6b3f8513874ea3b87e5a4511360eb8 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:41:33.888441 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17f02c8-b07c-4345-9163-d373655d2a53 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:33.889942 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-e17f02c8-b07c-4345-9163-d373655d2a53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:33.907045 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17f02c8-b07c-4345-9163-d373655d2a53 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:33.981782 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9b8c17-2d9e-4d18-a5fc-bffa4bd5bf36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:33.983348 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b8c17-2d9e-4d18-a5fc-bffa4bd5bf36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:33.983724 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b8c17-2d9e-4d18-a5fc-bffa4bd5bf36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:33.984079 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b8c17-2d9e-4d18-a5fc-bffa4bd5bf36 admin admin] PATH_INFO: `/v3/projects/139e19674ff14b6eb16b1ef60b9453e6` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:33.985547 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9b8c17-2d9e-4d18-a5fc-bffa4bd5bf36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=139e19674ff14b6eb16b1ef60b9453e6)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:33.987577 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9b8c17-2d9e-4d18-a5fc-bffa4bd5bf36 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:34.053486 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-fb9b8c17-2d9e-4d18-a5fc-bffa4bd5bf36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '139e19674ff14b6eb16b1ef60b9453e6', 'request_id': 'req-fb9b8c17-2d9e-4d18-a5fc-bffa4bd5bf36'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:34.060259 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-fb9b8c17-2d9e-4d18-a5fc-bffa4bd5bf36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '139e19674ff14b6eb16b1ef60b9453e6', 'request_id': 'req-fb9b8c17-2d9e-4d18-a5fc-bffa4bd5bf36'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:34.068254 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-fb9b8c17-2d9e-4d18-a5fc-bffa4bd5bf36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '139e19674ff14b6eb16b1ef60b9453e6', 'request_id': 'req-fb9b8c17-2d9e-4d18-a5fc-bffa4bd5bf36'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:34.085342 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-fb9b8c17-2d9e-4d18-a5fc-bffa4bd5bf36 admin admin] The token cache is being invalidate because project 139e19674ff14b6eb16b1ef60b9453e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:41:34.085857 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-fb9b8c17-2d9e-4d18-a5fc-bffa4bd5bf36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:34.086655 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-fb9b8c17-2d9e-4d18-a5fc-bffa4bd5bf36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:34.088717 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1293/2609] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:41:33 2022] DELETE /identity/v3/projects/139e19674ff14b6eb16b1ef60b9453e6 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:41:34.218671 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08349286-0383-4734-b887-916e9a798673 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:34.220621 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-08349286-0383-4734-b887-916e9a798673 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:34.239595 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08349286-0383-4734-b887-916e9a798673 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:34.322167 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6551a5ef-bb54-498d-b02c-2666a1c4caf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:34.324871 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6551a5ef-bb54-498d-b02c-2666a1c4caf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:34.325412 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6551a5ef-bb54-498d-b02c-2666a1c4caf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:34.325843 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6551a5ef-bb54-498d-b02c-2666a1c4caf7 admin admin] PATH_INFO: `/v3/users/21fc208ab01e4cac89215b25b3009112` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:34.328591 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6551a5ef-bb54-498d-b02c-2666a1c4caf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21fc208ab01e4cac89215b25b3009112)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:34.331434 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6551a5ef-bb54-498d-b02c-2666a1c4caf7 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:34.395911 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-6551a5ef-bb54-498d-b02c-2666a1c4caf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21fc208ab01e4cac89215b25b3009112'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:34.396624 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-6551a5ef-bb54-498d-b02c-2666a1c4caf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21fc208ab01e4cac89215b25b3009112'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:34.411322 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-6551a5ef-bb54-498d-b02c-2666a1c4caf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21fc208ab01e4cac89215b25b3009112'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:34.420231 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-6551a5ef-bb54-498d-b02c-2666a1c4caf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21fc208ab01e4cac89215b25b3009112'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:34.430817 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-6551a5ef-bb54-498d-b02c-2666a1c4caf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21fc208ab01e4cac89215b25b3009112'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:34.441389 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1317/2610] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:41:34 2022] DELETE /identity/v3/users/21fc208ab01e4cac89215b25b3009112 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:41:34.445116 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be0397-3640-40ac-83d8-46546e8dca42 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:34.446327 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be0397-3640-40ac-83d8-46546e8dca42 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:34.446608 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be0397-3640-40ac-83d8-46546e8dca42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:34.472213 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-84be0397-3640-40ac-83d8-46546e8dca42 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:41:34.474870 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-84be0397-3640-40ac-83d8-46546e8dca42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:34.557101 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1294/2611] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:41:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:41:34.571259 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6551a5ef-bb54-498d-b02c-2666a1c4caf7 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:34.572822 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-6551a5ef-bb54-498d-b02c-2666a1c4caf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:34.604802 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:34.661795 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6551a5ef-bb54-498d-b02c-2666a1c4caf7 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:34.666941 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74035e28-cc34-4083-806f-3d8c44b84426 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:34.667729 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74035e28-cc34-4083-806f-3d8c44b84426 service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:34.668078 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74035e28-cc34-4083-806f-3d8c44b84426 service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:34.668358 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74035e28-cc34-4083-806f-3d8c44b84426 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:34.679183 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74035e28-cc34-4083-806f-3d8c44b84426 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:34.680656 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74035e28-cc34-4083-806f-3d8c44b84426 service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:34.692572 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1318/2612] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:41:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:41:35.028002 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be0397-3640-40ac-83d8-46546e8dca42 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:35.030274 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-84be0397-3640-40ac-83d8-46546e8dca42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:35.041159 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:35.046937 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be0397-3640-40ac-83d8-46546e8dca42 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:35.055028 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52cc943-c59e-48b7-9766-569965758281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:35.057384 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52cc943-c59e-48b7-9766-569965758281 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:35.058239 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52cc943-c59e-48b7-9766-569965758281 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:35.059785 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52cc943-c59e-48b7-9766-569965758281 admin admin] PATH_INFO: `/v3/projects/70bd74f746d9459488a72d26ffb8c0ae` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:35.069697 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52cc943-c59e-48b7-9766-569965758281 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70bd74f746d9459488a72d26ffb8c0ae)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:35.072703 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52cc943-c59e-48b7-9766-569965758281 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:35.144570 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f52cc943-c59e-48b7-9766-569965758281 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70bd74f746d9459488a72d26ffb8c0ae', 'request_id': 'req-f52cc943-c59e-48b7-9766-569965758281'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:35.151675 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f52cc943-c59e-48b7-9766-569965758281 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70bd74f746d9459488a72d26ffb8c0ae', 'request_id': 'req-f52cc943-c59e-48b7-9766-569965758281'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:35.158517 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f52cc943-c59e-48b7-9766-569965758281 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70bd74f746d9459488a72d26ffb8c0ae', 'request_id': 'req-f52cc943-c59e-48b7-9766-569965758281'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:35.174211 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f52cc943-c59e-48b7-9766-569965758281 admin admin] The token cache is being invalidate because project 70bd74f746d9459488a72d26ffb8c0ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:41:35.174735 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f52cc943-c59e-48b7-9766-569965758281 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:35.175762 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f52cc943-c59e-48b7-9766-569965758281 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:35.177645 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1295/2613] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:41:35 2022] DELETE /identity/v3/projects/70bd74f746d9459488a72d26ffb8c0ae => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:41:35.182372 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91561f6-6c7b-4ed8-a562-020db7df0345 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:35.182670 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91561f6-6c7b-4ed8-a562-020db7df0345 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:35.182956 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91561f6-6c7b-4ed8-a562-020db7df0345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:35.202678 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-a91561f6-6c7b-4ed8-a562-020db7df0345 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:41:35.203951 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-a91561f6-6c7b-4ed8-a562-020db7df0345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:35.281126 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1319/2614] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:41:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:41:35.283297 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a5cae-a4ad-45dd-9fc2-22072dd6df37 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:35.283555 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a5cae-a4ad-45dd-9fc2-22072dd6df37 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:35.283838 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a5cae-a4ad-45dd-9fc2-22072dd6df37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:35.304664 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-5e7a5cae-a4ad-45dd-9fc2-22072dd6df37 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:41:35.306617 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-5e7a5cae-a4ad-45dd-9fc2-22072dd6df37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:35.322064 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1296/2615] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:41:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:41:35.323596 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91561f6-6c7b-4ed8-a562-020db7df0345 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:35.335501 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91561f6-6c7b-4ed8-a562-020db7df0345 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:35.340504 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1dd25c-2b3a-4c4d-b286-5f9aa5ab2b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:35.341169 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1dd25c-2b3a-4c4d-b286-5f9aa5ab2b86 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:35.342055 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1dd25c-2b3a-4c4d-b286-5f9aa5ab2b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:35.342341 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1dd25c-2b3a-4c4d-b286-5f9aa5ab2b86 admin admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:35.343067 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1dd25c-2b3a-4c4d-b286-5f9aa5ab2b86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:41:35.343378 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1dd25c-2b3a-4c4d-b286-5f9aa5ab2b86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:35.345168 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1dd25c-2b3a-4c4d-b286-5f9aa5ab2b86 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:35.365633 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1320/2616] 10.222.0.26 () {58 vars in 1152 bytes} [Fri Jul 1 19:41:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:41:35.366943 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a5cae-a4ad-45dd-9fc2-22072dd6df37 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:35.382706 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a5cae-a4ad-45dd-9fc2-22072dd6df37 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:35.389948 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6edfff-eb13-40af-84c5-0a18c6756c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:35.390867 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6edfff-eb13-40af-84c5-0a18c6756c95 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:35.391331 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6edfff-eb13-40af-84c5-0a18c6756c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:35.391689 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6edfff-eb13-40af-84c5-0a18c6756c95 admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:35.392614 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6edfff-eb13-40af-84c5-0a18c6756c95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:35.395362 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6edfff-eb13-40af-84c5-0a18c6756c95 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:35.434172 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1297/2617] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:41:35 2022] POST /identity/v3/projects => generated 405 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:41:35.439209 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1dd25c-2b3a-4c4d-b286-5f9aa5ab2b86 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:35.449963 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1dd25c-2b3a-4c4d-b286-5f9aa5ab2b86 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:35.517996 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b5c5a0-f7ee-485e-8f7b-cab45c8c7d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:35.518981 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b5c5a0-f7ee-485e-8f7b-cab45c8c7d01 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:35.519337 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b5c5a0-f7ee-485e-8f7b-cab45c8c7d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:35.519687 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b5c5a0-f7ee-485e-8f7b-cab45c8c7d01 admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:35.520463 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b5c5a0-f7ee-485e-8f7b-cab45c8c7d01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:35.522496 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b5c5a0-f7ee-485e-8f7b-cab45c8c7d01 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:35.553341 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1321/2618] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:41:35 2022] POST /identity/v3/users => generated 303 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:41:35.557407 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6edfff-eb13-40af-84c5-0a18c6756c95 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:35.571728 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6edfff-eb13-40af-84c5-0a18c6756c95 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:35.577526 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468d9371-4a85-40d6-bcee-0c98ca42b899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:35.578395 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d9371-4a85-40d6-bcee-0c98ca42b899 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:35.578756 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d9371-4a85-40d6-bcee-0c98ca42b899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:35.579122 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d9371-4a85-40d6-bcee-0c98ca42b899 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:35.580172 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468d9371-4a85-40d6-bcee-0c98ca42b899 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:35.581896 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468d9371-4a85-40d6-bcee-0c98ca42b899 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:35.596724 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1298/2619] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:41:35 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 19:41:35.603167 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b5c5a0-f7ee-485e-8f7b-cab45c8c7d01 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:35.619562 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b5c5a0-f7ee-485e-8f7b-cab45c8c7d01 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:35.625042 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa55782f-d3ff-4279-a728-65140f206d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:35.625853 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa55782f-d3ff-4279-a728-65140f206d73 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:35.626210 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa55782f-d3ff-4279-a728-65140f206d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:35.626564 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa55782f-d3ff-4279-a728-65140f206d73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:35.627568 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa55782f-d3ff-4279-a728-65140f206d73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:35.629719 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa55782f-d3ff-4279-a728-65140f206d73 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:35.644405 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1322/2620] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:41:35 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:41:35.649582 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468d9371-4a85-40d6-bcee-0c98ca42b899 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:35.667595 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468d9371-4a85-40d6-bcee-0c98ca42b899 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:35.673349 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad378d50-eb82-4c32-954e-43047c36b933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:35.674243 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad378d50-eb82-4c32-954e-43047c36b933 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:35.674529 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad378d50-eb82-4c32-954e-43047c36b933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:35.674813 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad378d50-eb82-4c32-954e-43047c36b933 admin admin] PATH_INFO: `/v3/projects/8fbbd38b0a0748819a81d736ce33673f/users/1edca10589b84ecbb69f300006a48d99/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:35.691734 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad378d50-eb82-4c32-954e-43047c36b933 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fbbd38b0a0748819a81d736ce33673f, user_id=1edca10589b84ecbb69f300006a48d99, role_id=4cbf6ec846eb4b7c8cc52e9bfd6f076f)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:35.694766 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad378d50-eb82-4c32-954e-43047c36b933 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:35.708719 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1299/2621] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:41:35 2022] PUT /identity/v3/projects/8fbbd38b0a0748819a81d736ce33673f/users/1edca10589b84ecbb69f300006a48d99/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:41:35.723027 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cead0d-4884-458a-b890-81c17e6d3949 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:35.723327 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cead0d-4884-458a-b890-81c17e6d3949 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:35.723663 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cead0d-4884-458a-b890-81c17e6d3949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:35.756199 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-f1cead0d-4884-458a-b890-81c17e6d3949 None None] MFA Rules not processed for user `1edca10589b84ecbb69f300006a48d99`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:41:35.757516 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-f1cead0d-4884-458a-b890-81c17e6d3949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:35.777679 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:35.837523 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1323/2622] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:41:35 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:41:35.843013 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad378d50-eb82-4c32-954e-43047c36b933 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:35.918437 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad378d50-eb82-4c32-954e-43047c36b933 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:35.926151 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbb82be-a728-4178-8b93-cdb35bb816e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:35.926959 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb82be-a728-4178-8b93-cdb35bb816e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:35.927444 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb82be-a728-4178-8b93-cdb35bb816e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:35.927764 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb82be-a728-4178-8b93-cdb35bb816e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:35.928710 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbb82be-a728-4178-8b93-cdb35bb816e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:35.931309 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbb82be-a728-4178-8b93-cdb35bb816e6 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:35.968289 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1300/2623] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:41:35 2022] POST /identity/v3/projects => generated 403 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:41:35.969674 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cead0d-4884-458a-b890-81c17e6d3949 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:35.981763 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cead0d-4884-458a-b890-81c17e6d3949 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:36.048069 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c896e6c-1692-4f7a-8be3-1055242b8f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:36.048944 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c896e6c-1692-4f7a-8be3-1055242b8f1c admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:36.049367 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c896e6c-1692-4f7a-8be3-1055242b8f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:36.049752 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c896e6c-1692-4f7a-8be3-1055242b8f1c admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:36.050555 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c896e6c-1692-4f7a-8be3-1055242b8f1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:36.052583 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c896e6c-1692-4f7a-8be3-1055242b8f1c admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:36.094699 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1324/2624] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:41:35 2022] POST /identity/v3/users => generated 308 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:41:36.095940 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbb82be-a728-4178-8b93-cdb35bb816e6 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:36.109130 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbb82be-a728-4178-8b93-cdb35bb816e6 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:36.114109 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78572d99-a5cc-41be-bf27-6da502575d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:36.114786 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78572d99-a5cc-41be-bf27-6da502575d71 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:36.115070 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78572d99-a5cc-41be-bf27-6da502575d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:36.115349 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78572d99-a5cc-41be-bf27-6da502575d71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:36.116072 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78572d99-a5cc-41be-bf27-6da502575d71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:36.117746 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78572d99-a5cc-41be-bf27-6da502575d71 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:36.122202 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:36.140903 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1301/2625] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:41:36 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:41:36.142281 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c896e6c-1692-4f7a-8be3-1055242b8f1c admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:36.164103 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c896e6c-1692-4f7a-8be3-1055242b8f1c admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:36.173699 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0ce4b0-b115-49d5-8c1e-ef92e9a322e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:36.175138 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ce4b0-b115-49d5-8c1e-ef92e9a322e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:36.175390 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ce4b0-b115-49d5-8c1e-ef92e9a322e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:36.175799 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ce4b0-b115-49d5-8c1e-ef92e9a322e2 admin admin] PATH_INFO: `/v3/projects/f1a0e43852e54a5fa11bacbf4950906e/users/da1214aaac8d46018a7fd3b46d933bfc/roles/6cb03785fb184ef587509b3174622f69` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:36.195775 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0ce4b0-b115-49d5-8c1e-ef92e9a322e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1a0e43852e54a5fa11bacbf4950906e, user_id=da1214aaac8d46018a7fd3b46d933bfc, role_id=6cb03785fb184ef587509b3174622f69)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:36.199164 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0ce4b0-b115-49d5-8c1e-ef92e9a322e2 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:36.215437 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1325/2626] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:41:36 2022] PUT /identity/v3/projects/f1a0e43852e54a5fa11bacbf4950906e/users/da1214aaac8d46018a7fd3b46d933bfc/roles/6cb03785fb184ef587509b3174622f69 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 19:41:36.220914 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78572d99-a5cc-41be-bf27-6da502575d71 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:36.236065 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78572d99-a5cc-41be-bf27-6da502575d71 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:36.327975 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad7e65e-0fdd-4060-bc85-b226f74d8710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:36.329051 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad7e65e-0fdd-4060-bc85-b226f74d8710 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:36.329533 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad7e65e-0fdd-4060-bc85-b226f74d8710 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:36.329971 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad7e65e-0fdd-4060-bc85-b226f74d8710 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:36.331046 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad7e65e-0fdd-4060-bc85-b226f74d8710 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:36.333427 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad7e65e-0fdd-4060-bc85-b226f74d8710 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:36.349180 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1302/2627] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:41:36 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:41:36.350256 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0ce4b0-b115-49d5-8c1e-ef92e9a322e2 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:36.363424 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0ce4b0-b115-49d5-8c1e-ef92e9a322e2 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:36.370103 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c8aa2a-d3a0-43e4-a20e-27492255d967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:36.371232 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8aa2a-d3a0-43e4-a20e-27492255d967 admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:36.371648 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8aa2a-d3a0-43e4-a20e-27492255d967 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:36.371929 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8aa2a-d3a0-43e4-a20e-27492255d967 admin admin] PATH_INFO: `/v3/projects/f1a0e43852e54a5fa11bacbf4950906e/users/da1214aaac8d46018a7fd3b46d933bfc/roles/6cb03785fb184ef587509b3174622f69` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:36.374687 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c8aa2a-d3a0-43e4-a20e-27492255d967 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1a0e43852e54a5fa11bacbf4950906e, user_id=da1214aaac8d46018a7fd3b46d933bfc, role_id=6cb03785fb184ef587509b3174622f69)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:36.378490 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c8aa2a-d3a0-43e4-a20e-27492255d967 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:36.392336 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1326/2628] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:41:36 2022] PUT /identity/v3/projects/f1a0e43852e54a5fa11bacbf4950906e/users/da1214aaac8d46018a7fd3b46d933bfc/roles/6cb03785fb184ef587509b3174622f69 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 19:41:36.406650 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63964bf9-dddd-4f9c-9a24-f5988e0305c9 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:36.407064 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63964bf9-dddd-4f9c-9a24-f5988e0305c9 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:36.407406 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63964bf9-dddd-4f9c-9a24-f5988e0305c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:36.437092 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-63964bf9-dddd-4f9c-9a24-f5988e0305c9 None None] MFA Rules not processed for user `da1214aaac8d46018a7fd3b46d933bfc`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:41:36.438548 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-63964bf9-dddd-4f9c-9a24-f5988e0305c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:36.530153 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1303/2629] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:41:36 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:41:36.538329 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c8aa2a-d3a0-43e4-a20e-27492255d967 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:36.540348 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-10c8aa2a-d3a0-43e4-a20e-27492255d967 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:36.621515 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c8aa2a-d3a0-43e4-a20e-27492255d967 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:36.626435 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1ef01e-7875-49bf-a0ef-b9fd41727cd3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a3ed285ee4c4d04abf7daf0aeb9fb7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:36.627274 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ef01e-7875-49bf-a0ef-b9fd41727cd3 service cinder] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:36.627614 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ef01e-7875-49bf-a0ef-b9fd41727cd3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:36.627958 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ef01e-7875-49bf-a0ef-b9fd41727cd3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:36.644106 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1ef01e-7875-49bf-a0ef-b9fd41727cd3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:36.646540 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1ef01e-7875-49bf-a0ef-b9fd41727cd3 service cinder] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:36.657268 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1327/2630] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:41:36 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:41:36.698758 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63964bf9-dddd-4f9c-9a24-f5988e0305c9 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:36.771801 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63964bf9-dddd-4f9c-9a24-f5988e0305c9 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:36.777224 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4542b58-497c-40d5-bf49-a025bc5009ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:36.778123 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4542b58-497c-40d5-bf49-a025bc5009ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:36.778463 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4542b58-497c-40d5-bf49-a025bc5009ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:36.778751 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4542b58-497c-40d5-bf49-a025bc5009ce admin admin] PATH_INFO: `/v3/users/1edca10589b84ecbb69f300006a48d99` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:36.781032 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4542b58-497c-40d5-bf49-a025bc5009ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=1edca10589b84ecbb69f300006a48d99)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:36.783036 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4542b58-497c-40d5-bf49-a025bc5009ce admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:36.810015 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:36.840200 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f4542b58-497c-40d5-bf49-a025bc5009ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1edca10589b84ecbb69f300006a48d99'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:36.840989 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f4542b58-497c-40d5-bf49-a025bc5009ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1edca10589b84ecbb69f300006a48d99'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:36.848264 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f4542b58-497c-40d5-bf49-a025bc5009ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1edca10589b84ecbb69f300006a48d99'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:36.857514 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f4542b58-497c-40d5-bf49-a025bc5009ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1edca10589b84ecbb69f300006a48d99'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:36.858333 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f4542b58-497c-40d5-bf49-a025bc5009ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1edca10589b84ecbb69f300006a48d99'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:36.879633 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1304/2631] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:41:36 2022] DELETE /identity/v3/users/1edca10589b84ecbb69f300006a48d99 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:41:36.884400 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b46775-e4cb-41ae-b0e6-7a81d5a48aec None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:36.884827 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b46775-e4cb-41ae-b0e6-7a81d5a48aec None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:36.885150 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b46775-e4cb-41ae-b0e6-7a81d5a48aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:36.906553 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-18b46775-e4cb-41ae-b0e6-7a81d5a48aec None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:41:36.907980 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-18b46775-e4cb-41ae-b0e6-7a81d5a48aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:36.918117 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:36.985511 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1328/2632] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:41:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:41:36.992518 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4542b58-497c-40d5-bf49-a025bc5009ce admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:36.994201 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-f4542b58-497c-40d5-bf49-a025bc5009ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:37.061818 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4542b58-497c-40d5-bf49-a025bc5009ce admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:37.066031 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c8b24e-a0c8-4e54-ae3e-1a599f0503ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:37.066962 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c8b24e-a0c8-4e54-ae3e-1a599f0503ea service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:37.067187 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c8b24e-a0c8-4e54-ae3e-1a599f0503ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:37.067504 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c8b24e-a0c8-4e54-ae3e-1a599f0503ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:37.077910 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c8b24e-a0c8-4e54-ae3e-1a599f0503ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:37.079358 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c8b24e-a0c8-4e54-ae3e-1a599f0503ea service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:37.089818 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1305/2633] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:41:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:41:37.412023 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b46775-e4cb-41ae-b0e6-7a81d5a48aec None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:37.413887 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-18b46775-e4cb-41ae-b0e6-7a81d5a48aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:37.427201 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b46775-e4cb-41ae-b0e6-7a81d5a48aec None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:37.447274 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5ba4f5-c207-4fad-ae70-0f1c197fdb42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:37.447274 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ba4f5-c207-4fad-ae70-0f1c197fdb42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:37.447274 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ba4f5-c207-4fad-ae70-0f1c197fdb42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:37.447274 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ba4f5-c207-4fad-ae70-0f1c197fdb42 admin admin] PATH_INFO: `/v3/projects/8fbbd38b0a0748819a81d736ce33673f` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:37.452502 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5ba4f5-c207-4fad-ae70-0f1c197fdb42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fbbd38b0a0748819a81d736ce33673f)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:37.452502 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5ba4f5-c207-4fad-ae70-0f1c197fdb42 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:37.500755 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-fb5ba4f5-c207-4fad-ae70-0f1c197fdb42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fbbd38b0a0748819a81d736ce33673f', 'request_id': 'req-fb5ba4f5-c207-4fad-ae70-0f1c197fdb42'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:37.507167 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-fb5ba4f5-c207-4fad-ae70-0f1c197fdb42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fbbd38b0a0748819a81d736ce33673f', 'request_id': 'req-fb5ba4f5-c207-4fad-ae70-0f1c197fdb42'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:37.512850 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-fb5ba4f5-c207-4fad-ae70-0f1c197fdb42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fbbd38b0a0748819a81d736ce33673f', 'request_id': 'req-fb5ba4f5-c207-4fad-ae70-0f1c197fdb42'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:37.535668 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-fb5ba4f5-c207-4fad-ae70-0f1c197fdb42 admin admin] The token cache is being invalidate because project 8fbbd38b0a0748819a81d736ce33673f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:41:37.536020 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-fb5ba4f5-c207-4fad-ae70-0f1c197fdb42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:37.536641 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-fb5ba4f5-c207-4fad-ae70-0f1c197fdb42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:37.538588 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1329/2634] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:41:37 2022] DELETE /identity/v3/projects/8fbbd38b0a0748819a81d736ce33673f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:41:37.542829 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c8b24e-a0c8-4e54-ae3e-1a599f0503ea service neutron] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:37.555873 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c8b24e-a0c8-4e54-ae3e-1a599f0503ea service neutron] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:37.631701 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f71b2f-b5a5-4b3b-b190-6d0798c03f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:37.632952 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f71b2f-b5a5-4b3b-b190-6d0798c03f18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:37.633399 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f71b2f-b5a5-4b3b-b190-6d0798c03f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:37.633909 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f71b2f-b5a5-4b3b-b190-6d0798c03f18 admin admin] PATH_INFO: `/v3/users/da1214aaac8d46018a7fd3b46d933bfc` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:37.635482 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f71b2f-b5a5-4b3b-b190-6d0798c03f18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da1214aaac8d46018a7fd3b46d933bfc)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:37.638409 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f71b2f-b5a5-4b3b-b190-6d0798c03f18 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:37.700123 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:37.703840 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-01f71b2f-b5a5-4b3b-b190-6d0798c03f18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da1214aaac8d46018a7fd3b46d933bfc'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:37.705273 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-01f71b2f-b5a5-4b3b-b190-6d0798c03f18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da1214aaac8d46018a7fd3b46d933bfc'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:37.715715 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-01f71b2f-b5a5-4b3b-b190-6d0798c03f18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da1214aaac8d46018a7fd3b46d933bfc'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:37.726083 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-01f71b2f-b5a5-4b3b-b190-6d0798c03f18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da1214aaac8d46018a7fd3b46d933bfc'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:37.726717 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-01f71b2f-b5a5-4b3b-b190-6d0798c03f18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da1214aaac8d46018a7fd3b46d933bfc'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:37.749080 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1306/2635] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:41:37 2022] DELETE /identity/v3/users/da1214aaac8d46018a7fd3b46d933bfc => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:41:38.078868 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5ba4f5-c207-4fad-ae70-0f1c197fdb42 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:38.080990 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-fb5ba4f5-c207-4fad-ae70-0f1c197fdb42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:38.112313 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5ba4f5-c207-4fad-ae70-0f1c197fdb42 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:38.191410 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d86596-e07d-47d3-912c-76a88e751188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:38.192267 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d86596-e07d-47d3-912c-76a88e751188 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:38.192552 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d86596-e07d-47d3-912c-76a88e751188 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:38.192827 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d86596-e07d-47d3-912c-76a88e751188 admin admin] PATH_INFO: `/v3/projects/f1a0e43852e54a5fa11bacbf4950906e` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:38.194053 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d86596-e07d-47d3-912c-76a88e751188 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1a0e43852e54a5fa11bacbf4950906e)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:38.195930 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d86596-e07d-47d3-912c-76a88e751188 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:38.243101 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:38.251800 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-49d86596-e07d-47d3-912c-76a88e751188 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1a0e43852e54a5fa11bacbf4950906e', 'request_id': 'req-49d86596-e07d-47d3-912c-76a88e751188'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:38.259223 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-49d86596-e07d-47d3-912c-76a88e751188 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1a0e43852e54a5fa11bacbf4950906e', 'request_id': 'req-49d86596-e07d-47d3-912c-76a88e751188'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:38.265091 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-49d86596-e07d-47d3-912c-76a88e751188 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1a0e43852e54a5fa11bacbf4950906e', 'request_id': 'req-49d86596-e07d-47d3-912c-76a88e751188'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:38.279070 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-49d86596-e07d-47d3-912c-76a88e751188 admin admin] The token cache is being invalidate because project f1a0e43852e54a5fa11bacbf4950906e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:41:38.279480 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-49d86596-e07d-47d3-912c-76a88e751188 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:38.280247 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-49d86596-e07d-47d3-912c-76a88e751188 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:38.281842 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1330/2636] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:41:38 2022] DELETE /identity/v3/projects/f1a0e43852e54a5fa11bacbf4950906e => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:41:38.289445 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ead3d-5165-4ad9-8c63-b9a009b0c19f None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:38.289749 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ead3d-5165-4ad9-8c63-b9a009b0c19f None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:38.290026 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ead3d-5165-4ad9-8c63-b9a009b0c19f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:38.307733 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-802ead3d-5165-4ad9-8c63-b9a009b0c19f None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:41:38.308908 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-802ead3d-5165-4ad9-8c63-b9a009b0c19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:38.366442 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1307/2637] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:41:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:41:38.374647 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ccfbc9-b9bc-4f74-9ae8-8baa628695b8 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:38.374937 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ccfbc9-b9bc-4f74-9ae8-8baa628695b8 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:38.375216 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ccfbc9-b9bc-4f74-9ae8-8baa628695b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:38.393907 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-18ccfbc9-b9bc-4f74-9ae8-8baa628695b8 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:41:38.395112 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-18ccfbc9-b9bc-4f74-9ae8-8baa628695b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:38.403115 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1331/2638] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:41:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:41:38.407841 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802ead3d-5165-4ad9-8c63-b9a009b0c19f None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:38.417688 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802ead3d-5165-4ad9-8c63-b9a009b0c19f None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:38.422915 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801735fe-3d2b-4a33-b05d-00f319b37eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:38.423556 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801735fe-3d2b-4a33-b05d-00f319b37eaa admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:38.423836 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801735fe-3d2b-4a33-b05d-00f319b37eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:38.424109 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801735fe-3d2b-4a33-b05d-00f319b37eaa admin admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:38.424828 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801735fe-3d2b-4a33-b05d-00f319b37eaa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:41:38.425135 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801735fe-3d2b-4a33-b05d-00f319b37eaa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:38.426747 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801735fe-3d2b-4a33-b05d-00f319b37eaa admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:38.437956 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1308/2639] 10.222.0.26 () {58 vars in 1152 bytes} [Fri Jul 1 19:41:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:41:38.442306 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ccfbc9-b9bc-4f74-9ae8-8baa628695b8 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:38.451360 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ccfbc9-b9bc-4f74-9ae8-8baa628695b8 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:38.456036 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2631859-d969-4ce1-a0ea-b6c8343cc01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:38.456677 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2631859-d969-4ce1-a0ea-b6c8343cc01d admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:38.456964 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2631859-d969-4ce1-a0ea-b6c8343cc01d admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:38.457261 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2631859-d969-4ce1-a0ea-b6c8343cc01d admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:38.458036 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2631859-d969-4ce1-a0ea-b6c8343cc01d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:38.459834 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2631859-d969-4ce1-a0ea-b6c8343cc01d admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:38.486051 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1332/2640] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:41:38 2022] POST /identity/v3/projects => generated 365 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 19:41:38.490176 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801735fe-3d2b-4a33-b05d-00f319b37eaa admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:38.500380 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801735fe-3d2b-4a33-b05d-00f319b37eaa admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:38.556054 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec47d402-6782-40e4-89c9-20acc7179cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:38.556643 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec47d402-6782-40e4-89c9-20acc7179cc2 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:38.556928 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec47d402-6782-40e4-89c9-20acc7179cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:38.557206 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec47d402-6782-40e4-89c9-20acc7179cc2 admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:38.557931 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec47d402-6782-40e4-89c9-20acc7179cc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:38.559893 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec47d402-6782-40e4-89c9-20acc7179cc2 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:38.580320 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1309/2641] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:41:38 2022] POST /identity/v3/users => generated 283 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:41:38.584477 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2631859-d969-4ce1-a0ea-b6c8343cc01d admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:38.595142 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2631859-d969-4ce1-a0ea-b6c8343cc01d admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:38.600367 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc223d7-edb5-47a2-8669-d4cdec96cf5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:38.601024 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc223d7-edb5-47a2-8669-d4cdec96cf5e admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:38.601350 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc223d7-edb5-47a2-8669-d4cdec96cf5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:38.601632 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc223d7-edb5-47a2-8669-d4cdec96cf5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:38.602361 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc223d7-edb5-47a2-8669-d4cdec96cf5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:38.603957 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc223d7-edb5-47a2-8669-d4cdec96cf5e admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:38.615123 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1333/2642] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:41:38.619068 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec47d402-6782-40e4-89c9-20acc7179cc2 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:38.629095 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec47d402-6782-40e4-89c9-20acc7179cc2 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:38.633720 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb99462-acca-4765-8962-fde3eec7b09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:38.634407 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb99462-acca-4765-8962-fde3eec7b09e admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:38.634689 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb99462-acca-4765-8962-fde3eec7b09e admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:38.634962 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb99462-acca-4765-8962-fde3eec7b09e admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:38.635684 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb99462-acca-4765-8962-fde3eec7b09e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:38.637300 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb99462-acca-4765-8962-fde3eec7b09e admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:38.647432 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1310/2643] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:41:38.651515 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc223d7-edb5-47a2-8669-d4cdec96cf5e admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:38.662363 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc223d7-edb5-47a2-8669-d4cdec96cf5e admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:38.668131 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d9a8c1-dabb-4ff2-99f0-26f2f83b790b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:38.669086 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d9a8c1-dabb-4ff2-99f0-26f2f83b790b admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:38.669948 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d9a8c1-dabb-4ff2-99f0-26f2f83b790b admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:38.670236 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d9a8c1-dabb-4ff2-99f0-26f2f83b790b admin admin] PATH_INFO: `/v3/projects/3c4005a0bf6847029a364fabb1fa9021/users/54fa0fd3002d4537bfe15410ffd850d6/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:38.685846 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d9a8c1-dabb-4ff2-99f0-26f2f83b790b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c4005a0bf6847029a364fabb1fa9021, user_id=54fa0fd3002d4537bfe15410ffd850d6, role_id=4cbf6ec846eb4b7c8cc52e9bfd6f076f)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:38.688483 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d9a8c1-dabb-4ff2-99f0-26f2f83b790b admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:38.701420 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1334/2644] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:41:38 2022] PUT /identity/v3/projects/3c4005a0bf6847029a364fabb1fa9021/users/54fa0fd3002d4537bfe15410ffd850d6/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:41:38.712527 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20796566-4e7b-42f3-a2dc-ff3434d80c46 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:38.713042 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20796566-4e7b-42f3-a2dc-ff3434d80c46 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:38.713153 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20796566-4e7b-42f3-a2dc-ff3434d80c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:38.740452 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-20796566-4e7b-42f3-a2dc-ff3434d80c46 None None] MFA Rules not processed for user `54fa0fd3002d4537bfe15410ffd850d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:41:38.741950 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-20796566-4e7b-42f3-a2dc-ff3434d80c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:38.755404 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:38.809475 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1311/2645] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:41:38 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:41:38.813862 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d9a8c1-dabb-4ff2-99f0-26f2f83b790b admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:38.874720 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d9a8c1-dabb-4ff2-99f0-26f2f83b790b admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:38.879319 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c6541-e8bd-44b2-ad73-d404f3d6bc5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:38.879970 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c6541-e8bd-44b2-ad73-d404f3d6bc5e admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:38.880254 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c6541-e8bd-44b2-ad73-d404f3d6bc5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:38.880534 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c6541-e8bd-44b2-ad73-d404f3d6bc5e admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:38.881219 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c6541-e8bd-44b2-ad73-d404f3d6bc5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:38.883136 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c6541-e8bd-44b2-ad73-d404f3d6bc5e admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:38.908274 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1335/2646] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:41:38 2022] POST /identity/v3/projects => generated 365 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:41:38.912578 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20796566-4e7b-42f3-a2dc-ff3434d80c46 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:38.923297 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20796566-4e7b-42f3-a2dc-ff3434d80c46 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:38.979561 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e918a-92ca-4868-89ea-73650d9d0db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:38.980234 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e918a-92ca-4868-89ea-73650d9d0db2 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:38.980519 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e918a-92ca-4868-89ea-73650d9d0db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:38.980795 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e918a-92ca-4868-89ea-73650d9d0db2 admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:38.981538 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2e918a-92ca-4868-89ea-73650d9d0db2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:38.983463 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2e918a-92ca-4868-89ea-73650d9d0db2 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:39.003637 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1312/2647] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:41:38 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:41:39.007480 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c6541-e8bd-44b2-ad73-d404f3d6bc5e admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:39.018245 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c6541-e8bd-44b2-ad73-d404f3d6bc5e admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:39.022737 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acb1354-f905-45d4-91f4-e1c59fe60f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:39.023381 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb1354-f905-45d4-91f4-e1c59fe60f88 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:39.023680 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb1354-f905-45d4-91f4-e1c59fe60f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:39.023939 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb1354-f905-45d4-91f4-e1c59fe60f88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:39.024653 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acb1354-f905-45d4-91f4-e1c59fe60f88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:39.026263 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acb1354-f905-45d4-91f4-e1c59fe60f88 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:39.037652 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1336/2648] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:41:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:41:39.041662 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e918a-92ca-4868-89ea-73650d9d0db2 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:39.053035 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e918a-92ca-4868-89ea-73650d9d0db2 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:39.057693 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3de802-cb96-49c0-9f35-401b4e92374b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:39.058558 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3de802-cb96-49c0-9f35-401b4e92374b admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:39.058847 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3de802-cb96-49c0-9f35-401b4e92374b admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:39.059129 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3de802-cb96-49c0-9f35-401b4e92374b admin admin] PATH_INFO: `/v3/projects/cc35dc259a0a407f945d080f4c4b9e66/users/469bc5a455174014bc5b4a55676f03ea/roles/6cb03785fb184ef587509b3174622f69` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:39.073531 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3de802-cb96-49c0-9f35-401b4e92374b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc35dc259a0a407f945d080f4c4b9e66, user_id=469bc5a455174014bc5b4a55676f03ea, role_id=6cb03785fb184ef587509b3174622f69)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:39.076670 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3de802-cb96-49c0-9f35-401b4e92374b admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:39.089926 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1313/2649] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:41:39 2022] PUT /identity/v3/projects/cc35dc259a0a407f945d080f4c4b9e66/users/469bc5a455174014bc5b4a55676f03ea/roles/6cb03785fb184ef587509b3174622f69 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:41:39.094691 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acb1354-f905-45d4-91f4-e1c59fe60f88 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:39.104499 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acb1354-f905-45d4-91f4-e1c59fe60f88 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:39.138527 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:39.167757 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8e5db3-b997-4f16-a648-9a5b964f57d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:39.168092 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8e5db3-b997-4f16-a648-9a5b964f57d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:39.168383 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8e5db3-b997-4f16-a648-9a5b964f57d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:39.168665 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8e5db3-b997-4f16-a648-9a5b964f57d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:39.170238 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8e5db3-b997-4f16-a648-9a5b964f57d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:39.172057 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8e5db3-b997-4f16-a648-9a5b964f57d7 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:39.182949 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1337/2650] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:41:39 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:41:39.187326 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3de802-cb96-49c0-9f35-401b4e92374b admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:39.197811 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3de802-cb96-49c0-9f35-401b4e92374b admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:39.202623 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b079b9b-9c8f-4c5a-aa04-247402bfb9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:39.203500 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b079b9b-9c8f-4c5a-aa04-247402bfb9df admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:39.203787 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b079b9b-9c8f-4c5a-aa04-247402bfb9df admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:39.204065 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b079b9b-9c8f-4c5a-aa04-247402bfb9df admin admin] PATH_INFO: `/v3/projects/cc35dc259a0a407f945d080f4c4b9e66/users/469bc5a455174014bc5b4a55676f03ea/roles/6cb03785fb184ef587509b3174622f69` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:39.206297 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b079b9b-9c8f-4c5a-aa04-247402bfb9df admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc35dc259a0a407f945d080f4c4b9e66, user_id=469bc5a455174014bc5b4a55676f03ea, role_id=6cb03785fb184ef587509b3174622f69)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:39.208959 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b079b9b-9c8f-4c5a-aa04-247402bfb9df admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:39.220239 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1314/2651] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:41:39 2022] PUT /identity/v3/projects/cc35dc259a0a407f945d080f4c4b9e66/users/469bc5a455174014bc5b4a55676f03ea/roles/6cb03785fb184ef587509b3174622f69 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:41:39.230267 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f911f3-eb02-403b-9976-cfe000ae92d7 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:39.230560 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f911f3-eb02-403b-9976-cfe000ae92d7 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:39.230838 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f911f3-eb02-403b-9976-cfe000ae92d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:39.260229 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-d8f911f3-eb02-403b-9976-cfe000ae92d7 None None] MFA Rules not processed for user `469bc5a455174014bc5b4a55676f03ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:41:39.261471 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-d8f911f3-eb02-403b-9976-cfe000ae92d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:39.263742 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13361221-634f-41b5-b97e-1f67db05f20c None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:39.264118 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13361221-634f-41b5-b97e-1f67db05f20c None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:39.264474 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13361221-634f-41b5-b97e-1f67db05f20c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:39.283424 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-13361221-634f-41b5-b97e-1f67db05f20c None None] MFA Rules not processed for user `0834256bdfbc48ffbc5af6d6760ecdd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:41:39.284867 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-13361221-634f-41b5-b97e-1f67db05f20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:39.343131 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1315/2652] 10.222.0.26 () {58 vars in 967 bytes} [Fri Jul 1 19:41:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:41:39.343442 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1338/2653] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:41:39 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:41:39.354812 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13361221-634f-41b5-b97e-1f67db05f20c None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:39.355602 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f911f3-eb02-403b-9976-cfe000ae92d7 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:39.356349 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-13361221-634f-41b5-b97e-1f67db05f20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:39.357560 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-d8f911f3-eb02-403b-9976-cfe000ae92d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:39.371033 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:39.416457 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13361221-634f-41b5-b97e-1f67db05f20c None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:39.420803 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5891c16f-7b93-4147-a0dd-9d55062ee9a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a3ed285ee4c4d04abf7daf0aeb9fb7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:39.421475 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891c16f-7b93-4147-a0dd-9d55062ee9a3 service cinder] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:39.421764 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891c16f-7b93-4147-a0dd-9d55062ee9a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:39.422042 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891c16f-7b93-4147-a0dd-9d55062ee9a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:39.429307 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f911f3-eb02-403b-9976-cfe000ae92d7 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:39.431120 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5891c16f-7b93-4147-a0dd-9d55062ee9a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:39.432561 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5891c16f-7b93-4147-a0dd-9d55062ee9a3 service cinder] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:39.434600 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ff7e33-baf0-4948-ac5d-1921d742e1fa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e958c5b03a9346d59c32675c5271bf3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:39.435875 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff7e33-baf0-4948-ac5d-1921d742e1fa service swift] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:39.436166 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff7e33-baf0-4948-ac5d-1921d742e1fa service swift] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:39.436452 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff7e33-baf0-4948-ac5d-1921d742e1fa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:39.442867 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1316/2654] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:41:39 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:41:39.446562 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ff7e33-baf0-4948-ac5d-1921d742e1fa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:39.448169 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ff7e33-baf0-4948-ac5d-1921d742e1fa service swift] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:39.457570 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1339/2655] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Jul 1 19:41:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 01 19:41:39.517713 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5891c16f-7b93-4147-a0dd-9d55062ee9a3 service cinder] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:39.526671 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5891c16f-7b93-4147-a0dd-9d55062ee9a3 service cinder] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:39.531861 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b796fbd-dd08-462b-afba-0abc7a189a2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a3ed285ee4c4d04abf7daf0aeb9fb7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:39.532574 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b796fbd-dd08-462b-afba-0abc7a189a2b service cinder] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:39.532863 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b796fbd-dd08-462b-afba-0abc7a189a2b service cinder] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:39.533145 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b796fbd-dd08-462b-afba-0abc7a189a2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:39.596221 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b796fbd-dd08-462b-afba-0abc7a189a2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:39.597914 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b796fbd-dd08-462b-afba-0abc7a189a2b service cinder] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:39.607906 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1317/2656] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:41:39 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 19:41:41.416621 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ff7e33-baf0-4948-ac5d-1921d742e1fa service swift] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:41.418593 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-65ff7e33-baf0-4948-ac5d-1921d742e1fa service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:41.469403 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:41.485172 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ff7e33-baf0-4948-ac5d-1921d742e1fa service swift] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:41.489765 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94601a6-978d-442f-bb78-5321b6fb1c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:41.490633 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94601a6-978d-442f-bb78-5321b6fb1c39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:41.490919 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94601a6-978d-442f-bb78-5321b6fb1c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:41.491201 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94601a6-978d-442f-bb78-5321b6fb1c39 admin admin] PATH_INFO: `/v3/users/4131419a2c9d4119a10433f4d26cd32c` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:41.492428 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94601a6-978d-442f-bb78-5321b6fb1c39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4131419a2c9d4119a10433f4d26cd32c)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:41.494386 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94601a6-978d-442f-bb78-5321b6fb1c39 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:41.543326 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-a94601a6-978d-442f-bb78-5321b6fb1c39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4131419a2c9d4119a10433f4d26cd32c'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:41.544079 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-a94601a6-978d-442f-bb78-5321b6fb1c39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4131419a2c9d4119a10433f4d26cd32c'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:41.556117 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-a94601a6-978d-442f-bb78-5321b6fb1c39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4131419a2c9d4119a10433f4d26cd32c'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:41.563731 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-a94601a6-978d-442f-bb78-5321b6fb1c39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4131419a2c9d4119a10433f4d26cd32c'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:41.571585 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-a94601a6-978d-442f-bb78-5321b6fb1c39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4131419a2c9d4119a10433f4d26cd32c'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:41.578890 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1340/2657] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:41:41 2022] DELETE /identity/v3/users/4131419a2c9d4119a10433f4d26cd32c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:41:41.757061 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b796fbd-dd08-462b-afba-0abc7a189a2b service cinder] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:41.768882 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b796fbd-dd08-462b-afba-0abc7a189a2b service cinder] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:41.830098 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f1fe0b-a52f-4c1f-a8e3-bc2cba5a85a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:41.830955 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1fe0b-a52f-4c1f-a8e3-bc2cba5a85a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:41.831237 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1fe0b-a52f-4c1f-a8e3-bc2cba5a85a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:41.831515 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1fe0b-a52f-4c1f-a8e3-bc2cba5a85a7 admin admin] PATH_INFO: `/v3/projects/6eeb9b0247554eec8d166c864d257325` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:41.832702 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f1fe0b-a52f-4c1f-a8e3-bc2cba5a85a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6eeb9b0247554eec8d166c864d257325)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:41.834654 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f1fe0b-a52f-4c1f-a8e3-bc2cba5a85a7 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:41.880344 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-73f1fe0b-a52f-4c1f-a8e3-bc2cba5a85a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6eeb9b0247554eec8d166c864d257325', 'request_id': 'req-73f1fe0b-a52f-4c1f-a8e3-bc2cba5a85a7'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:41.884940 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:41.886425 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-73f1fe0b-a52f-4c1f-a8e3-bc2cba5a85a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6eeb9b0247554eec8d166c864d257325', 'request_id': 'req-73f1fe0b-a52f-4c1f-a8e3-bc2cba5a85a7'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:41.893808 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-73f1fe0b-a52f-4c1f-a8e3-bc2cba5a85a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6eeb9b0247554eec8d166c864d257325', 'request_id': 'req-73f1fe0b-a52f-4c1f-a8e3-bc2cba5a85a7'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:41.906240 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-73f1fe0b-a52f-4c1f-a8e3-bc2cba5a85a7 admin admin] The token cache is being invalidate because project 6eeb9b0247554eec8d166c864d257325 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:41:41.906526 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-73f1fe0b-a52f-4c1f-a8e3-bc2cba5a85a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:41.907136 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-73f1fe0b-a52f-4c1f-a8e3-bc2cba5a85a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:41.908734 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1318/2658] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:41:41 2022] DELETE /identity/v3/projects/6eeb9b0247554eec8d166c864d257325 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:41:41.913986 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d37c5b8-699a-4f6c-a4cb-b85dcb246f20 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:41.914280 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d37c5b8-699a-4f6c-a4cb-b85dcb246f20 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:41.914558 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d37c5b8-699a-4f6c-a4cb-b85dcb246f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:41.931763 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-3d37c5b8-699a-4f6c-a4cb-b85dcb246f20 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:41:41.932947 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-3d37c5b8-699a-4f6c-a4cb-b85dcb246f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:41.992819 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1341/2659] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:41:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:41:42.001383 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68632545-a1f8-419d-82db-a90a7c59cbb5 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:42.001683 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68632545-a1f8-419d-82db-a90a7c59cbb5 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:42.001969 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68632545-a1f8-419d-82db-a90a7c59cbb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:42.020395 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-68632545-a1f8-419d-82db-a90a7c59cbb5 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:41:42.021631 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-68632545-a1f8-419d-82db-a90a7c59cbb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:42.030136 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1319/2660] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:41:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:41:42.034254 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d37c5b8-699a-4f6c-a4cb-b85dcb246f20 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:42.043992 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d37c5b8-699a-4f6c-a4cb-b85dcb246f20 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:42.048553 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06454da-76ac-4cb4-9494-6b27f08314bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:42.049197 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06454da-76ac-4cb4-9494-6b27f08314bd admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:42.049512 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06454da-76ac-4cb4-9494-6b27f08314bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:42.049788 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06454da-76ac-4cb4-9494-6b27f08314bd admin admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:42.050511 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06454da-76ac-4cb4-9494-6b27f08314bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:41:42.050816 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06454da-76ac-4cb4-9494-6b27f08314bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:42.052387 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06454da-76ac-4cb4-9494-6b27f08314bd admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:42.064045 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1342/2661] 10.222.0.26 () {58 vars in 1152 bytes} [Fri Jul 1 19:41:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:41:42.068368 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68632545-a1f8-419d-82db-a90a7c59cbb5 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:42.078014 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68632545-a1f8-419d-82db-a90a7c59cbb5 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:42.082814 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab67196-4e9d-4f15-9395-612c0ac20469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:42.083457 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab67196-4e9d-4f15-9395-612c0ac20469 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:42.083743 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab67196-4e9d-4f15-9395-612c0ac20469 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:42.084023 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab67196-4e9d-4f15-9395-612c0ac20469 admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:42.084713 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab67196-4e9d-4f15-9395-612c0ac20469 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:42.086670 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab67196-4e9d-4f15-9395-612c0ac20469 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:42.112555 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1320/2662] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:41:42 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:41:42.116624 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06454da-76ac-4cb4-9494-6b27f08314bd admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:42.127359 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06454da-76ac-4cb4-9494-6b27f08314bd admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:42.177352 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:42.185262 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3159a78a-bd7d-4018-8d42-05fab480be1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:42.186204 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3159a78a-bd7d-4018-8d42-05fab480be1f admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:42.186650 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3159a78a-bd7d-4018-8d42-05fab480be1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:42.187234 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3159a78a-bd7d-4018-8d42-05fab480be1f admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:42.188012 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3159a78a-bd7d-4018-8d42-05fab480be1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:42.190204 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3159a78a-bd7d-4018-8d42-05fab480be1f admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:42.209482 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1343/2663] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:41:42 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 19:41:42.213555 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab67196-4e9d-4f15-9395-612c0ac20469 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:42.224853 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab67196-4e9d-4f15-9395-612c0ac20469 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:42.229379 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ee44b-3de9-4679-8d31-387576d37e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:42.230043 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ee44b-3de9-4679-8d31-387576d37e72 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:42.230333 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ee44b-3de9-4679-8d31-387576d37e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:42.230613 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ee44b-3de9-4679-8d31-387576d37e72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:42.231687 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54ee44b-3de9-4679-8d31-387576d37e72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:42.234065 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54ee44b-3de9-4679-8d31-387576d37e72 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:42.249280 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1321/2664] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:41:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:41:42.253003 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3159a78a-bd7d-4018-8d42-05fab480be1f admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:42.263211 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3159a78a-bd7d-4018-8d42-05fab480be1f admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:42.268260 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e6eca9-8321-4e00-9520-cb432061924a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:42.268922 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6eca9-8321-4e00-9520-cb432061924a admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:42.269208 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6eca9-8321-4e00-9520-cb432061924a admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:42.269517 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6eca9-8321-4e00-9520-cb432061924a admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:42.270245 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e6eca9-8321-4e00-9520-cb432061924a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:42.271934 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e6eca9-8321-4e00-9520-cb432061924a admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:42.286195 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1344/2665] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:41:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:41:42.287364 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ee44b-3de9-4679-8d31-387576d37e72 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:42.298415 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ee44b-3de9-4679-8d31-387576d37e72 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:42.303187 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a13cff4-6690-4004-87de-e75f3aa4d328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:42.304053 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a13cff4-6690-4004-87de-e75f3aa4d328 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:42.304333 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a13cff4-6690-4004-87de-e75f3aa4d328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:42.304606 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a13cff4-6690-4004-87de-e75f3aa4d328 admin admin] PATH_INFO: `/v3/projects/348987c9cff14f65816c992b040212b6/users/c68dd6198e444d3da12135b17f68dc51/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:42.320022 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a13cff4-6690-4004-87de-e75f3aa4d328 admin admin] RBAC: Authorizing `identity:create_grant(project_id=348987c9cff14f65816c992b040212b6, user_id=c68dd6198e444d3da12135b17f68dc51, role_id=4cbf6ec846eb4b7c8cc52e9bfd6f076f)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:42.322725 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a13cff4-6690-4004-87de-e75f3aa4d328 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:42.339860 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1322/2666] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:41:42 2022] PUT /identity/v3/projects/348987c9cff14f65816c992b040212b6/users/c68dd6198e444d3da12135b17f68dc51/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 19:41:42.345593 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3600986d-2e2e-44fa-a58d-811e73722d26 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:42.345847 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3600986d-2e2e-44fa-a58d-811e73722d26 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:42.346146 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3600986d-2e2e-44fa-a58d-811e73722d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:42.350121 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a13cff4-6690-4004-87de-e75f3aa4d328 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:42.351794 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-6a13cff4-6690-4004-87de-e75f3aa4d328 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:42.364926 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-3600986d-2e2e-44fa-a58d-811e73722d26 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:41:42.366157 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-3600986d-2e2e-44fa-a58d-811e73722d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:42.417432 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a13cff4-6690-4004-87de-e75f3aa4d328 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:42.422858 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b90c9d-128a-42a2-b0cd-8eac02c0fea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:42.423729 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b90c9d-128a-42a2-b0cd-8eac02c0fea6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:42.424020 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b90c9d-128a-42a2-b0cd-8eac02c0fea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:42.424295 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b90c9d-128a-42a2-b0cd-8eac02c0fea6 admin admin] PATH_INFO: `/v3/users/54fa0fd3002d4537bfe15410ffd850d6` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:42.425547 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b90c9d-128a-42a2-b0cd-8eac02c0fea6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54fa0fd3002d4537bfe15410ffd850d6)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:42.427492 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b90c9d-128a-42a2-b0cd-8eac02c0fea6 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:42.430053 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1345/2667] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:41:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:41:42.439671 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3600986d-2e2e-44fa-a58d-811e73722d26 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:42.441073 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-3600986d-2e2e-44fa-a58d-811e73722d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:42.476573 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-14b90c9d-128a-42a2-b0cd-8eac02c0fea6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54fa0fd3002d4537bfe15410ffd850d6'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:42.477252 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-14b90c9d-128a-42a2-b0cd-8eac02c0fea6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54fa0fd3002d4537bfe15410ffd850d6'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:42.485097 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-14b90c9d-128a-42a2-b0cd-8eac02c0fea6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54fa0fd3002d4537bfe15410ffd850d6'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:42.493049 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-14b90c9d-128a-42a2-b0cd-8eac02c0fea6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54fa0fd3002d4537bfe15410ffd850d6'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:42.493926 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-14b90c9d-128a-42a2-b0cd-8eac02c0fea6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54fa0fd3002d4537bfe15410ffd850d6'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:42.501262 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3600986d-2e2e-44fa-a58d-811e73722d26 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:42.505162 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f9c7ad-a8b0-4dd9-9fab-b7b74354e426 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:42.506035 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9c7ad-a8b0-4dd9-9fab-b7b74354e426 service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:42.506322 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9c7ad-a8b0-4dd9-9fab-b7b74354e426 service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:42.506603 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9c7ad-a8b0-4dd9-9fab-b7b74354e426 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:42.507804 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=85,keystone:INSERT=4,keystone:DELETE=11 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:42.508475 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-05f9c7ad-a8b0-4dd9-9fab-b7b74354e426 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:42.512562 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1323/2668] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:41:42 2022] DELETE /identity/v3/users/54fa0fd3002d4537bfe15410ffd850d6 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:41:42.518045 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb89a7df-3148-4c9e-a1b0-d65e1464c2b4 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:42.518626 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb89a7df-3148-4c9e-a1b0-d65e1464c2b4 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:42.519465 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb89a7df-3148-4c9e-a1b0-d65e1464c2b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:42.521970 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f9c7ad-a8b0-4dd9-9fab-b7b74354e426 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:42.523396 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f9c7ad-a8b0-4dd9-9fab-b7b74354e426 service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:42.533804 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1346/2669] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:41:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 19:41:42.538122 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-cb89a7df-3148-4c9e-a1b0-d65e1464c2b4 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:41:42.539444 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-cb89a7df-3148-4c9e-a1b0-d65e1464c2b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:42.601916 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1324/2670] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:41:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:41:42.611876 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f9c7ad-a8b0-4dd9-9fab-b7b74354e426 service neutron] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:42.613473 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-05f9c7ad-a8b0-4dd9-9fab-b7b74354e426 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:42.626117 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f9c7ad-a8b0-4dd9-9fab-b7b74354e426 service neutron] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:42.683435 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32879cd3-ba42-4362-9731-1d50f3ac17ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:42.684098 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32879cd3-ba42-4362-9731-1d50f3ac17ec service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:42.684385 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32879cd3-ba42-4362-9731-1d50f3ac17ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:42.684666 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32879cd3-ba42-4362-9731-1d50f3ac17ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:42.697070 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32879cd3-ba42-4362-9731-1d50f3ac17ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:42.698420 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32879cd3-ba42-4362-9731-1d50f3ac17ec service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:42.711306 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1347/2671] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:41:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 19:41:43.035628 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb89a7df-3148-4c9e-a1b0-d65e1464c2b4 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:43.037874 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-cb89a7df-3148-4c9e-a1b0-d65e1464c2b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:43.049977 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb89a7df-3148-4c9e-a1b0-d65e1464c2b4 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:43.054823 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b067cb9-4749-4582-9030-e5ab9f66d68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:43.055708 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b067cb9-4749-4582-9030-e5ab9f66d68d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:43.056097 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b067cb9-4749-4582-9030-e5ab9f66d68d admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:43.056406 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b067cb9-4749-4582-9030-e5ab9f66d68d admin admin] PATH_INFO: `/v3/projects/3c4005a0bf6847029a364fabb1fa9021` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:43.057944 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b067cb9-4749-4582-9030-e5ab9f66d68d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c4005a0bf6847029a364fabb1fa9021)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:43.060793 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b067cb9-4749-4582-9030-e5ab9f66d68d admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:43.110272 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-0b067cb9-4749-4582-9030-e5ab9f66d68d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c4005a0bf6847029a364fabb1fa9021', 'request_id': 'req-0b067cb9-4749-4582-9030-e5ab9f66d68d'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:43.116163 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-0b067cb9-4749-4582-9030-e5ab9f66d68d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c4005a0bf6847029a364fabb1fa9021', 'request_id': 'req-0b067cb9-4749-4582-9030-e5ab9f66d68d'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:43.123427 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-0b067cb9-4749-4582-9030-e5ab9f66d68d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c4005a0bf6847029a364fabb1fa9021', 'request_id': 'req-0b067cb9-4749-4582-9030-e5ab9f66d68d'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:43.136549 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-0b067cb9-4749-4582-9030-e5ab9f66d68d admin admin] The token cache is being invalidate because project 3c4005a0bf6847029a364fabb1fa9021 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:41:43.136843 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-0b067cb9-4749-4582-9030-e5ab9f66d68d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:43.137494 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-0b067cb9-4749-4582-9030-e5ab9f66d68d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:43.139763 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1325/2672] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:41:43 2022] DELETE /identity/v3/projects/3c4005a0bf6847029a364fabb1fa9021 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:41:43.143701 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32879cd3-ba42-4362-9731-1d50f3ac17ec service neutron] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:43.153804 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32879cd3-ba42-4362-9731-1d50f3ac17ec service neutron] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:43.173969 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:43.197507 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb80739-c814-4f28-b949-a7c1f2732b3b None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:43.197796 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb80739-c814-4f28-b949-a7c1f2732b3b None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:43.198076 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb80739-c814-4f28-b949-a7c1f2732b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:43.226203 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e04b6-0588-44f3-b837-8b182a38ee04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:43.227483 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e04b6-0588-44f3-b837-8b182a38ee04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:43.227772 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e04b6-0588-44f3-b837-8b182a38ee04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:43.227879 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-cbb80739-c814-4f28-b949-a7c1f2732b3b None None] MFA Rules not processed for user `c68dd6198e444d3da12135b17f68dc51`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:41:43.228053 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e04b6-0588-44f3-b837-8b182a38ee04 admin admin] PATH_INFO: `/v3/users/469bc5a455174014bc5b4a55676f03ea` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:43.229106 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-cbb80739-c814-4f28-b949-a7c1f2732b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:43.229409 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317e04b6-0588-44f3-b837-8b182a38ee04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=469bc5a455174014bc5b4a55676f03ea)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:43.231367 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317e04b6-0588-44f3-b837-8b182a38ee04 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:43.291793 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-317e04b6-0588-44f3-b837-8b182a38ee04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '469bc5a455174014bc5b4a55676f03ea'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:43.292686 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-317e04b6-0588-44f3-b837-8b182a38ee04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '469bc5a455174014bc5b4a55676f03ea'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:43.306099 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1326/2673] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:41:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:41:43.309804 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-317e04b6-0588-44f3-b837-8b182a38ee04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '469bc5a455174014bc5b4a55676f03ea'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:43.314396 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb80739-c814-4f28-b949-a7c1f2732b3b None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:43.315783 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-cbb80739-c814-4f28-b949-a7c1f2732b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:43.319258 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-317e04b6-0588-44f3-b837-8b182a38ee04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '469bc5a455174014bc5b4a55676f03ea'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:43.332675 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-317e04b6-0588-44f3-b837-8b182a38ee04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '469bc5a455174014bc5b4a55676f03ea'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:43.338914 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:43.343385 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1348/2674] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:41:43 2022] DELETE /identity/v3/users/469bc5a455174014bc5b4a55676f03ea => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:41:43.404736 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb80739-c814-4f28-b949-a7c1f2732b3b None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:43.456900 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5472c61-e0da-46d1-9cba-4d4c560a395b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a3ed285ee4c4d04abf7daf0aeb9fb7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:43.457578 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5472c61-e0da-46d1-9cba-4d4c560a395b service cinder] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:43.457867 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5472c61-e0da-46d1-9cba-4d4c560a395b service cinder] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:43.458148 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5472c61-e0da-46d1-9cba-4d4c560a395b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:43.460363 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-c5472c61-e0da-46d1-9cba-4d4c560a395b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:43.527710 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5472c61-e0da-46d1-9cba-4d4c560a395b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:43.529902 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5472c61-e0da-46d1-9cba-4d4c560a395b service cinder] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:43.539114 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1327/2675] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:41:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 19:41:43.627807 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e04b6-0588-44f3-b837-8b182a38ee04 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:43.629426 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-317e04b6-0588-44f3-b837-8b182a38ee04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:43.708196 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e04b6-0588-44f3-b837-8b182a38ee04 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:43.714032 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb908ee-6ddb-409a-a3f8-392e8639186d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:43.714906 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb908ee-6ddb-409a-a3f8-392e8639186d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:43.715226 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb908ee-6ddb-409a-a3f8-392e8639186d admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:43.715541 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb908ee-6ddb-409a-a3f8-392e8639186d admin admin] PATH_INFO: `/v3/projects/cc35dc259a0a407f945d080f4c4b9e66` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:43.716820 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb908ee-6ddb-409a-a3f8-392e8639186d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc35dc259a0a407f945d080f4c4b9e66)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:43.718871 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb908ee-6ddb-409a-a3f8-392e8639186d admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:43.764633 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:43.772309 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-1fb908ee-6ddb-409a-a3f8-392e8639186d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc35dc259a0a407f945d080f4c4b9e66', 'request_id': 'req-1fb908ee-6ddb-409a-a3f8-392e8639186d'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:43.779410 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-1fb908ee-6ddb-409a-a3f8-392e8639186d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc35dc259a0a407f945d080f4c4b9e66', 'request_id': 'req-1fb908ee-6ddb-409a-a3f8-392e8639186d'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:43.786292 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-1fb908ee-6ddb-409a-a3f8-392e8639186d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc35dc259a0a407f945d080f4c4b9e66', 'request_id': 'req-1fb908ee-6ddb-409a-a3f8-392e8639186d'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:43.801427 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-1fb908ee-6ddb-409a-a3f8-392e8639186d admin admin] The token cache is being invalidate because project cc35dc259a0a407f945d080f4c4b9e66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:41:43.801787 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-1fb908ee-6ddb-409a-a3f8-392e8639186d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:43.802431 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-1fb908ee-6ddb-409a-a3f8-392e8639186d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:43.804188 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1349/2676] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:41:43 2022] DELETE /identity/v3/projects/cc35dc259a0a407f945d080f4c4b9e66 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:41:43.809082 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631b30e-6afe-4b8c-bfa4-b77ce128f29d None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:43.809427 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631b30e-6afe-4b8c-bfa4-b77ce128f29d None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:43.809709 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631b30e-6afe-4b8c-bfa4-b77ce128f29d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:43.830356 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-0631b30e-6afe-4b8c-bfa4-b77ce128f29d None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:41:43.831726 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-0631b30e-6afe-4b8c-bfa4-b77ce128f29d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:43.905665 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1328/2677] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:41:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:41:43.914100 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf698d-8f57-45a8-8407-4d7af7a373a2 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:43.914394 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf698d-8f57-45a8-8407-4d7af7a373a2 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:43.914676 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf698d-8f57-45a8-8407-4d7af7a373a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:43.932977 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-8ecf698d-8f57-45a8-8407-4d7af7a373a2 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:41:43.934232 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-8ecf698d-8f57-45a8-8407-4d7af7a373a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:43.942632 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1350/2678] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:41:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:41:43.946871 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0631b30e-6afe-4b8c-bfa4-b77ce128f29d None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:43.957046 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0631b30e-6afe-4b8c-bfa4-b77ce128f29d None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:43.961833 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af84f0e-07bd-4b53-a270-1b7e3f9f8c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:43.962486 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af84f0e-07bd-4b53-a270-1b7e3f9f8c5e admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:43.962772 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af84f0e-07bd-4b53-a270-1b7e3f9f8c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:43.963052 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af84f0e-07bd-4b53-a270-1b7e3f9f8c5e admin admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:43.963782 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af84f0e-07bd-4b53-a270-1b7e3f9f8c5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:41:43.964094 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af84f0e-07bd-4b53-a270-1b7e3f9f8c5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:43.965760 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af84f0e-07bd-4b53-a270-1b7e3f9f8c5e admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:43.977159 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1329/2679] 10.222.0.26 () {58 vars in 1152 bytes} [Fri Jul 1 19:41:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:41:43.981588 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf698d-8f57-45a8-8407-4d7af7a373a2 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:43.991586 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf698d-8f57-45a8-8407-4d7af7a373a2 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:43.996409 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff74459-caca-4021-af95-6d890d24ada7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:43.997087 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff74459-caca-4021-af95-6d890d24ada7 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:43.997411 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff74459-caca-4021-af95-6d890d24ada7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:43.997744 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff74459-caca-4021-af95-6d890d24ada7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:43.998941 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff74459-caca-4021-af95-6d890d24ada7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:44.000823 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff74459-caca-4021-af95-6d890d24ada7 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:44.028710 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1351/2680] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:41:43 2022] POST /identity/v3/projects => generated 367 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:41:44.030607 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af84f0e-07bd-4b53-a270-1b7e3f9f8c5e admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:44.040659 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af84f0e-07bd-4b53-a270-1b7e3f9f8c5e admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:44.048746 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:44.096384 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a795e99-79e5-4f79-8acd-2e4214412876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:44.097043 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a795e99-79e5-4f79-8acd-2e4214412876 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:44.097365 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a795e99-79e5-4f79-8acd-2e4214412876 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:44.097647 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a795e99-79e5-4f79-8acd-2e4214412876 admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:44.098334 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a795e99-79e5-4f79-8acd-2e4214412876 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:44.100254 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a795e99-79e5-4f79-8acd-2e4214412876 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:44.119764 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1330/2681] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:41:44 2022] POST /identity/v3/users => generated 284 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:41:44.124699 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff74459-caca-4021-af95-6d890d24ada7 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:44.134957 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff74459-caca-4021-af95-6d890d24ada7 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:44.139695 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8140435-c976-4f59-9cf2-8e9529b765ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:44.140346 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8140435-c976-4f59-9cf2-8e9529b765ce admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:44.140631 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8140435-c976-4f59-9cf2-8e9529b765ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:44.140909 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8140435-c976-4f59-9cf2-8e9529b765ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:44.141669 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8140435-c976-4f59-9cf2-8e9529b765ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:44.143325 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8140435-c976-4f59-9cf2-8e9529b765ce admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:44.153645 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1352/2682] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:41:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:41:44.159192 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a795e99-79e5-4f79-8acd-2e4214412876 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:44.170431 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a795e99-79e5-4f79-8acd-2e4214412876 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:44.175079 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2336fe-c27b-4313-960f-a21b0798d666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:44.175732 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2336fe-c27b-4313-960f-a21b0798d666 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:44.176020 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2336fe-c27b-4313-960f-a21b0798d666 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:44.176300 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2336fe-c27b-4313-960f-a21b0798d666 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:44.177017 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2336fe-c27b-4313-960f-a21b0798d666 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:44.178802 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2336fe-c27b-4313-960f-a21b0798d666 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:44.189294 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1331/2683] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:41:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:41:44.193536 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8140435-c976-4f59-9cf2-8e9529b765ce admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:44.203670 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8140435-c976-4f59-9cf2-8e9529b765ce admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:44.208338 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8553f1-5361-436c-8439-2204d1ae8e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:44.209212 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8553f1-5361-436c-8439-2204d1ae8e6b admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:44.209532 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8553f1-5361-436c-8439-2204d1ae8e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:44.209816 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8553f1-5361-436c-8439-2204d1ae8e6b admin admin] PATH_INFO: `/v3/projects/6922b4fcb48d4141b9fdbae8d894dd69/users/5bed3684cd9c4ca1bec675531906fc1b/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:44.224356 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8553f1-5361-436c-8439-2204d1ae8e6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6922b4fcb48d4141b9fdbae8d894dd69, user_id=5bed3684cd9c4ca1bec675531906fc1b, role_id=4cbf6ec846eb4b7c8cc52e9bfd6f076f)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:44.227055 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8553f1-5361-436c-8439-2204d1ae8e6b admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:44.241250 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1353/2684] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:41:44 2022] PUT /identity/v3/projects/6922b4fcb48d4141b9fdbae8d894dd69/users/5bed3684cd9c4ca1bec675531906fc1b/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:41:44.253221 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4f004-6c73-43a0-89a9-610785b4ca91 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:44.253549 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4f004-6c73-43a0-89a9-610785b4ca91 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:44.253837 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4f004-6c73-43a0-89a9-610785b4ca91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:44.279629 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-97d4f004-6c73-43a0-89a9-610785b4ca91 None None] MFA Rules not processed for user `5bed3684cd9c4ca1bec675531906fc1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:41:44.280833 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-97d4f004-6c73-43a0-89a9-610785b4ca91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:44.344791 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1332/2685] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:41:44 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:41:44.349118 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8553f1-5361-436c-8439-2204d1ae8e6b admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:44.411838 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8553f1-5361-436c-8439-2204d1ae8e6b admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:44.416471 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a1433c-60e7-4640-a8bb-4238b9e6851a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:44.417125 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a1433c-60e7-4640-a8bb-4238b9e6851a admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:44.417444 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a1433c-60e7-4640-a8bb-4238b9e6851a admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:44.417729 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a1433c-60e7-4640-a8bb-4238b9e6851a admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:44.418429 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a1433c-60e7-4640-a8bb-4238b9e6851a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:44.420880 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a1433c-60e7-4640-a8bb-4238b9e6851a admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:44.445954 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1354/2686] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:41:44 2022] POST /identity/v3/projects => generated 367 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:41:44.450060 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d4f004-6c73-43a0-89a9-610785b4ca91 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:44.461209 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d4f004-6c73-43a0-89a9-610785b4ca91 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:44.519687 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4b6b7a-4379-45b8-84fd-0346ffcfed62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:44.520356 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b6b7a-4379-45b8-84fd-0346ffcfed62 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:44.520644 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b6b7a-4379-45b8-84fd-0346ffcfed62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:44.520926 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b6b7a-4379-45b8-84fd-0346ffcfed62 admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:44.521669 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4b6b7a-4379-45b8-84fd-0346ffcfed62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:44.523595 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4b6b7a-4379-45b8-84fd-0346ffcfed62 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:44.542853 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1333/2687] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:41:44 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:41:44.546895 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a1433c-60e7-4640-a8bb-4238b9e6851a admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:44.557004 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a1433c-60e7-4640-a8bb-4238b9e6851a admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:44.562326 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f1eaf-c8ad-4cce-813b-679025dae62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:44.562981 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f1eaf-c8ad-4cce-813b-679025dae62d admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:44.563272 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f1eaf-c8ad-4cce-813b-679025dae62d admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:44.563556 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f1eaf-c8ad-4cce-813b-679025dae62d admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:44.564284 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20f1eaf-c8ad-4cce-813b-679025dae62d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:44.565913 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20f1eaf-c8ad-4cce-813b-679025dae62d admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:44.577033 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1355/2688] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:41:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:41:44.581094 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4b6b7a-4379-45b8-84fd-0346ffcfed62 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:44.590935 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4b6b7a-4379-45b8-84fd-0346ffcfed62 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:44.595601 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd0eca4-e352-4a1f-8c60-500f1d02af28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:44.596425 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0eca4-e352-4a1f-8c60-500f1d02af28 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:44.596718 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0eca4-e352-4a1f-8c60-500f1d02af28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:44.597001 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0eca4-e352-4a1f-8c60-500f1d02af28 admin admin] PATH_INFO: `/v3/projects/16a514cd2c5540d6b24aabc7d9eff507/users/003f576fff8d43ce959a5783da235ab2/roles/6cb03785fb184ef587509b3174622f69` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:44.600043 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:44.612502 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd0eca4-e352-4a1f-8c60-500f1d02af28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16a514cd2c5540d6b24aabc7d9eff507, user_id=003f576fff8d43ce959a5783da235ab2, role_id=6cb03785fb184ef587509b3174622f69)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:44.615186 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd0eca4-e352-4a1f-8c60-500f1d02af28 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:44.630482 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1334/2689] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:41:44 2022] PUT /identity/v3/projects/16a514cd2c5540d6b24aabc7d9eff507/users/003f576fff8d43ce959a5783da235ab2/roles/6cb03785fb184ef587509b3174622f69 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:41:44.634546 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f1eaf-c8ad-4cce-813b-679025dae62d admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:44.645622 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f1eaf-c8ad-4cce-813b-679025dae62d admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:44.685924 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:44.706939 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d6206a-428e-41f2-8e96-246c6d839cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:44.707607 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6206a-428e-41f2-8e96-246c6d839cbd admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:44.707894 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6206a-428e-41f2-8e96-246c6d839cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:44.708173 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6206a-428e-41f2-8e96-246c6d839cbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:44.708895 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d6206a-428e-41f2-8e96-246c6d839cbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:44.712054 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d6206a-428e-41f2-8e96-246c6d839cbd admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:44.721807 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1356/2690] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:41:44 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 19:41:44.726035 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd0eca4-e352-4a1f-8c60-500f1d02af28 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:44.737592 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd0eca4-e352-4a1f-8c60-500f1d02af28 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:44.742324 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c94442-d5b0-46c9-a1b2-7bbc6beecd8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:44.743199 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c94442-d5b0-46c9-a1b2-7bbc6beecd8e admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:44.743485 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c94442-d5b0-46c9-a1b2-7bbc6beecd8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:44.743787 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c94442-d5b0-46c9-a1b2-7bbc6beecd8e admin admin] PATH_INFO: `/v3/projects/16a514cd2c5540d6b24aabc7d9eff507/users/003f576fff8d43ce959a5783da235ab2/roles/6cb03785fb184ef587509b3174622f69` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:44.745784 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c94442-d5b0-46c9-a1b2-7bbc6beecd8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=16a514cd2c5540d6b24aabc7d9eff507, user_id=003f576fff8d43ce959a5783da235ab2, role_id=6cb03785fb184ef587509b3174622f69)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:44.749107 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c94442-d5b0-46c9-a1b2-7bbc6beecd8e admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:44.759247 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1335/2691] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:41:44 2022] PUT /identity/v3/projects/16a514cd2c5540d6b24aabc7d9eff507/users/003f576fff8d43ce959a5783da235ab2/roles/6cb03785fb184ef587509b3174622f69 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:41:44.769826 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e065da-e2d5-4234-ba19-8fed74293c3a None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:44.770123 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e065da-e2d5-4234-ba19-8fed74293c3a None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:44.770408 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e065da-e2d5-4234-ba19-8fed74293c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:44.801732 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-e7e065da-e2d5-4234-ba19-8fed74293c3a None None] MFA Rules not processed for user `003f576fff8d43ce959a5783da235ab2`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:41:44.802939 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-e7e065da-e2d5-4234-ba19-8fed74293c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:44.871968 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1357/2692] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:41:44 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:41:44.882405 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c94442-d5b0-46c9-a1b2-7bbc6beecd8e admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:44.884838 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-61c94442-d5b0-46c9-a1b2-7bbc6beecd8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:44.919281 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab46de1e-feae-4191-b0e5-ab4082a99530 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:44.919616 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab46de1e-feae-4191-b0e5-ab4082a99530 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:44.919922 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab46de1e-feae-4191-b0e5-ab4082a99530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:44.937430 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-ab46de1e-feae-4191-b0e5-ab4082a99530 None None] MFA Rules not processed for user `c68dd6198e444d3da12135b17f68dc51`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:41:44.938530 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-ab46de1e-feae-4191-b0e5-ab4082a99530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:44.946812 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c94442-d5b0-46c9-a1b2-7bbc6beecd8e admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:44.950641 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f9248-e18e-4d29-a782-2dee382abca4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a3ed285ee4c4d04abf7daf0aeb9fb7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:44.951854 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f9248-e18e-4d29-a782-2dee382abca4 service cinder] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:44.952147 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f9248-e18e-4d29-a782-2dee382abca4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:44.952523 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f9248-e18e-4d29-a782-2dee382abca4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:44.961729 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2f9248-e18e-4d29-a782-2dee382abca4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:44.963195 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2f9248-e18e-4d29-a782-2dee382abca4 service cinder] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:44.973222 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1336/2693] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:41:44 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:41:44.996793 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1358/2694] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:41:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:41:45.057651 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f9248-e18e-4d29-a782-2dee382abca4 service cinder] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:45.067474 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f9248-e18e-4d29-a782-2dee382abca4 service cinder] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:45.071371 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43220679-b858-472c-9861-a3d54bfb29ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a3ed285ee4c4d04abf7daf0aeb9fb7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:45.072010 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43220679-b858-472c-9861-a3d54bfb29ff service cinder] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:45.072297 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43220679-b858-472c-9861-a3d54bfb29ff service cinder] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:45.072717 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43220679-b858-472c-9861-a3d54bfb29ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:45.135211 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43220679-b858-472c-9861-a3d54bfb29ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:45.136933 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43220679-b858-472c-9861-a3d54bfb29ff service cinder] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:45.148991 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1337/2695] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:41:45 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:41:49.987672 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab46de1e-feae-4191-b0e5-ab4082a99530 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:50.051920 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab46de1e-feae-4191-b0e5-ab4082a99530 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:50.056314 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1da3b6f-6b19-4eb9-a081-8337b9863c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:50.057181 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1da3b6f-6b19-4eb9-a081-8337b9863c1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:50.057497 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1da3b6f-6b19-4eb9-a081-8337b9863c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:50.057776 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1da3b6f-6b19-4eb9-a081-8337b9863c1d admin admin] PATH_INFO: `/v3/users/5bed3684cd9c4ca1bec675531906fc1b` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:50.058967 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1da3b6f-6b19-4eb9-a081-8337b9863c1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bed3684cd9c4ca1bec675531906fc1b)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:50.061189 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1da3b6f-6b19-4eb9-a081-8337b9863c1d admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:50.066472 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:50.107943 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-e1da3b6f-6b19-4eb9-a081-8337b9863c1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bed3684cd9c4ca1bec675531906fc1b'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:50.108597 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-e1da3b6f-6b19-4eb9-a081-8337b9863c1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bed3684cd9c4ca1bec675531906fc1b'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:50.120098 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-e1da3b6f-6b19-4eb9-a081-8337b9863c1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bed3684cd9c4ca1bec675531906fc1b'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:50.126897 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-e1da3b6f-6b19-4eb9-a081-8337b9863c1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bed3684cd9c4ca1bec675531906fc1b'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:50.134113 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-e1da3b6f-6b19-4eb9-a081-8337b9863c1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bed3684cd9c4ca1bec675531906fc1b'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:50.140525 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1359/2696] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:41:49 2022] DELETE /identity/v3/users/5bed3684cd9c4ca1bec675531906fc1b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:41:50.144994 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3a57b-bece-4e11-b709-8b1c098c185f None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:50.145504 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3a57b-bece-4e11-b709-8b1c098c185f None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:50.145603 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3a57b-bece-4e11-b709-8b1c098c185f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:50.162747 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-79f3a57b-bece-4e11-b709-8b1c098c185f None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:41:50.163926 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-79f3a57b-bece-4e11-b709-8b1c098c185f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:50.223729 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1338/2697] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:41:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:41:50.233820 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1da3b6f-6b19-4eb9-a081-8337b9863c1d admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:50.235278 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-e1da3b6f-6b19-4eb9-a081-8337b9863c1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:50.297796 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1da3b6f-6b19-4eb9-a081-8337b9863c1d admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:50.303331 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd7ce6e-29cd-441d-a4ec-02cb13fc8659 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:50.303876 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd7ce6e-29cd-441d-a4ec-02cb13fc8659 service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:50.304170 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd7ce6e-29cd-441d-a4ec-02cb13fc8659 service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:50.304456 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd7ce6e-29cd-441d-a4ec-02cb13fc8659 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:50.315074 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd7ce6e-29cd-441d-a4ec-02cb13fc8659 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:50.316780 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd7ce6e-29cd-441d-a4ec-02cb13fc8659 service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:50.327951 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1360/2698] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:41:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:41:50.597153 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f3a57b-bece-4e11-b709-8b1c098c185f None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:50.599654 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-79f3a57b-bece-4e11-b709-8b1c098c185f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:50.613786 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f3a57b-bece-4e11-b709-8b1c098c185f None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:50.618418 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bafb1e5-eadd-4410-9c38-ab560aa425c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:50.619273 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bafb1e5-eadd-4410-9c38-ab560aa425c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:50.619597 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bafb1e5-eadd-4410-9c38-ab560aa425c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:50.619809 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bafb1e5-eadd-4410-9c38-ab560aa425c1 admin admin] PATH_INFO: `/v3/projects/6922b4fcb48d4141b9fdbae8d894dd69` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:50.625485 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bafb1e5-eadd-4410-9c38-ab560aa425c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6922b4fcb48d4141b9fdbae8d894dd69)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:50.625485 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bafb1e5-eadd-4410-9c38-ab560aa425c1 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:50.633063 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:50.673586 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-4bafb1e5-eadd-4410-9c38-ab560aa425c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6922b4fcb48d4141b9fdbae8d894dd69', 'request_id': 'req-4bafb1e5-eadd-4410-9c38-ab560aa425c1'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:50.679272 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-4bafb1e5-eadd-4410-9c38-ab560aa425c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6922b4fcb48d4141b9fdbae8d894dd69', 'request_id': 'req-4bafb1e5-eadd-4410-9c38-ab560aa425c1'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:50.686082 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-4bafb1e5-eadd-4410-9c38-ab560aa425c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6922b4fcb48d4141b9fdbae8d894dd69', 'request_id': 'req-4bafb1e5-eadd-4410-9c38-ab560aa425c1'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:50.698436 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-4bafb1e5-eadd-4410-9c38-ab560aa425c1 admin admin] The token cache is being invalidate because project 6922b4fcb48d4141b9fdbae8d894dd69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:41:50.698722 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-4bafb1e5-eadd-4410-9c38-ab560aa425c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:50.699336 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-4bafb1e5-eadd-4410-9c38-ab560aa425c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:50.701266 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1339/2699] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:41:50 2022] DELETE /identity/v3/projects/6922b4fcb48d4141b9fdbae8d894dd69 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:41:50.705594 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd7ce6e-29cd-441d-a4ec-02cb13fc8659 service neutron] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:50.715140 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd7ce6e-29cd-441d-a4ec-02cb13fc8659 service neutron] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:50.772191 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0e217f-672c-4acb-a020-a251c1b00172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:50.773062 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e217f-672c-4acb-a020-a251c1b00172 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:50.773402 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e217f-672c-4acb-a020-a251c1b00172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:50.773681 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e217f-672c-4acb-a020-a251c1b00172 admin admin] PATH_INFO: `/v3/users/003f576fff8d43ce959a5783da235ab2` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:50.774881 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0e217f-672c-4acb-a020-a251c1b00172 admin admin] RBAC: Authorizing `identity:delete_user(user_id=003f576fff8d43ce959a5783da235ab2)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:50.776797 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0e217f-672c-4acb-a020-a251c1b00172 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:50.812371 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:50.827480 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-dd0e217f-672c-4acb-a020-a251c1b00172 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '003f576fff8d43ce959a5783da235ab2'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:50.828130 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-dd0e217f-672c-4acb-a020-a251c1b00172 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '003f576fff8d43ce959a5783da235ab2'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:50.839762 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-dd0e217f-672c-4acb-a020-a251c1b00172 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '003f576fff8d43ce959a5783da235ab2'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:50.846572 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-dd0e217f-672c-4acb-a020-a251c1b00172 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '003f576fff8d43ce959a5783da235ab2'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:50.853952 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-dd0e217f-672c-4acb-a020-a251c1b00172 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '003f576fff8d43ce959a5783da235ab2'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:50.860729 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1361/2700] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:41:50 2022] DELETE /identity/v3/users/003f576fff8d43ce959a5783da235ab2 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:41:51.151297 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bafb1e5-eadd-4410-9c38-ab560aa425c1 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:51.155646 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-4bafb1e5-eadd-4410-9c38-ab560aa425c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:51.180365 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bafb1e5-eadd-4410-9c38-ab560aa425c1 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:51.241213 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc9b79-b4dc-4c84-ab1f-abf4abc80614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:51.242110 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc9b79-b4dc-4c84-ab1f-abf4abc80614 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:51.242402 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc9b79-b4dc-4c84-ab1f-abf4abc80614 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:51.242684 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc9b79-b4dc-4c84-ab1f-abf4abc80614 admin admin] PATH_INFO: `/v3/projects/16a514cd2c5540d6b24aabc7d9eff507` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:51.243892 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bc9b79-b4dc-4c84-ab1f-abf4abc80614 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16a514cd2c5540d6b24aabc7d9eff507)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:51.245927 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bc9b79-b4dc-4c84-ab1f-abf4abc80614 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:51.304965 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f2bc9b79-b4dc-4c84-ab1f-abf4abc80614 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16a514cd2c5540d6b24aabc7d9eff507', 'request_id': 'req-f2bc9b79-b4dc-4c84-ab1f-abf4abc80614'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:51.304965 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f2bc9b79-b4dc-4c84-ab1f-abf4abc80614 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16a514cd2c5540d6b24aabc7d9eff507', 'request_id': 'req-f2bc9b79-b4dc-4c84-ab1f-abf4abc80614'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:51.311194 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f2bc9b79-b4dc-4c84-ab1f-abf4abc80614 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16a514cd2c5540d6b24aabc7d9eff507', 'request_id': 'req-f2bc9b79-b4dc-4c84-ab1f-abf4abc80614'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:51.324434 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f2bc9b79-b4dc-4c84-ab1f-abf4abc80614 admin admin] The token cache is being invalidate because project 16a514cd2c5540d6b24aabc7d9eff507 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:41:51.324731 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f2bc9b79-b4dc-4c84-ab1f-abf4abc80614 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:51.325425 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f2bc9b79-b4dc-4c84-ab1f-abf4abc80614 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:51.327575 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1340/2701] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:41:51 2022] DELETE /identity/v3/projects/16a514cd2c5540d6b24aabc7d9eff507 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:41:51.332456 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f6110-05fb-4f98-92c1-84e21a2fc569 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:51.332959 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f6110-05fb-4f98-92c1-84e21a2fc569 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:51.333066 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f6110-05fb-4f98-92c1-84e21a2fc569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:51.351149 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-f43f6110-05fb-4f98-92c1-84e21a2fc569 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:41:51.352475 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-f43f6110-05fb-4f98-92c1-84e21a2fc569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:51.423863 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1362/2702] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:41:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:41:51.444189 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c36390-9018-446e-9d2b-b9f671e28182 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:51.444481 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c36390-9018-446e-9d2b-b9f671e28182 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:51.444763 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c36390-9018-446e-9d2b-b9f671e28182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:51.464047 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-32c36390-9018-446e-9d2b-b9f671e28182 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:41:51.465365 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-32c36390-9018-446e-9d2b-b9f671e28182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:51.473745 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1341/2703] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:41:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:41:51.477768 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f6110-05fb-4f98-92c1-84e21a2fc569 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:51.488262 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f6110-05fb-4f98-92c1-84e21a2fc569 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:51.493086 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922003bd-d13c-4ed4-b044-4e44f539006f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:51.493856 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922003bd-d13c-4ed4-b044-4e44f539006f admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:51.494141 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922003bd-d13c-4ed4-b044-4e44f539006f admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:51.494421 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922003bd-d13c-4ed4-b044-4e44f539006f admin admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:51.495197 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922003bd-d13c-4ed4-b044-4e44f539006f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:41:51.495553 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922003bd-d13c-4ed4-b044-4e44f539006f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:51.497151 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922003bd-d13c-4ed4-b044-4e44f539006f admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:51.511598 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1363/2704] 10.222.0.26 () {58 vars in 1152 bytes} [Fri Jul 1 19:41:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:41:51.515972 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c36390-9018-446e-9d2b-b9f671e28182 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:51.526171 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c36390-9018-446e-9d2b-b9f671e28182 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:51.531400 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4acb8d3-22c4-4fb6-80fd-71196cd3c3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:51.532178 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4acb8d3-22c4-4fb6-80fd-71196cd3c3dd admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:51.532530 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4acb8d3-22c4-4fb6-80fd-71196cd3c3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:51.532872 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4acb8d3-22c4-4fb6-80fd-71196cd3c3dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:51.533755 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4acb8d3-22c4-4fb6-80fd-71196cd3c3dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:51.536095 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4acb8d3-22c4-4fb6-80fd-71196cd3c3dd admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:51.557056 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:51.566277 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1342/2705] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:41:51 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:41:51.570171 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922003bd-d13c-4ed4-b044-4e44f539006f admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:51.580021 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922003bd-d13c-4ed4-b044-4e44f539006f admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:51.637740 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a726abb5-ee78-4520-8e4a-33b3f52fb779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:51.638452 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a726abb5-ee78-4520-8e4a-33b3f52fb779 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:51.638739 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a726abb5-ee78-4520-8e4a-33b3f52fb779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:51.639020 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a726abb5-ee78-4520-8e4a-33b3f52fb779 admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:51.639733 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a726abb5-ee78-4520-8e4a-33b3f52fb779 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:51.641701 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a726abb5-ee78-4520-8e4a-33b3f52fb779 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:51.660666 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1364/2706] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:41:51 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:41:51.664756 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4acb8d3-22c4-4fb6-80fd-71196cd3c3dd admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:51.675841 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4acb8d3-22c4-4fb6-80fd-71196cd3c3dd admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:51.680568 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39932b3-678c-4956-8979-0457248a2d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:51.681259 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39932b3-678c-4956-8979-0457248a2d07 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:51.681552 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39932b3-678c-4956-8979-0457248a2d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:51.681832 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39932b3-678c-4956-8979-0457248a2d07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:51.682561 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39932b3-678c-4956-8979-0457248a2d07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:51.684173 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39932b3-678c-4956-8979-0457248a2d07 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:51.695698 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1343/2707] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:41:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:41:51.699941 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a726abb5-ee78-4520-8e4a-33b3f52fb779 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:51.709782 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a726abb5-ee78-4520-8e4a-33b3f52fb779 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:51.714688 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c52b32-f7a6-4f1f-88eb-bab4935ce9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:51.715352 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c52b32-f7a6-4f1f-88eb-bab4935ce9e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:51.715644 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c52b32-f7a6-4f1f-88eb-bab4935ce9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:51.715931 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c52b32-f7a6-4f1f-88eb-bab4935ce9e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:51.716667 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c52b32-f7a6-4f1f-88eb-bab4935ce9e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:51.718400 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c52b32-f7a6-4f1f-88eb-bab4935ce9e8 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:51.728651 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1365/2708] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:41:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:41:51.733019 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39932b3-678c-4956-8979-0457248a2d07 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:51.742864 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39932b3-678c-4956-8979-0457248a2d07 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:51.747663 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6188c6d1-9110-4775-8726-d66da9b2a169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:51.749015 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188c6d1-9110-4775-8726-d66da9b2a169 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:51.749340 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188c6d1-9110-4775-8726-d66da9b2a169 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:51.749652 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188c6d1-9110-4775-8726-d66da9b2a169 admin admin] PATH_INFO: `/v3/projects/ee36871fe62f473781b69101daa5e195/users/a6017025e169491eaf1d0cc8e8f3eca7/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:51.764366 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6188c6d1-9110-4775-8726-d66da9b2a169 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee36871fe62f473781b69101daa5e195, user_id=a6017025e169491eaf1d0cc8e8f3eca7, role_id=4cbf6ec846eb4b7c8cc52e9bfd6f076f)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:51.767271 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6188c6d1-9110-4775-8726-d66da9b2a169 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:51.782199 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1344/2709] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:41:51 2022] PUT /identity/v3/projects/ee36871fe62f473781b69101daa5e195/users/a6017025e169491eaf1d0cc8e8f3eca7/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:41:51.793198 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb6baa8-3319-4a95-8a1b-70d0372dc3a6 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:51.793518 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb6baa8-3319-4a95-8a1b-70d0372dc3a6 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:51.793801 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb6baa8-3319-4a95-8a1b-70d0372dc3a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:51.820539 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:51.826517 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-aeb6baa8-3319-4a95-8a1b-70d0372dc3a6 None None] MFA Rules not processed for user `a6017025e169491eaf1d0cc8e8f3eca7`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:41:51.829441 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-aeb6baa8-3319-4a95-8a1b-70d0372dc3a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:51.895963 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1366/2710] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:41:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:41:51.907159 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6188c6d1-9110-4775-8726-d66da9b2a169 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:51.908827 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-6188c6d1-9110-4775-8726-d66da9b2a169 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:51.967784 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6188c6d1-9110-4775-8726-d66da9b2a169 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:51.971477 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b3deee-f3d8-4e71-942e-8792b291c50b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a3ed285ee4c4d04abf7daf0aeb9fb7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:51.972130 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b3deee-f3d8-4e71-942e-8792b291c50b service cinder] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:51.972417 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b3deee-f3d8-4e71-942e-8792b291c50b service cinder] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:51.972699 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b3deee-f3d8-4e71-942e-8792b291c50b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:51.981746 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b3deee-f3d8-4e71-942e-8792b291c50b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:51.983280 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b3deee-f3d8-4e71-942e-8792b291c50b service cinder] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:51.992796 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1345/2711] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:41:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:41:52.012447 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb6baa8-3319-4a95-8a1b-70d0372dc3a6 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:52.074274 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb6baa8-3319-4a95-8a1b-70d0372dc3a6 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:52.079634 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59522cd7-1663-43b6-be7c-c83e47960609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:52.080496 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59522cd7-1663-43b6-be7c-c83e47960609 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:52.080782 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59522cd7-1663-43b6-be7c-c83e47960609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:52.081058 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59522cd7-1663-43b6-be7c-c83e47960609 admin admin] PATH_INFO: `/v3/users/a6017025e169491eaf1d0cc8e8f3eca7` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:52.082287 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59522cd7-1663-43b6-be7c-c83e47960609 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6017025e169491eaf1d0cc8e8f3eca7)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:52.084194 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59522cd7-1663-43b6-be7c-c83e47960609 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:52.129886 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-59522cd7-1663-43b6-be7c-c83e47960609 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6017025e169491eaf1d0cc8e8f3eca7'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:52.130551 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-59522cd7-1663-43b6-be7c-c83e47960609 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6017025e169491eaf1d0cc8e8f3eca7'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:52.143004 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-59522cd7-1663-43b6-be7c-c83e47960609 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6017025e169491eaf1d0cc8e8f3eca7'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:52.149869 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-59522cd7-1663-43b6-be7c-c83e47960609 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6017025e169491eaf1d0cc8e8f3eca7'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:52.157107 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-59522cd7-1663-43b6-be7c-c83e47960609 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6017025e169491eaf1d0cc8e8f3eca7'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:52.163605 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1367/2712] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:41:52 2022] DELETE /identity/v3/users/a6017025e169491eaf1d0cc8e8f3eca7 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:41:52.168112 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24eead5-325b-47c9-b81e-872775dd9973 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:52.168609 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24eead5-325b-47c9-b81e-872775dd9973 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:52.168714 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24eead5-325b-47c9-b81e-872775dd9973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:52.186184 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-d24eead5-325b-47c9-b81e-872775dd9973 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:41:52.187396 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-d24eead5-325b-47c9-b81e-872775dd9973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:52.245782 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1346/2713] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:41:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:41:52.256069 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59522cd7-1663-43b6-be7c-c83e47960609 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:52.257530 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-59522cd7-1663-43b6-be7c-c83e47960609 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:52.283752 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:52.322099 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59522cd7-1663-43b6-be7c-c83e47960609 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:52.327259 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3fb414-518b-4da8-90a4-a6f22800e167 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:52.328206 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3fb414-518b-4da8-90a4-a6f22800e167 service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:52.328500 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3fb414-518b-4da8-90a4-a6f22800e167 service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:52.328782 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3fb414-518b-4da8-90a4-a6f22800e167 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:52.338960 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3fb414-518b-4da8-90a4-a6f22800e167 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:52.340395 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3fb414-518b-4da8-90a4-a6f22800e167 service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:52.352139 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1368/2714] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:41:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:41:52.659475 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24eead5-325b-47c9-b81e-872775dd9973 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:52.660914 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-d24eead5-325b-47c9-b81e-872775dd9973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:52.673453 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24eead5-325b-47c9-b81e-872775dd9973 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:52.678428 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2042530d-b666-4221-b255-c6324db35e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:52.679310 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042530d-b666-4221-b255-c6324db35e65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:52.679606 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042530d-b666-4221-b255-c6324db35e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:52.679885 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042530d-b666-4221-b255-c6324db35e65 admin admin] PATH_INFO: `/v3/projects/ee36871fe62f473781b69101daa5e195` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:52.681144 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2042530d-b666-4221-b255-c6324db35e65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee36871fe62f473781b69101daa5e195)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:52.683131 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2042530d-b666-4221-b255-c6324db35e65 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:52.756780 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-2042530d-b666-4221-b255-c6324db35e65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee36871fe62f473781b69101daa5e195', 'request_id': 'req-2042530d-b666-4221-b255-c6324db35e65'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:52.766020 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-2042530d-b666-4221-b255-c6324db35e65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee36871fe62f473781b69101daa5e195', 'request_id': 'req-2042530d-b666-4221-b255-c6324db35e65'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:52.768078 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:52.772765 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-2042530d-b666-4221-b255-c6324db35e65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee36871fe62f473781b69101daa5e195', 'request_id': 'req-2042530d-b666-4221-b255-c6324db35e65'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:52.787433 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-2042530d-b666-4221-b255-c6324db35e65 admin admin] The token cache is being invalidate because project ee36871fe62f473781b69101daa5e195 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:41:52.787755 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-2042530d-b666-4221-b255-c6324db35e65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:52.788402 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-2042530d-b666-4221-b255-c6324db35e65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:52.790223 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1347/2715] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:41:52 2022] DELETE /identity/v3/projects/ee36871fe62f473781b69101daa5e195 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:41:52.795327 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f00c5bf-98d9-476a-982c-85f60a36ad40 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:52.795625 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f00c5bf-98d9-476a-982c-85f60a36ad40 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:52.795912 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f00c5bf-98d9-476a-982c-85f60a36ad40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:52.816050 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-0f00c5bf-98d9-476a-982c-85f60a36ad40 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:41:52.817789 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-0f00c5bf-98d9-476a-982c-85f60a36ad40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:52.883846 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1369/2716] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:41:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:41:52.892381 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392eba9-be05-4ed1-941d-44c08b2c8bbd None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:52.892935 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392eba9-be05-4ed1-941d-44c08b2c8bbd None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:52.893218 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392eba9-be05-4ed1-941d-44c08b2c8bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:52.912455 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-0392eba9-be05-4ed1-941d-44c08b2c8bbd None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:41:52.913654 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-0392eba9-be05-4ed1-941d-44c08b2c8bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:52.927508 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f00c5bf-98d9-476a-982c-85f60a36ad40 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:52.928126 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1348/2717] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:41:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:41:52.939359 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f00c5bf-98d9-476a-982c-85f60a36ad40 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:52.944576 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f07f3d-4bc0-414d-90b3-cc58ea786d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:52.945330 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f07f3d-4bc0-414d-90b3-cc58ea786d2e admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:52.945619 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f07f3d-4bc0-414d-90b3-cc58ea786d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:52.945893 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f07f3d-4bc0-414d-90b3-cc58ea786d2e admin admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:52.946635 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f07f3d-4bc0-414d-90b3-cc58ea786d2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:41:52.946951 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f07f3d-4bc0-414d-90b3-cc58ea786d2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:52.948668 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f07f3d-4bc0-414d-90b3-cc58ea786d2e admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:52.963526 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1370/2718] 10.222.0.26 () {58 vars in 1152 bytes} [Fri Jul 1 19:41:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:41:52.968718 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0392eba9-be05-4ed1-941d-44c08b2c8bbd None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:52.979416 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0392eba9-be05-4ed1-941d-44c08b2c8bbd None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:52.985746 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f6f3cb-bd55-43b1-8a44-b5286afaca36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:52.986412 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f6f3cb-bd55-43b1-8a44-b5286afaca36 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:52.986731 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f6f3cb-bd55-43b1-8a44-b5286afaca36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:52.987010 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f6f3cb-bd55-43b1-8a44-b5286afaca36 admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:52.987991 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f6f3cb-bd55-43b1-8a44-b5286afaca36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:52.989732 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f6f3cb-bd55-43b1-8a44-b5286afaca36 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:53.021264 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1349/2719] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:41:52 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:41:53.025495 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f07f3d-4bc0-414d-90b3-cc58ea786d2e admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:53.036325 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f07f3d-4bc0-414d-90b3-cc58ea786d2e admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:53.101683 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb05a530-a2c5-4fb3-8985-fea7de69b24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:53.102354 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb05a530-a2c5-4fb3-8985-fea7de69b24a admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:53.102640 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb05a530-a2c5-4fb3-8985-fea7de69b24a admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:53.102920 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb05a530-a2c5-4fb3-8985-fea7de69b24a admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:53.103623 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb05a530-a2c5-4fb3-8985-fea7de69b24a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:53.105588 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb05a530-a2c5-4fb3-8985-fea7de69b24a admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:53.131083 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1371/2720] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:41:53 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 19:41:53.132681 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f6f3cb-bd55-43b1-8a44-b5286afaca36 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:53.143074 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f6f3cb-bd55-43b1-8a44-b5286afaca36 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:53.147997 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44e0b57-601e-46fd-8745-6a044d734551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:53.148657 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e0b57-601e-46fd-8745-6a044d734551 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:53.148963 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e0b57-601e-46fd-8745-6a044d734551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:53.149253 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e0b57-601e-46fd-8745-6a044d734551 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:53.149988 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44e0b57-601e-46fd-8745-6a044d734551 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:53.151608 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44e0b57-601e-46fd-8745-6a044d734551 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:53.166807 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1350/2721] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:41:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:41:53.168743 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb05a530-a2c5-4fb3-8985-fea7de69b24a admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:53.179452 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb05a530-a2c5-4fb3-8985-fea7de69b24a admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:53.184349 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6784d1f6-27d9-43f9-a47e-f071e47addff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:53.185809 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784d1f6-27d9-43f9-a47e-f071e47addff admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:53.186132 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784d1f6-27d9-43f9-a47e-f071e47addff admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:53.186412 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784d1f6-27d9-43f9-a47e-f071e47addff admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:53.187148 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6784d1f6-27d9-43f9-a47e-f071e47addff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:53.188900 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6784d1f6-27d9-43f9-a47e-f071e47addff admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:53.200169 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1372/2722] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:41:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:41:53.204343 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44e0b57-601e-46fd-8745-6a044d734551 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:53.214352 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44e0b57-601e-46fd-8745-6a044d734551 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:53.219133 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93db6801-672a-479a-9228-bf1f6f631ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:53.220007 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db6801-672a-479a-9228-bf1f6f631ea2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:53.220291 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db6801-672a-479a-9228-bf1f6f631ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:53.220567 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db6801-672a-479a-9228-bf1f6f631ea2 admin admin] PATH_INFO: `/v3/projects/b543a84669084ff0add2c3f7f8e80432/users/ef8cd1939ab54c36a6b4f063f716a962/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:53.236318 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93db6801-672a-479a-9228-bf1f6f631ea2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b543a84669084ff0add2c3f7f8e80432, user_id=ef8cd1939ab54c36a6b4f063f716a962, role_id=4cbf6ec846eb4b7c8cc52e9bfd6f076f)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:53.239067 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93db6801-672a-479a-9228-bf1f6f631ea2 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:53.253838 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1351/2723] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:41:53 2022] PUT /identity/v3/projects/b543a84669084ff0add2c3f7f8e80432/users/ef8cd1939ab54c36a6b4f063f716a962/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:41:53.320562 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c5ed7d-731a-4a26-bc57-8b1d044a67d7 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:53.320981 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c5ed7d-731a-4a26-bc57-8b1d044a67d7 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:53.321358 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c5ed7d-731a-4a26-bc57-8b1d044a67d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:53.348551 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-a5c5ed7d-731a-4a26-bc57-8b1d044a67d7 None None] MFA Rules not processed for user `ef8cd1939ab54c36a6b4f063f716a962`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:41:53.349825 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-a5c5ed7d-731a-4a26-bc57-8b1d044a67d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:53.369048 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:53.429641 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1373/2724] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:41:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:41:53.433983 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93db6801-672a-479a-9228-bf1f6f631ea2 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:53.498566 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93db6801-672a-479a-9228-bf1f6f631ea2 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:53.504309 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048da8b3-c82a-4fe1-823e-96bb80b36a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:53.504972 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048da8b3-c82a-4fe1-823e-96bb80b36a80 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:53.505287 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048da8b3-c82a-4fe1-823e-96bb80b36a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:53.505569 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048da8b3-c82a-4fe1-823e-96bb80b36a80 admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:53.506384 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048da8b3-c82a-4fe1-823e-96bb80b36a80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:53.508325 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048da8b3-c82a-4fe1-823e-96bb80b36a80 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:53.536071 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1352/2725] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:41:53 2022] POST /identity/v3/projects => generated 371 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:41:53.539709 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c5ed7d-731a-4a26-bc57-8b1d044a67d7 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:53.551814 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c5ed7d-731a-4a26-bc57-8b1d044a67d7 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:53.611601 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d01a7e7-88f9-4f4e-85c7-67501c4aeb38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:53.612267 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d01a7e7-88f9-4f4e-85c7-67501c4aeb38 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:53.612556 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d01a7e7-88f9-4f4e-85c7-67501c4aeb38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:53.612834 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d01a7e7-88f9-4f4e-85c7-67501c4aeb38 admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:53.613571 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d01a7e7-88f9-4f4e-85c7-67501c4aeb38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:53.615656 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d01a7e7-88f9-4f4e-85c7-67501c4aeb38 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:53.638027 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1374/2726] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:41:53 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:41:53.641858 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048da8b3-c82a-4fe1-823e-96bb80b36a80 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:53.652388 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048da8b3-c82a-4fe1-823e-96bb80b36a80 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:53.657815 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e52f8e-4b2e-40b2-8f82-984071126a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:53.658472 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e52f8e-4b2e-40b2-8f82-984071126a7e admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:53.658755 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e52f8e-4b2e-40b2-8f82-984071126a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:53.659033 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e52f8e-4b2e-40b2-8f82-984071126a7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:53.660012 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e52f8e-4b2e-40b2-8f82-984071126a7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:53.661645 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e52f8e-4b2e-40b2-8f82-984071126a7e admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:53.673671 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1353/2727] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:41:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:41:53.678445 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d01a7e7-88f9-4f4e-85c7-67501c4aeb38 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:53.691903 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d01a7e7-88f9-4f4e-85c7-67501c4aeb38 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:53.696765 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c49b13-4385-4818-8149-afb3bf027647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:53.697894 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c49b13-4385-4818-8149-afb3bf027647 admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:53.698252 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c49b13-4385-4818-8149-afb3bf027647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:53.698554 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c49b13-4385-4818-8149-afb3bf027647 admin admin] PATH_INFO: `/v3/projects/d3e4fa93c1234c689377d836251ef816/users/c98b1d77887e433cbc1236f812ee0310/roles/6cb03785fb184ef587509b3174622f69` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:53.716006 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c49b13-4385-4818-8149-afb3bf027647 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3e4fa93c1234c689377d836251ef816, user_id=c98b1d77887e433cbc1236f812ee0310, role_id=6cb03785fb184ef587509b3174622f69)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:53.719353 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c49b13-4385-4818-8149-afb3bf027647 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:53.733546 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1375/2728] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:41:53 2022] PUT /identity/v3/projects/d3e4fa93c1234c689377d836251ef816/users/c98b1d77887e433cbc1236f812ee0310/roles/6cb03785fb184ef587509b3174622f69 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:41:53.737580 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e52f8e-4b2e-40b2-8f82-984071126a7e admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:53.747568 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e52f8e-4b2e-40b2-8f82-984071126a7e admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:53.815470 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f93cb4-06fe-4853-9f31-9eb23bcbc1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:53.816153 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f93cb4-06fe-4853-9f31-9eb23bcbc1c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:53.816419 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f93cb4-06fe-4853-9f31-9eb23bcbc1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:53.816742 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f93cb4-06fe-4853-9f31-9eb23bcbc1c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:53.817503 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f93cb4-06fe-4853-9f31-9eb23bcbc1c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:53.819126 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f93cb4-06fe-4853-9f31-9eb23bcbc1c3 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:53.820844 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:53.833221 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1354/2729] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:41:53 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:41:53.837453 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c49b13-4385-4818-8149-afb3bf027647 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:53.850204 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c49b13-4385-4818-8149-afb3bf027647 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:53.855389 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec1b1c0-fc29-47d6-be1b-30ee21f100a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:53.856948 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec1b1c0-fc29-47d6-be1b-30ee21f100a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:53.857567 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec1b1c0-fc29-47d6-be1b-30ee21f100a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:53.858489 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec1b1c0-fc29-47d6-be1b-30ee21f100a7 admin admin] PATH_INFO: `/v3/projects/d3e4fa93c1234c689377d836251ef816/users/c98b1d77887e433cbc1236f812ee0310/roles/6cb03785fb184ef587509b3174622f69` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:53.862131 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec1b1c0-fc29-47d6-be1b-30ee21f100a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3e4fa93c1234c689377d836251ef816, user_id=c98b1d77887e433cbc1236f812ee0310, role_id=6cb03785fb184ef587509b3174622f69)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:53.867098 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec1b1c0-fc29-47d6-be1b-30ee21f100a7 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:53.880276 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1376/2730] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:41:53 2022] PUT /identity/v3/projects/d3e4fa93c1234c689377d836251ef816/users/c98b1d77887e433cbc1236f812ee0310/roles/6cb03785fb184ef587509b3174622f69 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:41:53.890960 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2797fb-35d8-4ee6-abfc-ba07b0501c23 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:53.891329 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2797fb-35d8-4ee6-abfc-ba07b0501c23 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:53.891681 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2797fb-35d8-4ee6-abfc-ba07b0501c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:53.927461 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-cb2797fb-35d8-4ee6-abfc-ba07b0501c23 None None] MFA Rules not processed for user `c98b1d77887e433cbc1236f812ee0310`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:41:53.928736 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-cb2797fb-35d8-4ee6-abfc-ba07b0501c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:54.005680 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1355/2731] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:41:53 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:41:54.017677 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec1b1c0-fc29-47d6-be1b-30ee21f100a7 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:54.019440 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-eec1b1c0-fc29-47d6-be1b-30ee21f100a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:54.077900 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec1b1c0-fc29-47d6-be1b-30ee21f100a7 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:54.081633 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bbba47-9c32-42df-87bc-2b0785b9dba2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a3ed285ee4c4d04abf7daf0aeb9fb7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:54.082278 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bbba47-9c32-42df-87bc-2b0785b9dba2 service cinder] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:54.082565 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bbba47-9c32-42df-87bc-2b0785b9dba2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:54.082844 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bbba47-9c32-42df-87bc-2b0785b9dba2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:54.112586 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:54.146541 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bbba47-9c32-42df-87bc-2b0785b9dba2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:54.148048 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bbba47-9c32-42df-87bc-2b0785b9dba2 service cinder] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:54.159164 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1377/2732] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:41:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:41:54.851321 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f6204-aa86-40d3-8110-0b2e19340b30 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:54.851862 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f6204-aa86-40d3-8110-0b2e19340b30 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:54.851862 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f6204-aa86-40d3-8110-0b2e19340b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:54.874081 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-4d6f6204-aa86-40d3-8110-0b2e19340b30 None None] MFA Rules not processed for user `1eae281b1ee147a09134db72c64282ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:41:54.875305 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-4d6f6204-aa86-40d3-8110-0b2e19340b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:54.935757 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1356/2733] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:41:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:41:56.693772 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bbba47-9c32-42df-87bc-2b0785b9dba2 service cinder] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:56.757462 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bbba47-9c32-42df-87bc-2b0785b9dba2 service cinder] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:56.762078 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfce755-88ee-4238-b990-bcc8742a4205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:56.763557 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfce755-88ee-4238-b990-bcc8742a4205 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:56.764072 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfce755-88ee-4238-b990-bcc8742a4205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:56.764456 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfce755-88ee-4238-b990-bcc8742a4205 admin admin] PATH_INFO: `/v3/users/ef8cd1939ab54c36a6b4f063f716a962` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:56.766806 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfce755-88ee-4238-b990-bcc8742a4205 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef8cd1939ab54c36a6b4f063f716a962)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:56.768788 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfce755-88ee-4238-b990-bcc8742a4205 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:56.831345 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-2dfce755-88ee-4238-b990-bcc8742a4205 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef8cd1939ab54c36a6b4f063f716a962'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:56.832336 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-2dfce755-88ee-4238-b990-bcc8742a4205 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef8cd1939ab54c36a6b4f063f716a962'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:56.846793 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-2dfce755-88ee-4238-b990-bcc8742a4205 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef8cd1939ab54c36a6b4f063f716a962'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:56.854279 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-2dfce755-88ee-4238-b990-bcc8742a4205 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef8cd1939ab54c36a6b4f063f716a962'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:56.863570 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-2dfce755-88ee-4238-b990-bcc8742a4205 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef8cd1939ab54c36a6b4f063f716a962'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:56.871514 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1378/2734] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:41:56 2022] DELETE /identity/v3/users/ef8cd1939ab54c36a6b4f063f716a962 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:41:56.876045 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cddd76-0a57-4d39-b04f-999f4b567b3b None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:56.876537 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cddd76-0a57-4d39-b04f-999f4b567b3b None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:56.876651 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cddd76-0a57-4d39-b04f-999f4b567b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:56.894827 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-b8cddd76-0a57-4d39-b04f-999f4b567b3b None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:41:56.895960 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-b8cddd76-0a57-4d39-b04f-999f4b567b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:56.954868 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1357/2735] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:41:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:41:56.964280 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfce755-88ee-4238-b990-bcc8742a4205 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:56.965784 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-2dfce755-88ee-4238-b990-bcc8742a4205 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:57.018076 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:57.024911 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfce755-88ee-4238-b990-bcc8742a4205 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:57.030256 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffbcd19-302a-44c4-b7dd-d81e4445bbce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:57.030892 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffbcd19-302a-44c4-b7dd-d81e4445bbce service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:57.031177 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffbcd19-302a-44c4-b7dd-d81e4445bbce service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:57.031453 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffbcd19-302a-44c4-b7dd-d81e4445bbce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:57.040653 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffbcd19-302a-44c4-b7dd-d81e4445bbce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:57.042109 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffbcd19-302a-44c4-b7dd-d81e4445bbce service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:57.051790 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1379/2736] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:41:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:41:57.359560 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cddd76-0a57-4d39-b04f-999f4b567b3b None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:57.361080 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-b8cddd76-0a57-4d39-b04f-999f4b567b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:57.374058 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cddd76-0a57-4d39-b04f-999f4b567b3b None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:57.379422 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62074a30-638e-4be7-a323-6b75f74dc5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:57.380606 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62074a30-638e-4be7-a323-6b75f74dc5a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:57.380734 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62074a30-638e-4be7-a323-6b75f74dc5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:57.380993 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62074a30-638e-4be7-a323-6b75f74dc5a4 admin admin] PATH_INFO: `/v3/projects/b543a84669084ff0add2c3f7f8e80432` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:57.382301 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62074a30-638e-4be7-a323-6b75f74dc5a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b543a84669084ff0add2c3f7f8e80432)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:57.384826 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62074a30-638e-4be7-a323-6b75f74dc5a4 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:57.415018 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:57.440759 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-62074a30-638e-4be7-a323-6b75f74dc5a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b543a84669084ff0add2c3f7f8e80432', 'request_id': 'req-62074a30-638e-4be7-a323-6b75f74dc5a4'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:57.446491 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-62074a30-638e-4be7-a323-6b75f74dc5a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b543a84669084ff0add2c3f7f8e80432', 'request_id': 'req-62074a30-638e-4be7-a323-6b75f74dc5a4'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:57.452921 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-62074a30-638e-4be7-a323-6b75f74dc5a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b543a84669084ff0add2c3f7f8e80432', 'request_id': 'req-62074a30-638e-4be7-a323-6b75f74dc5a4'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:57.467177 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-62074a30-638e-4be7-a323-6b75f74dc5a4 admin admin] The token cache is being invalidate because project b543a84669084ff0add2c3f7f8e80432 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:41:57.467548 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-62074a30-638e-4be7-a323-6b75f74dc5a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:57.468242 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-62074a30-638e-4be7-a323-6b75f74dc5a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:57.469880 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1358/2737] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:41:57 2022] DELETE /identity/v3/projects/b543a84669084ff0add2c3f7f8e80432 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:41:57.473998 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffbcd19-302a-44c4-b7dd-d81e4445bbce service neutron] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:57.484376 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffbcd19-302a-44c4-b7dd-d81e4445bbce service neutron] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:57.548306 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ace94f-4e05-4d58-a24c-0370ff0c6022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:57.549181 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ace94f-4e05-4d58-a24c-0370ff0c6022 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:57.549494 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ace94f-4e05-4d58-a24c-0370ff0c6022 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:57.549772 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ace94f-4e05-4d58-a24c-0370ff0c6022 admin admin] PATH_INFO: `/v3/users/c98b1d77887e433cbc1236f812ee0310` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:57.550968 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ace94f-4e05-4d58-a24c-0370ff0c6022 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c98b1d77887e433cbc1236f812ee0310)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:57.552885 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ace94f-4e05-4d58-a24c-0370ff0c6022 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:57.601716 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-44ace94f-4e05-4d58-a24c-0370ff0c6022 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c98b1d77887e433cbc1236f812ee0310'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:57.602431 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-44ace94f-4e05-4d58-a24c-0370ff0c6022 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c98b1d77887e433cbc1236f812ee0310'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:57.614936 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-44ace94f-4e05-4d58-a24c-0370ff0c6022 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c98b1d77887e433cbc1236f812ee0310'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:57.624918 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-44ace94f-4e05-4d58-a24c-0370ff0c6022 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c98b1d77887e433cbc1236f812ee0310'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:57.639024 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-44ace94f-4e05-4d58-a24c-0370ff0c6022 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c98b1d77887e433cbc1236f812ee0310'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:57.643094 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1380/2738] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:41:57 2022] DELETE /identity/v3/users/c98b1d77887e433cbc1236f812ee0310 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:41:58.115577 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62074a30-638e-4be7-a323-6b75f74dc5a4 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:58.117154 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-62074a30-638e-4be7-a323-6b75f74dc5a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:58.132031 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62074a30-638e-4be7-a323-6b75f74dc5a4 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:58.228703 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2d5630-feef-42df-abc7-b69b34028de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:58.229872 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d5630-feef-42df-abc7-b69b34028de8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:58.230161 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d5630-feef-42df-abc7-b69b34028de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:58.230439 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d5630-feef-42df-abc7-b69b34028de8 admin admin] PATH_INFO: `/v3/projects/d3e4fa93c1234c689377d836251ef816` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:58.232356 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2d5630-feef-42df-abc7-b69b34028de8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3e4fa93c1234c689377d836251ef816)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:58.235395 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2d5630-feef-42df-abc7-b69b34028de8 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:58.288578 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-6a2d5630-feef-42df-abc7-b69b34028de8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3e4fa93c1234c689377d836251ef816', 'request_id': 'req-6a2d5630-feef-42df-abc7-b69b34028de8'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:58.298316 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-6a2d5630-feef-42df-abc7-b69b34028de8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3e4fa93c1234c689377d836251ef816', 'request_id': 'req-6a2d5630-feef-42df-abc7-b69b34028de8'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:58.308075 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-6a2d5630-feef-42df-abc7-b69b34028de8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3e4fa93c1234c689377d836251ef816', 'request_id': 'req-6a2d5630-feef-42df-abc7-b69b34028de8'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:58.326133 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-6a2d5630-feef-42df-abc7-b69b34028de8 admin admin] The token cache is being invalidate because project d3e4fa93c1234c689377d836251ef816 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:41:58.326133 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-6a2d5630-feef-42df-abc7-b69b34028de8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:58.326674 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-6a2d5630-feef-42df-abc7-b69b34028de8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:58.328266 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1359/2739] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:41:58 2022] DELETE /identity/v3/projects/d3e4fa93c1234c689377d836251ef816 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:41:58.333155 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be6978-4f60-4253-84d2-9db109dfaaa2 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:58.334245 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be6978-4f60-4253-84d2-9db109dfaaa2 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:58.334783 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be6978-4f60-4253-84d2-9db109dfaaa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:58.357925 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-d8be6978-4f60-4253-84d2-9db109dfaaa2 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:41:58.359284 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-d8be6978-4f60-4253-84d2-9db109dfaaa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:58.427973 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1381/2740] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:41:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:41:58.436454 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87347dd6-616b-4ab4-933f-c0e0bb54a56a None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:58.436795 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87347dd6-616b-4ab4-933f-c0e0bb54a56a None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:58.437144 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87347dd6-616b-4ab4-933f-c0e0bb54a56a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:58.456625 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-87347dd6-616b-4ab4-933f-c0e0bb54a56a None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:41:58.457867 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-87347dd6-616b-4ab4-933f-c0e0bb54a56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:58.466092 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1360/2741] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:41:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:41:58.470525 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8be6978-4f60-4253-84d2-9db109dfaaa2 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:58.486967 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8be6978-4f60-4253-84d2-9db109dfaaa2 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:58.493001 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0cbd45-4279-45a8-b474-5a31e7ff5c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:58.493593 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0cbd45-4279-45a8-b474-5a31e7ff5c7f admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:58.493730 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0cbd45-4279-45a8-b474-5a31e7ff5c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:58.493953 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0cbd45-4279-45a8-b474-5a31e7ff5c7f admin admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:58.495655 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0cbd45-4279-45a8-b474-5a31e7ff5c7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:41:58.495655 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0cbd45-4279-45a8-b474-5a31e7ff5c7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:58.497069 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0cbd45-4279-45a8-b474-5a31e7ff5c7f admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:58.500876 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:58.514275 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1382/2742] 10.222.0.26 () {58 vars in 1152 bytes} [Fri Jul 1 19:41:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:41:58.518420 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87347dd6-616b-4ab4-933f-c0e0bb54a56a None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:58.529423 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87347dd6-616b-4ab4-933f-c0e0bb54a56a None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:58.534559 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed65e9c2-a7d6-417a-ad78-4ed438a1bb9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:58.535260 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65e9c2-a7d6-417a-ad78-4ed438a1bb9a admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:58.535531 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65e9c2-a7d6-417a-ad78-4ed438a1bb9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:58.535814 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65e9c2-a7d6-417a-ad78-4ed438a1bb9a admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:58.536533 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed65e9c2-a7d6-417a-ad78-4ed438a1bb9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:58.538578 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed65e9c2-a7d6-417a-ad78-4ed438a1bb9a admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:58.579308 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1361/2743] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:41:58 2022] POST /identity/v3/projects => generated 375 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 19:41:58.580149 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0cbd45-4279-45a8-b474-5a31e7ff5c7f admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:58.593907 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0cbd45-4279-45a8-b474-5a31e7ff5c7f admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:58.690412 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eea047-9973-4fe1-936a-79f79fc1282c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:58.691109 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eea047-9973-4fe1-936a-79f79fc1282c admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:58.691420 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eea047-9973-4fe1-936a-79f79fc1282c admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:58.691705 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eea047-9973-4fe1-936a-79f79fc1282c admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:58.692598 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eea047-9973-4fe1-936a-79f79fc1282c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:58.694958 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eea047-9973-4fe1-936a-79f79fc1282c admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:58.724579 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1383/2744] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:41:58 2022] POST /identity/v3/users => generated 288 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 19:41:58.729475 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed65e9c2-a7d6-417a-ad78-4ed438a1bb9a admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:58.745536 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed65e9c2-a7d6-417a-ad78-4ed438a1bb9a admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:58.755239 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a963390a-0b08-49b3-8101-b704c3deb1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:58.755928 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a963390a-0b08-49b3-8101-b704c3deb1e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:58.756216 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a963390a-0b08-49b3-8101-b704c3deb1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:58.756496 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a963390a-0b08-49b3-8101-b704c3deb1e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:58.757247 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a963390a-0b08-49b3-8101-b704c3deb1e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:58.758898 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a963390a-0b08-49b3-8101-b704c3deb1e6 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:58.765192 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:58.773288 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1362/2745] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:41:58 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:41:58.775901 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eea047-9973-4fe1-936a-79f79fc1282c admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:58.788840 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eea047-9973-4fe1-936a-79f79fc1282c admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:58.798227 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c9fef-5022-48ff-b885-1102b0d0aaa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:58.798933 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c9fef-5022-48ff-b885-1102b0d0aaa3 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:58.799280 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c9fef-5022-48ff-b885-1102b0d0aaa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:58.799566 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c9fef-5022-48ff-b885-1102b0d0aaa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:58.800351 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6c9fef-5022-48ff-b885-1102b0d0aaa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:58.802003 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6c9fef-5022-48ff-b885-1102b0d0aaa3 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:58.816314 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1384/2746] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:41:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:41:58.817872 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a963390a-0b08-49b3-8101-b704c3deb1e6 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:58.829627 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a963390a-0b08-49b3-8101-b704c3deb1e6 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:58.835436 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36fcf49-a55b-45c8-bb7e-22aeded99026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:58.836351 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36fcf49-a55b-45c8-bb7e-22aeded99026 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:58.836640 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36fcf49-a55b-45c8-bb7e-22aeded99026 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:58.836921 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36fcf49-a55b-45c8-bb7e-22aeded99026 admin admin] PATH_INFO: `/v3/projects/32b005f270a6464dbf7852ab645c26e0/users/16602d83996642f48df0a405a1cf5eca/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:58.855455 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36fcf49-a55b-45c8-bb7e-22aeded99026 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32b005f270a6464dbf7852ab645c26e0, user_id=16602d83996642f48df0a405a1cf5eca, role_id=4cbf6ec846eb4b7c8cc52e9bfd6f076f)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:58.858959 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36fcf49-a55b-45c8-bb7e-22aeded99026 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:58.874699 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1363/2747] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:41:58 2022] PUT /identity/v3/projects/32b005f270a6464dbf7852ab645c26e0/users/16602d83996642f48df0a405a1cf5eca/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:41:58.888857 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055e7a2-74d6-4292-a731-13140d753711 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:58.889502 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055e7a2-74d6-4292-a731-13140d753711 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:58.889813 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055e7a2-74d6-4292-a731-13140d753711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:58.923060 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-0055e7a2-74d6-4292-a731-13140d753711 None None] MFA Rules not processed for user `16602d83996642f48df0a405a1cf5eca`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:41:58.925103 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-0055e7a2-74d6-4292-a731-13140d753711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:59.005400 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1385/2748] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:41:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:41:59.032694 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36fcf49-a55b-45c8-bb7e-22aeded99026 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:59.034875 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-c36fcf49-a55b-45c8-bb7e-22aeded99026 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:59.126140 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36fcf49-a55b-45c8-bb7e-22aeded99026 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:59.134698 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e1445-152d-464c-81ef-add4e3c5f51a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a3ed285ee4c4d04abf7daf0aeb9fb7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:59.135371 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e1445-152d-464c-81ef-add4e3c5f51a service cinder] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:59.135655 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e1445-152d-464c-81ef-add4e3c5f51a service cinder] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:59.135931 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e1445-152d-464c-81ef-add4e3c5f51a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:59.146040 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3e1445-152d-464c-81ef-add4e3c5f51a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:59.147622 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3e1445-152d-464c-81ef-add4e3c5f51a service cinder] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:59.167050 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1364/2749] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:41:59 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:42:00.587994 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f5830-8fb7-422b-8b51-214107a1a6b8 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:00.588553 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f5830-8fb7-422b-8b51-214107a1a6b8 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:00.588671 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f5830-8fb7-422b-8b51-214107a1a6b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:00.610377 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-9f3f5830-8fb7-422b-8b51-214107a1a6b8 None None] MFA Rules not processed for user `16602d83996642f48df0a405a1cf5eca`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:42:00.611648 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-9f3f5830-8fb7-422b-8b51-214107a1a6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:42:00.618502 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1386/2750] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:42:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:42:09.162662 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=36,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:42:10.603655 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=71,keystone:INSERT=3 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:42:16.521673 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e65c2c-0764-4474-bea0-7096785e901e None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:16.522239 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e65c2c-0764-4474-bea0-7096785e901e None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:16.522239 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e65c2c-0764-4474-bea0-7096785e901e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:16.539924 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-e1e65c2c-0764-4474-bea0-7096785e901e None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:42:16.541124 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-e1e65c2c-0764-4474-bea0-7096785e901e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:42:16.599439 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1365/2751] 10.222.0.55 () {58 vars in 1016 bytes} [Fri Jul 1 19:42:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:42:16.623320 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f5830-8fb7-422b-8b51-214107a1a6b8 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:42:16.624888 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-9f3f5830-8fb7-422b-8b51-214107a1a6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:42:16.699221 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f5830-8fb7-422b-8b51-214107a1a6b8 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:42:16.705355 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53985777-d7e5-4e60-835e-a32179a13fb2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13fd76fc7dd1410b9cde5adbaa6cb2e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:42:16.706024 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53985777-d7e5-4e60-835e-a32179a13fb2 service nova] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:16.706308 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53985777-d7e5-4e60-835e-a32179a13fb2 service nova] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:16.706590 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53985777-d7e5-4e60-835e-a32179a13fb2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:16.716203 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53985777-d7e5-4e60-835e-a32179a13fb2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:42:16.717940 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53985777-d7e5-4e60-835e-a32179a13fb2 service nova] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:42:16.727803 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1387/2752] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:42:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:42:17.253374 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e1f3e-0579-47ad-a272-7a56ec47e505 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:17.253675 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e1f3e-0579-47ad-a272-7a56ec47e505 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:17.253961 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e1f3e-0579-47ad-a272-7a56ec47e505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:17.271970 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-e58e1f3e-0579-47ad-a272-7a56ec47e505 None None] MFA Rules not processed for user `0834256bdfbc48ffbc5af6d6760ecdd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:42:17.273157 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-e58e1f3e-0579-47ad-a272-7a56ec47e505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:42:17.327722 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1366/2753] 10.222.0.26 () {58 vars in 1009 bytes} [Fri Jul 1 19:42:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:42:17.339667 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53985777-d7e5-4e60-835e-a32179a13fb2 service nova] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:42:17.341717 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-53985777-d7e5-4e60-835e-a32179a13fb2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:42:17.413163 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53985777-d7e5-4e60-835e-a32179a13fb2 service nova] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:42:17.418083 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b83fd3-8013-4986-b32e-5a9aaadecb5e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e958c5b03a9346d59c32675c5271bf3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:42:17.418750 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b83fd3-8013-4986-b32e-5a9aaadecb5e service swift] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:17.419116 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b83fd3-8013-4986-b32e-5a9aaadecb5e service swift] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:17.419403 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b83fd3-8013-4986-b32e-5a9aaadecb5e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:17.427379 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b83fd3-8013-4986-b32e-5a9aaadecb5e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:42:17.428959 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b83fd3-8013-4986-b32e-5a9aaadecb5e service swift] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:42:17.437504 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1388/2754] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Jul 1 19:42:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 01 19:42:17.940249 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e3ab38-795b-485a-940e-6d9cf50f1607 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:17.940726 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e3ab38-795b-485a-940e-6d9cf50f1607 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:17.940827 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e3ab38-795b-485a-940e-6d9cf50f1607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:17.958054 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-75e3ab38-795b-485a-940e-6d9cf50f1607 None None] MFA Rules not processed for user `0834256bdfbc48ffbc5af6d6760ecdd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:42:17.959229 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-75e3ab38-795b-485a-940e-6d9cf50f1607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:42:17.968367 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1367/2755] 10.222.0.26 () {58 vars in 967 bytes} [Fri Jul 1 19:42:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:42:17.980201 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b83fd3-8013-4986-b32e-5a9aaadecb5e service swift] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:42:17.991218 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b83fd3-8013-4986-b32e-5a9aaadecb5e service swift] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:42:17.996256 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3695663-5234-4077-8c8a-4e3512c71e48 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e958c5b03a9346d59c32675c5271bf3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:42:17.997462 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3695663-5234-4077-8c8a-4e3512c71e48 service swift] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:17.997752 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3695663-5234-4077-8c8a-4e3512c71e48 service swift] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:17.998033 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3695663-5234-4077-8c8a-4e3512c71e48 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:18.006113 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3695663-5234-4077-8c8a-4e3512c71e48 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:42:18.007687 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3695663-5234-4077-8c8a-4e3512c71e48 service swift] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:42:18.015783 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1389/2756] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Jul 1 19:42:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 01 19:42:18.208744 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267102e-fd08-4cf8-b751-3715beb6dfb1 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:18.209029 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267102e-fd08-4cf8-b751-3715beb6dfb1 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:18.209347 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267102e-fd08-4cf8-b751-3715beb6dfb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:18.226721 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-2267102e-fd08-4cf8-b751-3715beb6dfb1 None None] MFA Rules not processed for user `0834256bdfbc48ffbc5af6d6760ecdd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:42:18.227905 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-2267102e-fd08-4cf8-b751-3715beb6dfb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:42:18.235630 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1368/2757] 10.222.0.26 () {58 vars in 1009 bytes} [Fri Jul 1 19:42:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:42:18.250462 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3695663-5234-4077-8c8a-4e3512c71e48 service swift] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:42:18.262014 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3695663-5234-4077-8c8a-4e3512c71e48 service swift] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:42:18.268126 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06262eaf-7dcf-4dae-8363-c85f09644e04 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e958c5b03a9346d59c32675c5271bf3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:42:18.268774 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06262eaf-7dcf-4dae-8363-c85f09644e04 service swift] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:18.269056 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06262eaf-7dcf-4dae-8363-c85f09644e04 service swift] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:18.269370 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06262eaf-7dcf-4dae-8363-c85f09644e04 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:18.278782 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06262eaf-7dcf-4dae-8363-c85f09644e04 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:42:18.280350 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06262eaf-7dcf-4dae-8363-c85f09644e04 service swift] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:42:18.288747 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1390/2758] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Jul 1 19:42:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 01 19:42:18.611622 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004f1b0-d0e1-4c0a-b40e-2d12c2e51932 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:18.611915 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004f1b0-d0e1-4c0a-b40e-2d12c2e51932 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:18.612195 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004f1b0-d0e1-4c0a-b40e-2d12c2e51932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:18.630474 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-2004f1b0-d0e1-4c0a-b40e-2d12c2e51932 None None] MFA Rules not processed for user `0834256bdfbc48ffbc5af6d6760ecdd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:42:18.631668 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-2004f1b0-d0e1-4c0a-b40e-2d12c2e51932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:42:18.639997 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1369/2759] 10.222.0.26 () {58 vars in 967 bytes} [Fri Jul 1 19:42:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:42:18.652060 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06262eaf-7dcf-4dae-8363-c85f09644e04 service swift] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:42:18.663559 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06262eaf-7dcf-4dae-8363-c85f09644e04 service swift] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:42:18.668480 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d0841b-8627-4bd4-ae18-867fcb3d3f11 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e958c5b03a9346d59c32675c5271bf3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:42:18.669663 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0841b-8627-4bd4-ae18-867fcb3d3f11 service swift] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:18.669950 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0841b-8627-4bd4-ae18-867fcb3d3f11 service swift] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:18.670275 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0841b-8627-4bd4-ae18-867fcb3d3f11 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:18.678309 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d0841b-8627-4bd4-ae18-867fcb3d3f11 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:42:18.680035 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d0841b-8627-4bd4-ae18-867fcb3d3f11 service swift] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:42:18.688272 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1391/2760] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Jul 1 19:42:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 01 19:42:19.589876 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c5e3e-1d66-4d29-9ac4-87f7ddcf63bc None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:19.590387 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c5e3e-1d66-4d29-9ac4-87f7ddcf63bc None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:19.590802 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c5e3e-1d66-4d29-9ac4-87f7ddcf63bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:19.610549 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-7e1c5e3e-1d66-4d29-9ac4-87f7ddcf63bc None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:42:19.611732 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-7e1c5e3e-1d66-4d29-9ac4-87f7ddcf63bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:42:19.620666 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1370/2761] 10.222.0.55 () {58 vars in 1016 bytes} [Fri Jul 1 19:42:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:42:19.646531 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d0841b-8627-4bd4-ae18-867fcb3d3f11 service swift] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:42:19.658508 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d0841b-8627-4bd4-ae18-867fcb3d3f11 service swift] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:42:19.664516 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20edaad-b2b0-4f4b-87e3-fa4160f4ea66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13fd76fc7dd1410b9cde5adbaa6cb2e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:42:19.665284 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20edaad-b2b0-4f4b-87e3-fa4160f4ea66 service nova] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:19.665640 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20edaad-b2b0-4f4b-87e3-fa4160f4ea66 service nova] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:19.665979 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20edaad-b2b0-4f4b-87e3-fa4160f4ea66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:19.675293 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20edaad-b2b0-4f4b-87e3-fa4160f4ea66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:42:19.677101 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20edaad-b2b0-4f4b-87e3-fa4160f4ea66 service nova] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:42:19.689149 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1392/2762] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:42:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:42:20.771318 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c5e3e-1d66-4d29-9ac4-87f7ddcf63bc None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:42:20.780959 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c5e3e-1d66-4d29-9ac4-87f7ddcf63bc None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:42:20.786008 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59316516-d336-4801-b32b-8b346992cb2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:42:20.786875 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59316516-d336-4801-b32b-8b346992cb2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:20.787156 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59316516-d336-4801-b32b-8b346992cb2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:20.787431 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59316516-d336-4801-b32b-8b346992cb2f admin admin] PATH_INFO: `/v3/users/16602d83996642f48df0a405a1cf5eca` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:20.788651 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59316516-d336-4801-b32b-8b346992cb2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=16602d83996642f48df0a405a1cf5eca)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:42:20.790625 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59316516-d336-4801-b32b-8b346992cb2f admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:42:20.838618 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-59316516-d336-4801-b32b-8b346992cb2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16602d83996642f48df0a405a1cf5eca'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:20.839268 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-59316516-d336-4801-b32b-8b346992cb2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16602d83996642f48df0a405a1cf5eca'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:20.846121 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-59316516-d336-4801-b32b-8b346992cb2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16602d83996642f48df0a405a1cf5eca'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:20.852885 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-59316516-d336-4801-b32b-8b346992cb2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16602d83996642f48df0a405a1cf5eca'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:20.853522 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-59316516-d336-4801-b32b-8b346992cb2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16602d83996642f48df0a405a1cf5eca'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:20.861222 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:42:20.873037 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1371/2763] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:42:20 2022] DELETE /identity/v3/users/16602d83996642f48df0a405a1cf5eca => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:42:20.877619 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f4c4c-9ac1-4abe-9c9e-22102b82b1e1 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:20.878108 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f4c4c-9ac1-4abe-9c9e-22102b82b1e1 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:20.878225 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f4c4c-9ac1-4abe-9c9e-22102b82b1e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:20.895835 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-5d8f4c4c-9ac1-4abe-9c9e-22102b82b1e1 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:42:20.897024 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-5d8f4c4c-9ac1-4abe-9c9e-22102b82b1e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:42:20.914962 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:42:20.957673 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1393/2764] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:42:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:42:20.967019 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59316516-d336-4801-b32b-8b346992cb2f admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:42:20.968418 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-59316516-d336-4801-b32b-8b346992cb2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:42:21.027793 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59316516-d336-4801-b32b-8b346992cb2f admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:42:21.031879 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74631bb7-1a5a-494a-8ef7-79f48bb79862 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:42:21.032527 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74631bb7-1a5a-494a-8ef7-79f48bb79862 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:21.032818 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74631bb7-1a5a-494a-8ef7-79f48bb79862 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:21.033100 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74631bb7-1a5a-494a-8ef7-79f48bb79862 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:21.042558 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74631bb7-1a5a-494a-8ef7-79f48bb79862 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:42:21.043996 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74631bb7-1a5a-494a-8ef7-79f48bb79862 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:42:21.053473 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1372/2765] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:42:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:42:21.225077 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f4c4c-9ac1-4abe-9c9e-22102b82b1e1 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:42:21.227062 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-5d8f4c4c-9ac1-4abe-9c9e-22102b82b1e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:42:21.262421 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f4c4c-9ac1-4abe-9c9e-22102b82b1e1 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:42:21.268096 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd6fa61-b80b-4743-bf8f-283bed292c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:42:21.269142 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6fa61-b80b-4743-bf8f-283bed292c51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:21.269459 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6fa61-b80b-4743-bf8f-283bed292c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:21.269739 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6fa61-b80b-4743-bf8f-283bed292c51 admin admin] PATH_INFO: `/v3/projects/32b005f270a6464dbf7852ab645c26e0` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:21.270936 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd6fa61-b80b-4743-bf8f-283bed292c51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32b005f270a6464dbf7852ab645c26e0)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:42:21.272850 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd6fa61-b80b-4743-bf8f-283bed292c51 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:42:21.319897 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-9bd6fa61-b80b-4743-bf8f-283bed292c51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32b005f270a6464dbf7852ab645c26e0', 'request_id': 'req-9bd6fa61-b80b-4743-bf8f-283bed292c51'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:21.326331 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-9bd6fa61-b80b-4743-bf8f-283bed292c51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32b005f270a6464dbf7852ab645c26e0', 'request_id': 'req-9bd6fa61-b80b-4743-bf8f-283bed292c51'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:21.331871 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-9bd6fa61-b80b-4743-bf8f-283bed292c51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32b005f270a6464dbf7852ab645c26e0', 'request_id': 'req-9bd6fa61-b80b-4743-bf8f-283bed292c51'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:21.343889 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-9bd6fa61-b80b-4743-bf8f-283bed292c51 admin admin] The token cache is being invalidate because project 32b005f270a6464dbf7852ab645c26e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:42:21.344176 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-9bd6fa61-b80b-4743-bf8f-283bed292c51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:21.344786 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-9bd6fa61-b80b-4743-bf8f-283bed292c51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:21.346352 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1394/2766] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:42:21 2022] DELETE /identity/v3/projects/32b005f270a6464dbf7852ab645c26e0 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:42:22.846715 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ba2be-2712-4ed3-910a-86621e434779 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:22.847278 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ba2be-2712-4ed3-910a-86621e434779 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:22.847278 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ba2be-2712-4ed3-910a-86621e434779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:22.864773 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-b97ba2be-2712-4ed3-910a-86621e434779 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:42:22.866008 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-b97ba2be-2712-4ed3-910a-86621e434779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:42:22.923551 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1373/2767] 10.222.0.55 () {58 vars in 1016 bytes} [Fri Jul 1 19:42:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:42:22.949475 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd6fa61-b80b-4743-bf8f-283bed292c51 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:42:22.950911 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-9bd6fa61-b80b-4743-bf8f-283bed292c51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:42:23.022832 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd6fa61-b80b-4743-bf8f-283bed292c51 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:42:23.028793 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ec0c10-7ef2-4ce6-b1b7-561ef0be65dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13fd76fc7dd1410b9cde5adbaa6cb2e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:42:23.029455 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec0c10-7ef2-4ce6-b1b7-561ef0be65dc service nova] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:23.029741 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec0c10-7ef2-4ce6-b1b7-561ef0be65dc service nova] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:23.030013 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec0c10-7ef2-4ce6-b1b7-561ef0be65dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:23.038436 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ec0c10-7ef2-4ce6-b1b7-561ef0be65dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:42:23.039999 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ec0c10-7ef2-4ce6-b1b7-561ef0be65dc service nova] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:42:23.049807 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1395/2768] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:42:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:42:25.926799 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205653bd-5c2a-4db9-9e93-e442bd49c7cd None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:25.927296 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205653bd-5c2a-4db9-9e93-e442bd49c7cd None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:25.927296 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205653bd-5c2a-4db9-9e93-e442bd49c7cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:25.945677 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-205653bd-5c2a-4db9-9e93-e442bd49c7cd None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:42:25.946864 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-205653bd-5c2a-4db9-9e93-e442bd49c7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:42:25.954590 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1374/2769] 10.222.0.55 () {58 vars in 1016 bytes} [Fri Jul 1 19:42:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:42:25.979591 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ec0c10-7ef2-4ce6-b1b7-561ef0be65dc service nova] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:42:25.981499 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-d0ec0c10-7ef2-4ce6-b1b7-561ef0be65dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:42:25.995807 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ec0c10-7ef2-4ce6-b1b7-561ef0be65dc service nova] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:42:26.002571 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb35f96-8d99-42ee-a42b-797c90ede20d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13fd76fc7dd1410b9cde5adbaa6cb2e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:42:26.003220 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb35f96-8d99-42ee-a42b-797c90ede20d service nova] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:26.003507 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb35f96-8d99-42ee-a42b-797c90ede20d service nova] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:26.003790 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb35f96-8d99-42ee-a42b-797c90ede20d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:26.012228 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb35f96-8d99-42ee-a42b-797c90ede20d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:42:26.013827 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb35f96-8d99-42ee-a42b-797c90ede20d service nova] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:42:26.023188 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1396/2770] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:42:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:42:29.076029 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbdef02-2426-43a8-8690-b35025417204 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:29.076565 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbdef02-2426-43a8-8690-b35025417204 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:29.076565 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbdef02-2426-43a8-8690-b35025417204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:29.093829 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-ffbdef02-2426-43a8-8690-b35025417204 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:42:29.095000 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-ffbdef02-2426-43a8-8690-b35025417204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:42:29.102666 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1375/2771] 10.222.0.55 () {58 vars in 1016 bytes} [Fri Jul 1 19:42:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:42:29.124407 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb35f96-8d99-42ee-a42b-797c90ede20d service nova] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:42:29.135534 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb35f96-8d99-42ee-a42b-797c90ede20d service nova] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:42:29.141876 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4cdd6a-d7cd-439b-af82-88b448e5d544 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13fd76fc7dd1410b9cde5adbaa6cb2e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:42:29.142505 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4cdd6a-d7cd-439b-af82-88b448e5d544 service nova] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:29.142787 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4cdd6a-d7cd-439b-af82-88b448e5d544 service nova] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:29.143062 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4cdd6a-d7cd-439b-af82-88b448e5d544 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:29.151168 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4cdd6a-d7cd-439b-af82-88b448e5d544 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:42:29.152726 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4cdd6a-d7cd-439b-af82-88b448e5d544 service nova] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:42:29.162422 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1397/2772] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:42:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:42:32.236732 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73241b19-6496-48cd-8137-82e8e5f3f140 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:32.237292 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73241b19-6496-48cd-8137-82e8e5f3f140 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:32.237292 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73241b19-6496-48cd-8137-82e8e5f3f140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:32.255694 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-73241b19-6496-48cd-8137-82e8e5f3f140 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:42:32.256884 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-73241b19-6496-48cd-8137-82e8e5f3f140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:42:32.265460 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1376/2773] 10.222.0.55 () {58 vars in 1016 bytes} [Fri Jul 1 19:42:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:42:32.289695 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4cdd6a-d7cd-439b-af82-88b448e5d544 service nova] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:42:32.296430 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:42:32.301012 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4cdd6a-d7cd-439b-af82-88b448e5d544 service nova] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:42:32.308068 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e901ec28-7840-4aa8-963d-d81b65f572bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13fd76fc7dd1410b9cde5adbaa6cb2e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:42:32.308850 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e901ec28-7840-4aa8-963d-d81b65f572bd service nova] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:32.309656 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e901ec28-7840-4aa8-963d-d81b65f572bd service nova] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:32.309936 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e901ec28-7840-4aa8-963d-d81b65f572bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:32.318657 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e901ec28-7840-4aa8-963d-d81b65f572bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:42:32.320265 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e901ec28-7840-4aa8-963d-d81b65f572bd service nova] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:42:32.330852 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1398/2774] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:42:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:42:42.250646 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=65,keystone:DELETE=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:42:42.326455 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=4 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:42:47.403930 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9579c246-ac24-4b56-97f7-cd3b65580fae None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:47.404479 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9579c246-ac24-4b56-97f7-cd3b65580fae None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:47.404592 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9579c246-ac24-4b56-97f7-cd3b65580fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:47.422777 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-9579c246-ac24-4b56-97f7-cd3b65580fae None None] MFA Rules not processed for user `c68dd6198e444d3da12135b17f68dc51`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:42:47.423986 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-9579c246-ac24-4b56-97f7-cd3b65580fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:42:47.478476 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1377/2775] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:42:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:42:57.471709 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=25 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:42:58.890858 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd931693-7002-48d9-8549-c590b0748877 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:58.891371 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd931693-7002-48d9-8549-c590b0748877 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:58.891508 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd931693-7002-48d9-8549-c590b0748877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:58.909650 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-cd931693-7002-48d9-8549-c590b0748877 None None] MFA Rules not processed for user `1eae281b1ee147a09134db72c64282ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:42:58.910843 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-cd931693-7002-48d9-8549-c590b0748877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:42:58.966058 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1399/2776] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:42:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:43:02.310387 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e831a7e2-b33f-4a15-9fb2-74b11c387e26 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:43:02.310960 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e831a7e2-b33f-4a15-9fb2-74b11c387e26 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:43:02.311090 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e831a7e2-b33f-4a15-9fb2-74b11c387e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:43:02.335419 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-e831a7e2-b33f-4a15-9fb2-74b11c387e26 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:43:02.337634 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-e831a7e2-b33f-4a15-9fb2-74b11c387e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:43:02.346653 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1378/2777] 10.222.0.55 () {58 vars in 1016 bytes} [Fri Jul 1 19:43:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:43:02.368867 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd931693-7002-48d9-8549-c590b0748877 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:43:02.384278 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd931693-7002-48d9-8549-c590b0748877 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:43:02.391335 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf0ae9f-a2e8-4421-a0c2-a633ed2fae6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13fd76fc7dd1410b9cde5adbaa6cb2e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:43:02.392008 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf0ae9f-a2e8-4421-a0c2-a633ed2fae6f service nova] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:43:02.392300 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf0ae9f-a2e8-4421-a0c2-a633ed2fae6f service nova] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:43:02.392573 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf0ae9f-a2e8-4421-a0c2-a633ed2fae6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:43:02.403004 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf0ae9f-a2e8-4421-a0c2-a633ed2fae6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:43:02.404684 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf0ae9f-a2e8-4421-a0c2-a633ed2fae6f service nova] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:43:02.417545 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1400/2778] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:43:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:43:05.560361 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a334d-7146-4886-a5ce-79f76041588c None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:43:05.560906 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a334d-7146-4886-a5ce-79f76041588c None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:43:05.560906 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a334d-7146-4886-a5ce-79f76041588c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:43:05.579214 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-b17a334d-7146-4886-a5ce-79f76041588c None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:43:05.580407 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-b17a334d-7146-4886-a5ce-79f76041588c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:43:05.588168 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1379/2779] 10.222.0.55 () {58 vars in 1016 bytes} [Fri Jul 1 19:43:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:43:05.607305 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf0ae9f-a2e8-4421-a0c2-a633ed2fae6f service nova] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:43:05.619085 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf0ae9f-a2e8-4421-a0c2-a633ed2fae6f service nova] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:43:05.626990 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f0a4c0-e163-4fd0-b7c3-9cfc4e0e95e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13fd76fc7dd1410b9cde5adbaa6cb2e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:43:05.627913 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0a4c0-e163-4fd0-b7c3-9cfc4e0e95e9 service nova] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:43:05.628329 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0a4c0-e163-4fd0-b7c3-9cfc4e0e95e9 service nova] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:43:05.628753 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0a4c0-e163-4fd0-b7c3-9cfc4e0e95e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:43:05.653730 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f0a4c0-e163-4fd0-b7c3-9cfc4e0e95e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:43:05.653730 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f0a4c0-e163-4fd0-b7c3-9cfc4e0e95e9 service nova] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:43:05.659076 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1401/2780] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:43:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:43:08.636372 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2baeb-f316-479e-9884-4fa0cce5e915 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:43:08.636906 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2baeb-f316-479e-9884-4fa0cce5e915 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:43:08.637060 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2baeb-f316-479e-9884-4fa0cce5e915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:43:08.656150 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-63f2baeb-f316-479e-9884-4fa0cce5e915 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:43:08.657376 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-63f2baeb-f316-479e-9884-4fa0cce5e915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:43:08.666433 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1380/2781] 10.222.0.55 () {58 vars in 1016 bytes} [Fri Jul 1 19:43:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:43:08.686725 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f0a4c0-e163-4fd0-b7c3-9cfc4e0e95e9 service nova] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:43:08.698161 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f0a4c0-e163-4fd0-b7c3-9cfc4e0e95e9 service nova] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:43:08.704575 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8cb332-0ee3-4ab1-9279-ec3aeec1013c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13fd76fc7dd1410b9cde5adbaa6cb2e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:43:08.705225 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8cb332-0ee3-4ab1-9279-ec3aeec1013c service nova] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:43:08.705540 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8cb332-0ee3-4ab1-9279-ec3aeec1013c service nova] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:43:08.705865 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8cb332-0ee3-4ab1-9279-ec3aeec1013c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:43:08.715194 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8cb332-0ee3-4ab1-9279-ec3aeec1013c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:43:08.716802 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8cb332-0ee3-4ab1-9279-ec3aeec1013c service nova] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:43:08.730316 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1402/2782] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:43:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:43:11.818346 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0e69a-ecd1-41d4-8941-13a3db30278b None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:43:11.818889 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0e69a-ecd1-41d4-8941-13a3db30278b None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:43:11.818889 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0e69a-ecd1-41d4-8941-13a3db30278b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:43:11.839630 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-ccf0e69a-ecd1-41d4-8941-13a3db30278b None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:43:11.840841 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-ccf0e69a-ecd1-41d4-8941-13a3db30278b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:43:11.848796 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1381/2783] 10.222.0.55 () {58 vars in 1016 bytes} [Fri Jul 1 19:43:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:43:11.870930 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8cb332-0ee3-4ab1-9279-ec3aeec1013c service nova] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:43:11.883474 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8cb332-0ee3-4ab1-9279-ec3aeec1013c service nova] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:43:11.889388 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745fbfbf-c492-4287-8d2b-b66cb561d1f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13fd76fc7dd1410b9cde5adbaa6cb2e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:43:11.890515 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745fbfbf-c492-4287-8d2b-b66cb561d1f8 service nova] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:43:11.890805 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745fbfbf-c492-4287-8d2b-b66cb561d1f8 service nova] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:43:11.891088 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745fbfbf-c492-4287-8d2b-b66cb561d1f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:43:11.899961 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745fbfbf-c492-4287-8d2b-b66cb561d1f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:43:11.901630 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745fbfbf-c492-4287-8d2b-b66cb561d1f8 service nova] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:43:11.912175 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1403/2784] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:43:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:43:14.959527 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d225394-9e91-41ed-9dbf-f90b2cae76c4 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:43:14.960034 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d225394-9e91-41ed-9dbf-f90b2cae76c4 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:43:14.960034 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d225394-9e91-41ed-9dbf-f90b2cae76c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:43:14.977609 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-4d225394-9e91-41ed-9dbf-f90b2cae76c4 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:43:14.978806 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-4d225394-9e91-41ed-9dbf-f90b2cae76c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:43:14.986810 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1382/2785] 10.222.0.55 () {58 vars in 1016 bytes} [Fri Jul 1 19:43:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:43:15.007144 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745fbfbf-c492-4287-8d2b-b66cb561d1f8 service nova] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:43:15.018908 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745fbfbf-c492-4287-8d2b-b66cb561d1f8 service nova] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:43:15.024378 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367a1aa5-55db-4a8c-9376-9b1e59219efc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13fd76fc7dd1410b9cde5adbaa6cb2e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:43:15.025037 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a1aa5-55db-4a8c-9376-9b1e59219efc service nova] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:43:15.025429 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a1aa5-55db-4a8c-9376-9b1e59219efc service nova] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:43:15.025716 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a1aa5-55db-4a8c-9376-9b1e59219efc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:43:15.034085 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367a1aa5-55db-4a8c-9376-9b1e59219efc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:43:15.035650 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367a1aa5-55db-4a8c-9376-9b1e59219efc service nova] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:43:15.045103 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1404/2786] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:43:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:43:24.972489 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=15 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:43:25.040833 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=55 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:43:42.661519 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d225394-9e91-41ed-9dbf-f90b2cae76c4 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:43:42.663011 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-4d225394-9e91-41ed-9dbf-f90b2cae76c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:43:42.676092 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d225394-9e91-41ed-9dbf-f90b2cae76c4 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:43:42.680707 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0823900-f23a-4b90-a07c-7623fe7d3985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:43:42.681610 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0823900-f23a-4b90-a07c-7623fe7d3985 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:43:42.681891 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0823900-f23a-4b90-a07c-7623fe7d3985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:43:42.682279 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0823900-f23a-4b90-a07c-7623fe7d3985 admin admin] PATH_INFO: `/v3/users/c68dd6198e444d3da12135b17f68dc51` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:43:42.683941 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0823900-f23a-4b90-a07c-7623fe7d3985 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c68dd6198e444d3da12135b17f68dc51)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:43:42.685914 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0823900-f23a-4b90-a07c-7623fe7d3985 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:43:42.738120 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-e0823900-f23a-4b90-a07c-7623fe7d3985 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c68dd6198e444d3da12135b17f68dc51'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:43:42.738686 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-e0823900-f23a-4b90-a07c-7623fe7d3985 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c68dd6198e444d3da12135b17f68dc51'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:43:42.745779 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-e0823900-f23a-4b90-a07c-7623fe7d3985 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c68dd6198e444d3da12135b17f68dc51'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:43:42.752932 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-e0823900-f23a-4b90-a07c-7623fe7d3985 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c68dd6198e444d3da12135b17f68dc51'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:43:42.753553 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-e0823900-f23a-4b90-a07c-7623fe7d3985 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c68dd6198e444d3da12135b17f68dc51'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:43:42.770447 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1383/2787] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:43:42 2022] DELETE /identity/v3/users/c68dd6198e444d3da12135b17f68dc51 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:43:42.947182 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367a1aa5-55db-4a8c-9376-9b1e59219efc service nova] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:43:42.958586 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367a1aa5-55db-4a8c-9376-9b1e59219efc service nova] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:43:43.016689 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af89f030-7fc2-43df-b274-ccc34b31569e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:43:43.018379 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89f030-7fc2-43df-b274-ccc34b31569e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:43:43.018708 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89f030-7fc2-43df-b274-ccc34b31569e admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:43:43.019044 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89f030-7fc2-43df-b274-ccc34b31569e admin admin] PATH_INFO: `/v3/projects/348987c9cff14f65816c992b040212b6` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:43:43.020265 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af89f030-7fc2-43df-b274-ccc34b31569e admin admin] RBAC: Authorizing `identity:delete_project(project_id=348987c9cff14f65816c992b040212b6)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:43:43.022191 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af89f030-7fc2-43df-b274-ccc34b31569e admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:43:43.068230 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-af89f030-7fc2-43df-b274-ccc34b31569e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '348987c9cff14f65816c992b040212b6', 'request_id': 'req-af89f030-7fc2-43df-b274-ccc34b31569e'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:43:43.074231 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-af89f030-7fc2-43df-b274-ccc34b31569e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '348987c9cff14f65816c992b040212b6', 'request_id': 'req-af89f030-7fc2-43df-b274-ccc34b31569e'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:43:43.079678 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-af89f030-7fc2-43df-b274-ccc34b31569e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '348987c9cff14f65816c992b040212b6', 'request_id': 'req-af89f030-7fc2-43df-b274-ccc34b31569e'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:43:43.092338 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-af89f030-7fc2-43df-b274-ccc34b31569e admin admin] The token cache is being invalidate because project 348987c9cff14f65816c992b040212b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:43:43.092625 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-af89f030-7fc2-43df-b274-ccc34b31569e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:43:43.093268 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-af89f030-7fc2-43df-b274-ccc34b31569e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:43:43.094789 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1405/2788] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:43:42 2022] DELETE /identity/v3/projects/348987c9cff14f65816c992b040212b6 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:43:52.766929 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:43:53.089046 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:43:56.227384 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0823900-f23a-4b90-a07c-7623fe7d3985 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:43:56.228965 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-e0823900-f23a-4b90-a07c-7623fe7d3985 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:43:56.306526 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0823900-f23a-4b90-a07c-7623fe7d3985 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:43:56.366416 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3e94ac-d691-4d4a-9383-ed329c41a799 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '941e65d95bcd4e66a6489280520c12de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:43:56.367072 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e94ac-d691-4d4a-9383-ed329c41a799 service placement] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:43:56.367357 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e94ac-d691-4d4a-9383-ed329c41a799 service placement] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:43:56.367634 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e94ac-d691-4d4a-9383-ed329c41a799 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:43:56.369971 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-3d3e94ac-d691-4d4a-9383-ed329c41a799 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:43:56.382989 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3e94ac-d691-4d4a-9383-ed329c41a799 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:43:56.384669 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3e94ac-d691-4d4a-9383-ed329c41a799 service placement] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:43:56.398224 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1384/2789] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:43:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:44:00.515416 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b8da2-24bf-44c7-991c-82a4531b0ae4 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:44:00.515915 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b8da2-24bf-44c7-991c-82a4531b0ae4 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:44:00.516025 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b8da2-24bf-44c7-991c-82a4531b0ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:44:00.535469 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-511b8da2-24bf-44c7-991c-82a4531b0ae4 None None] MFA Rules not processed for user `1eae281b1ee147a09134db72c64282ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:44:00.537490 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-511b8da2-24bf-44c7-991c-82a4531b0ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:44:00.601494 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1406/2790] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:44:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:44:06.393152 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=58 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:44:10.594600 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=25 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:44:50.767961 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3e94ac-d691-4d4a-9383-ed329c41a799 service placement] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:44:50.769412 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-3d3e94ac-d691-4d4a-9383-ed329c41a799 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:44:50.827140 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3e94ac-d691-4d4a-9383-ed329c41a799 service placement] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:44:50.830723 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405d7f99-818c-48e7-a7ef-29fbb93c1042 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a3ed285ee4c4d04abf7daf0aeb9fb7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:44:50.831363 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d7f99-818c-48e7-a7ef-29fbb93c1042 service cinder] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:44:50.831646 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d7f99-818c-48e7-a7ef-29fbb93c1042 service cinder] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:44:50.831920 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d7f99-818c-48e7-a7ef-29fbb93c1042 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:44:50.833697 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-405d7f99-818c-48e7-a7ef-29fbb93c1042 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:44:50.905180 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405d7f99-818c-48e7-a7ef-29fbb93c1042 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:44:50.906896 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405d7f99-818c-48e7-a7ef-29fbb93c1042 service cinder] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:44:50.917968 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1385/2791] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:44:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:44:53.532483 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511b8da2-24bf-44c7-991c-82a4531b0ae4 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:44:53.533939 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-511b8da2-24bf-44c7-991c-82a4531b0ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:44:53.590205 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511b8da2-24bf-44c7-991c-82a4531b0ae4 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:44:53.593785 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefaa380-58d1-4edc-8f77-3b3511aa141f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:44:53.594441 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefaa380-58d1-4edc-8f77-3b3511aa141f service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:44:53.594729 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefaa380-58d1-4edc-8f77-3b3511aa141f service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:44:53.595012 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefaa380-58d1-4edc-8f77-3b3511aa141f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:44:53.596795 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-eefaa380-58d1-4edc-8f77-3b3511aa141f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:44:53.610071 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefaa380-58d1-4edc-8f77-3b3511aa141f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:44:53.611491 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefaa380-58d1-4edc-8f77-3b3511aa141f service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:44:53.622997 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1407/2792] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:44:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:45:00.913624 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=54 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:45:03.273735 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405d7f99-818c-48e7-a7ef-29fbb93c1042 service cinder] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:03.275330 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-405d7f99-818c-48e7-a7ef-29fbb93c1042 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:45:03.345339 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405d7f99-818c-48e7-a7ef-29fbb93c1042 service cinder] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:03.350003 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e555b3-1a5e-4677-aade-3f479a4f5cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:03.350885 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e555b3-1a5e-4677-aade-3f479a4f5cf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:03.351171 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e555b3-1a5e-4677-aade-3f479a4f5cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:03.351447 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e555b3-1a5e-4677-aade-3f479a4f5cf5 admin admin] PATH_INFO: `/v3/users/1eae281b1ee147a09134db72c64282ec` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:03.352675 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e555b3-1a5e-4677-aade-3f479a4f5cf5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1eae281b1ee147a09134db72c64282ec)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:03.354648 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e555b3-1a5e-4677-aade-3f479a4f5cf5 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:03.403890 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f2e555b3-1a5e-4677-aade-3f479a4f5cf5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1eae281b1ee147a09134db72c64282ec'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:03.404539 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f2e555b3-1a5e-4677-aade-3f479a4f5cf5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1eae281b1ee147a09134db72c64282ec'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:03.411589 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f2e555b3-1a5e-4677-aade-3f479a4f5cf5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1eae281b1ee147a09134db72c64282ec'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:03.418348 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f2e555b3-1a5e-4677-aade-3f479a4f5cf5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1eae281b1ee147a09134db72c64282ec'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:03.418975 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f2e555b3-1a5e-4677-aade-3f479a4f5cf5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1eae281b1ee147a09134db72c64282ec'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:03.437036 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1386/2793] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:45:03 2022] DELETE /identity/v3/users/1eae281b1ee147a09134db72c64282ec => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:45:03.611461 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefaa380-58d1-4edc-8f77-3b3511aa141f service neutron] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:03.630728 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefaa380-58d1-4edc-8f77-3b3511aa141f service neutron] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:03.692195 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e4b546-6bea-4035-a087-35567fc1e374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:03.693124 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4b546-6bea-4035-a087-35567fc1e374 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:03.693438 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4b546-6bea-4035-a087-35567fc1e374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:03.693717 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4b546-6bea-4035-a087-35567fc1e374 admin admin] PATH_INFO: `/v3/projects/79f31fb931fe4c139341706de494a759` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:03.694905 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e4b546-6bea-4035-a087-35567fc1e374 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79f31fb931fe4c139341706de494a759)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:03.696817 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e4b546-6bea-4035-a087-35567fc1e374 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:03.743138 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-c5e4b546-6bea-4035-a087-35567fc1e374 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79f31fb931fe4c139341706de494a759', 'request_id': 'req-c5e4b546-6bea-4035-a087-35567fc1e374'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:03.749847 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-c5e4b546-6bea-4035-a087-35567fc1e374 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79f31fb931fe4c139341706de494a759', 'request_id': 'req-c5e4b546-6bea-4035-a087-35567fc1e374'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:03.755451 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-c5e4b546-6bea-4035-a087-35567fc1e374 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79f31fb931fe4c139341706de494a759', 'request_id': 'req-c5e4b546-6bea-4035-a087-35567fc1e374'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:03.768219 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-c5e4b546-6bea-4035-a087-35567fc1e374 admin admin] The token cache is being invalidate because project 79f31fb931fe4c139341706de494a759 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:45:03.768531 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-c5e4b546-6bea-4035-a087-35567fc1e374 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:03.769157 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-c5e4b546-6bea-4035-a087-35567fc1e374 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:03.770717 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1408/2794] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:45:03 2022] DELETE /identity/v3/projects/79f31fb931fe4c139341706de494a759 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:45:03.776393 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78612d5d-6676-471d-a77d-1688b75f9df2 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:03.776689 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78612d5d-6676-471d-a77d-1688b75f9df2 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:03.776968 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78612d5d-6676-471d-a77d-1688b75f9df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:03.795159 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-78612d5d-6676-471d-a77d-1688b75f9df2 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:45:03.796361 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-78612d5d-6676-471d-a77d-1688b75f9df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:45:03.854212 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1387/2795] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:45:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:45:03.861799 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc06d93c-db53-4843-9f53-a63b7c968f7b None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:03.862097 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc06d93c-db53-4843-9f53-a63b7c968f7b None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:03.862384 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc06d93c-db53-4843-9f53-a63b7c968f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:03.880899 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-cc06d93c-db53-4843-9f53-a63b7c968f7b None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:45:03.882125 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-cc06d93c-db53-4843-9f53-a63b7c968f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:45:03.890744 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1409/2796] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:45:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:45:03.894872 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78612d5d-6676-471d-a77d-1688b75f9df2 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:03.904591 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78612d5d-6676-471d-a77d-1688b75f9df2 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:03.909422 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393a1db3-42ab-4b9b-83ec-da2722a13d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:03.910071 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a1db3-42ab-4b9b-83ec-da2722a13d93 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:03.910362 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a1db3-42ab-4b9b-83ec-da2722a13d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:03.910638 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a1db3-42ab-4b9b-83ec-da2722a13d93 admin admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:03.911355 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393a1db3-42ab-4b9b-83ec-da2722a13d93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:45:03.911753 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393a1db3-42ab-4b9b-83ec-da2722a13d93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:03.913380 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393a1db3-42ab-4b9b-83ec-da2722a13d93 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:03.927151 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1388/2797] 10.222.0.26 () {58 vars in 1152 bytes} [Fri Jul 1 19:45:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:45:03.931447 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc06d93c-db53-4843-9f53-a63b7c968f7b None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:03.941356 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc06d93c-db53-4843-9f53-a63b7c968f7b None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:03.946302 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1a04a5-e592-48f8-a8b0-4b0974d8652f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:03.946955 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a04a5-e592-48f8-a8b0-4b0974d8652f admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:03.947242 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a04a5-e592-48f8-a8b0-4b0974d8652f admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:03.948150 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a04a5-e592-48f8-a8b0-4b0974d8652f admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:03.948849 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1a04a5-e592-48f8-a8b0-4b0974d8652f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:03.950776 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1a04a5-e592-48f8-a8b0-4b0974d8652f admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:03.976428 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1410/2798] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:45:03 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:45:03.980605 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393a1db3-42ab-4b9b-83ec-da2722a13d93 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:03.991148 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393a1db3-42ab-4b9b-83ec-da2722a13d93 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:03.995312 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:45:04.049342 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df563938-1d02-44ca-8510-29f3af3f159b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:04.050001 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df563938-1d02-44ca-8510-29f3af3f159b admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:04.050287 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df563938-1d02-44ca-8510-29f3af3f159b admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:04.050565 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df563938-1d02-44ca-8510-29f3af3f159b admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:04.051263 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df563938-1d02-44ca-8510-29f3af3f159b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:04.053189 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df563938-1d02-44ca-8510-29f3af3f159b admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:04.073470 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1389/2799] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:45:03 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:45:04.077486 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1a04a5-e592-48f8-a8b0-4b0974d8652f admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:04.084106 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:45:04.088634 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1a04a5-e592-48f8-a8b0-4b0974d8652f admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:04.094591 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3001db8-caa6-422c-a991-558628fc66b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:04.095423 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3001db8-caa6-422c-a991-558628fc66b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:04.095936 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3001db8-caa6-422c-a991-558628fc66b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:04.096279 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3001db8-caa6-422c-a991-558628fc66b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:04.097188 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3001db8-caa6-422c-a991-558628fc66b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:04.098847 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3001db8-caa6-422c-a991-558628fc66b6 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:04.109951 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1411/2800] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:45:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:45:04.113777 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df563938-1d02-44ca-8510-29f3af3f159b admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:04.123698 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df563938-1d02-44ca-8510-29f3af3f159b admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:04.128225 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509ed57e-10f6-4300-a024-faa7591b6afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:04.128871 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509ed57e-10f6-4300-a024-faa7591b6afc admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:04.129220 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509ed57e-10f6-4300-a024-faa7591b6afc admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:04.129529 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509ed57e-10f6-4300-a024-faa7591b6afc admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:04.130270 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509ed57e-10f6-4300-a024-faa7591b6afc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:04.131848 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509ed57e-10f6-4300-a024-faa7591b6afc admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:04.144578 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1390/2801] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:45:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:45:04.148667 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3001db8-caa6-422c-a991-558628fc66b6 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:04.159295 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3001db8-caa6-422c-a991-558628fc66b6 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:04.164038 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77cfc25-9470-48e6-93f3-80b6d20dfc71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:04.164901 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77cfc25-9470-48e6-93f3-80b6d20dfc71 admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:04.165179 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77cfc25-9470-48e6-93f3-80b6d20dfc71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:04.165551 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77cfc25-9470-48e6-93f3-80b6d20dfc71 admin admin] PATH_INFO: `/v3/projects/2278c7eda64f4640b5d05889152e9951/users/2b3f02de7850436f9e8a50c00f3f7d53/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:04.180477 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77cfc25-9470-48e6-93f3-80b6d20dfc71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2278c7eda64f4640b5d05889152e9951, user_id=2b3f02de7850436f9e8a50c00f3f7d53, role_id=4cbf6ec846eb4b7c8cc52e9bfd6f076f)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:04.183233 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77cfc25-9470-48e6-93f3-80b6d20dfc71 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:04.195766 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1412/2802] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:45:04 2022] PUT /identity/v3/projects/2278c7eda64f4640b5d05889152e9951/users/2b3f02de7850436f9e8a50c00f3f7d53/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:45:04.206993 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f665f88-9195-45cb-975b-0b41c9d8d281 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:04.207289 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f665f88-9195-45cb-975b-0b41c9d8d281 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:04.207607 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f665f88-9195-45cb-975b-0b41c9d8d281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:04.233513 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-5f665f88-9195-45cb-975b-0b41c9d8d281 None None] MFA Rules not processed for user `2b3f02de7850436f9e8a50c00f3f7d53`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:45:04.234719 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-5f665f88-9195-45cb-975b-0b41c9d8d281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:45:04.298838 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1391/2803] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:45:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:45:04.309709 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77cfc25-9470-48e6-93f3-80b6d20dfc71 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:04.311390 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-b77cfc25-9470-48e6-93f3-80b6d20dfc71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:45:04.384675 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77cfc25-9470-48e6-93f3-80b6d20dfc71 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:04.390742 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e58f129-27a7-4206-94de-32d8222f693f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13fd76fc7dd1410b9cde5adbaa6cb2e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:04.391419 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e58f129-27a7-4206-94de-32d8222f693f service nova] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:04.391751 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e58f129-27a7-4206-94de-32d8222f693f service nova] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:04.392178 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e58f129-27a7-4206-94de-32d8222f693f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:04.400249 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e58f129-27a7-4206-94de-32d8222f693f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:04.402558 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e58f129-27a7-4206-94de-32d8222f693f service nova] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:04.411706 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1413/2804] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:45:04 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:45:04.625359 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f665f88-9195-45cb-975b-0b41c9d8d281 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:04.687272 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f665f88-9195-45cb-975b-0b41c9d8d281 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:04.691822 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c8ab5-6ced-408e-a717-a8e22666163f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:04.692678 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c8ab5-6ced-408e-a717-a8e22666163f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:04.693042 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c8ab5-6ced-408e-a717-a8e22666163f admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:04.693358 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c8ab5-6ced-408e-a717-a8e22666163f admin admin] PATH_INFO: `/v3/users/2b3f02de7850436f9e8a50c00f3f7d53` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:04.694543 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580c8ab5-6ced-408e-a717-a8e22666163f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b3f02de7850436f9e8a50c00f3f7d53)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:04.696616 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580c8ab5-6ced-408e-a717-a8e22666163f admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:04.712342 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:45:04.745051 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-580c8ab5-6ced-408e-a717-a8e22666163f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b3f02de7850436f9e8a50c00f3f7d53'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:04.745769 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-580c8ab5-6ced-408e-a717-a8e22666163f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b3f02de7850436f9e8a50c00f3f7d53'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:04.752646 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-580c8ab5-6ced-408e-a717-a8e22666163f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b3f02de7850436f9e8a50c00f3f7d53'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:04.760833 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-580c8ab5-6ced-408e-a717-a8e22666163f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b3f02de7850436f9e8a50c00f3f7d53'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:04.761596 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-580c8ab5-6ced-408e-a717-a8e22666163f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b3f02de7850436f9e8a50c00f3f7d53'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:04.779262 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1392/2805] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:45:04 2022] DELETE /identity/v3/users/2b3f02de7850436f9e8a50c00f3f7d53 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:45:04.783699 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6621e95-68ff-4b7b-8fdb-4d961feece09 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:04.784116 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6621e95-68ff-4b7b-8fdb-4d961feece09 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:04.784472 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6621e95-68ff-4b7b-8fdb-4d961feece09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:04.802617 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-e6621e95-68ff-4b7b-8fdb-4d961feece09 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:45:04.803778 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-e6621e95-68ff-4b7b-8fdb-4d961feece09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:45:04.864543 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1414/2806] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:45:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:45:04.874846 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c8ab5-6ced-408e-a717-a8e22666163f admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:04.876251 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-580c8ab5-6ced-408e-a717-a8e22666163f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:45:04.933256 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c8ab5-6ced-408e-a717-a8e22666163f admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:04.936905 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efa9b3e-9818-43ad-9675-489710bca8c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:04.937582 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa9b3e-9818-43ad-9675-489710bca8c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:04.937870 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa9b3e-9818-43ad-9675-489710bca8c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:04.938147 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa9b3e-9818-43ad-9675-489710bca8c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:04.947140 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efa9b3e-9818-43ad-9675-489710bca8c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:04.949211 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efa9b3e-9818-43ad-9675-489710bca8c0 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:04.959332 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1393/2807] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:45:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:45:05.220015 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6621e95-68ff-4b7b-8fdb-4d961feece09 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:05.221619 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-e6621e95-68ff-4b7b-8fdb-4d961feece09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:45:05.235627 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6621e95-68ff-4b7b-8fdb-4d961feece09 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:05.240250 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f37014c-0449-43a3-8079-1555ec0f1977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:05.241738 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37014c-0449-43a3-8079-1555ec0f1977 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:05.242191 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37014c-0449-43a3-8079-1555ec0f1977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:05.242477 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37014c-0449-43a3-8079-1555ec0f1977 admin admin] PATH_INFO: `/v3/projects/2278c7eda64f4640b5d05889152e9951` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:05.243942 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f37014c-0449-43a3-8079-1555ec0f1977 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2278c7eda64f4640b5d05889152e9951)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:05.246497 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f37014c-0449-43a3-8079-1555ec0f1977 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:05.294196 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-3f37014c-0449-43a3-8079-1555ec0f1977 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2278c7eda64f4640b5d05889152e9951', 'request_id': 'req-3f37014c-0449-43a3-8079-1555ec0f1977'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:05.295285 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:45:05.302049 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-3f37014c-0449-43a3-8079-1555ec0f1977 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2278c7eda64f4640b5d05889152e9951', 'request_id': 'req-3f37014c-0449-43a3-8079-1555ec0f1977'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:05.309110 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-3f37014c-0449-43a3-8079-1555ec0f1977 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2278c7eda64f4640b5d05889152e9951', 'request_id': 'req-3f37014c-0449-43a3-8079-1555ec0f1977'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:05.321603 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-3f37014c-0449-43a3-8079-1555ec0f1977 admin admin] The token cache is being invalidate because project 2278c7eda64f4640b5d05889152e9951 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:45:05.321894 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-3f37014c-0449-43a3-8079-1555ec0f1977 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:05.322571 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-3f37014c-0449-43a3-8079-1555ec0f1977 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:05.324119 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1415/2808] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:45:05 2022] DELETE /identity/v3/projects/2278c7eda64f4640b5d05889152e9951 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:45:05.328956 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67c8d0-c2b7-4ba1-837d-46856f6261f6 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:05.329472 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67c8d0-c2b7-4ba1-837d-46856f6261f6 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:05.329584 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67c8d0-c2b7-4ba1-837d-46856f6261f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:05.347281 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-cf67c8d0-c2b7-4ba1-837d-46856f6261f6 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:45:05.348467 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-cf67c8d0-c2b7-4ba1-837d-46856f6261f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:45:05.409439 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1394/2809] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:45:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:45:05.417836 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8158a15-652c-4393-bcf1-eb3bede87d50 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:05.418134 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8158a15-652c-4393-bcf1-eb3bede87d50 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:05.418419 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8158a15-652c-4393-bcf1-eb3bede87d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:05.436719 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-c8158a15-652c-4393-bcf1-eb3bede87d50 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:45:05.437951 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-c8158a15-652c-4393-bcf1-eb3bede87d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:45:05.445772 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1416/2810] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:45:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:45:05.449846 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf67c8d0-c2b7-4ba1-837d-46856f6261f6 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:05.459454 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf67c8d0-c2b7-4ba1-837d-46856f6261f6 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:05.464428 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf3a0d-fc29-424c-b6fe-137246104ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:05.465070 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf3a0d-fc29-424c-b6fe-137246104ae1 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:05.465390 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf3a0d-fc29-424c-b6fe-137246104ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:05.465662 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf3a0d-fc29-424c-b6fe-137246104ae1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:05.466407 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bf3a0d-fc29-424c-b6fe-137246104ae1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:45:05.466709 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bf3a0d-fc29-424c-b6fe-137246104ae1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:05.468287 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bf3a0d-fc29-424c-b6fe-137246104ae1 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:05.480176 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1395/2811] 10.222.0.26 () {58 vars in 1152 bytes} [Fri Jul 1 19:45:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:45:05.484340 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8158a15-652c-4393-bcf1-eb3bede87d50 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:05.493674 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8158a15-652c-4393-bcf1-eb3bede87d50 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:05.498387 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a97338b-7864-4abb-a84f-d260a082d6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:05.499036 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a97338b-7864-4abb-a84f-d260a082d6e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:05.499321 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a97338b-7864-4abb-a84f-d260a082d6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:05.499628 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a97338b-7864-4abb-a84f-d260a082d6e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:05.500328 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a97338b-7864-4abb-a84f-d260a082d6e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:05.502270 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a97338b-7864-4abb-a84f-d260a082d6e8 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:05.527887 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1417/2812] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:45:05 2022] POST /identity/v3/projects => generated 399 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 19:45:05.532253 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf3a0d-fc29-424c-b6fe-137246104ae1 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:05.543140 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf3a0d-fc29-424c-b6fe-137246104ae1 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:05.563488 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:45:05.605434 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd6c1ee-5bab-4647-997b-db56ebacf5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:05.606020 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6c1ee-5bab-4647-997b-db56ebacf5cc admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:05.606301 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6c1ee-5bab-4647-997b-db56ebacf5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:05.606573 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6c1ee-5bab-4647-997b-db56ebacf5cc admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:05.607272 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd6c1ee-5bab-4647-997b-db56ebacf5cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:05.609181 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd6c1ee-5bab-4647-997b-db56ebacf5cc admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:05.630697 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1396/2813] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:45:05 2022] POST /identity/v3/users => generated 300 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:45:05.634676 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a97338b-7864-4abb-a84f-d260a082d6e8 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:05.645478 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a97338b-7864-4abb-a84f-d260a082d6e8 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:05.650272 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81918aba-3909-4e99-9543-d5ea8d18bd85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:05.651451 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81918aba-3909-4e99-9543-d5ea8d18bd85 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:05.651740 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81918aba-3909-4e99-9543-d5ea8d18bd85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:05.652023 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81918aba-3909-4e99-9543-d5ea8d18bd85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:05.652748 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81918aba-3909-4e99-9543-d5ea8d18bd85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:05.654383 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81918aba-3909-4e99-9543-d5ea8d18bd85 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:05.665083 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1418/2814] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:45:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:45:05.669795 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd6c1ee-5bab-4647-997b-db56ebacf5cc admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:05.679719 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd6c1ee-5bab-4647-997b-db56ebacf5cc admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:05.684351 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ed13d4-69b4-4020-b4f6-40280bd2c00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:05.685019 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed13d4-69b4-4020-b4f6-40280bd2c00d admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:05.685330 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed13d4-69b4-4020-b4f6-40280bd2c00d admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:05.685613 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed13d4-69b4-4020-b4f6-40280bd2c00d admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:05.686364 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ed13d4-69b4-4020-b4f6-40280bd2c00d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:05.687964 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ed13d4-69b4-4020-b4f6-40280bd2c00d admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:05.698371 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1397/2815] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:45:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:45:05.702498 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81918aba-3909-4e99-9543-d5ea8d18bd85 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:05.712573 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81918aba-3909-4e99-9543-d5ea8d18bd85 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:05.717868 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c848e3-ce9c-4750-9b95-ea1078a68c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:05.718744 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c848e3-ce9c-4750-9b95-ea1078a68c33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:05.719144 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c848e3-ce9c-4750-9b95-ea1078a68c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:05.719431 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c848e3-ce9c-4750-9b95-ea1078a68c33 admin admin] PATH_INFO: `/v3/projects/d85defa89b2e4d8d98532e0a1659d5be/users/8bbe133705594bc08ef57bcb5b33cfdc/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:05.733942 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c848e3-ce9c-4750-9b95-ea1078a68c33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d85defa89b2e4d8d98532e0a1659d5be, user_id=8bbe133705594bc08ef57bcb5b33cfdc, role_id=4cbf6ec846eb4b7c8cc52e9bfd6f076f)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:05.736594 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c848e3-ce9c-4750-9b95-ea1078a68c33 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:05.749618 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1419/2816] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:45:05 2022] PUT /identity/v3/projects/d85defa89b2e4d8d98532e0a1659d5be/users/8bbe133705594bc08ef57bcb5b33cfdc/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 19:45:05.759849 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb5d6fc-115d-469a-8204-c1eea9906247 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:05.760680 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb5d6fc-115d-469a-8204-c1eea9906247 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:05.760971 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb5d6fc-115d-469a-8204-c1eea9906247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:05.788081 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-5cb5d6fc-115d-469a-8204-c1eea9906247 None None] MFA Rules not processed for user `8bbe133705594bc08ef57bcb5b33cfdc`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:45:05.789382 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-5cb5d6fc-115d-469a-8204-c1eea9906247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:45:05.851563 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1398/2817] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:45:05 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:45:05.856108 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c848e3-ce9c-4750-9b95-ea1078a68c33 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:05.918704 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c848e3-ce9c-4750-9b95-ea1078a68c33 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:05.923296 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263634ce-6492-48d4-acda-dede5be2d594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:05.923944 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263634ce-6492-48d4-acda-dede5be2d594 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:05.924227 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263634ce-6492-48d4-acda-dede5be2d594 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:05.924502 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263634ce-6492-48d4-acda-dede5be2d594 admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:05.925213 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263634ce-6492-48d4-acda-dede5be2d594 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:05.927161 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263634ce-6492-48d4-acda-dede5be2d594 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:05.955236 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1420/2818] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:45:05 2022] POST /identity/v3/projects => generated 401 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:45:05.959759 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb5d6fc-115d-469a-8204-c1eea9906247 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:05.971318 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb5d6fc-115d-469a-8204-c1eea9906247 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:06.026861 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ca031-a050-45b5-a064-e19e03ed93a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:06.027519 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ca031-a050-45b5-a064-e19e03ed93a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:06.027799 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ca031-a050-45b5-a064-e19e03ed93a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:06.028072 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ca031-a050-45b5-a064-e19e03ed93a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:06.028759 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88ca031-a050-45b5-a064-e19e03ed93a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:06.030963 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88ca031-a050-45b5-a064-e19e03ed93a5 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:06.049855 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1399/2819] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:45:05 2022] POST /identity/v3/users => generated 307 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 19:45:06.053845 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263634ce-6492-48d4-acda-dede5be2d594 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:06.063835 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263634ce-6492-48d4-acda-dede5be2d594 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:06.068416 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aadf263-a66b-40a5-88ee-c7236bdfd30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:06.069057 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aadf263-a66b-40a5-88ee-c7236bdfd30c admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:06.069440 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aadf263-a66b-40a5-88ee-c7236bdfd30c admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:06.069680 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aadf263-a66b-40a5-88ee-c7236bdfd30c admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:06.070403 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aadf263-a66b-40a5-88ee-c7236bdfd30c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:06.071978 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aadf263-a66b-40a5-88ee-c7236bdfd30c admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:06.083723 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1421/2820] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:45:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:45:06.087640 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ca031-a050-45b5-a064-e19e03ed93a5 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:06.098293 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ca031-a050-45b5-a064-e19e03ed93a5 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:06.102912 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b9812-3d81-4f6b-826f-075f1d9e8191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:06.103817 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b9812-3d81-4f6b-826f-075f1d9e8191 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:06.104105 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b9812-3d81-4f6b-826f-075f1d9e8191 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:06.104383 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b9812-3d81-4f6b-826f-075f1d9e8191 admin admin] PATH_INFO: `/v3/projects/1eef973ae3b743548314f6a2532eb020/users/26fe402bad2d46e8a573fd781f5ce7a1/roles/6cb03785fb184ef587509b3174622f69` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:06.118941 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6b9812-3d81-4f6b-826f-075f1d9e8191 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eef973ae3b743548314f6a2532eb020, user_id=26fe402bad2d46e8a573fd781f5ce7a1, role_id=6cb03785fb184ef587509b3174622f69)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:06.122099 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6b9812-3d81-4f6b-826f-075f1d9e8191 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:06.130178 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:45:06.137278 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1400/2821] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:45:06 2022] PUT /identity/v3/projects/1eef973ae3b743548314f6a2532eb020/users/26fe402bad2d46e8a573fd781f5ce7a1/roles/6cb03785fb184ef587509b3174622f69 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:45:06.141040 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aadf263-a66b-40a5-88ee-c7236bdfd30c admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:06.151075 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aadf263-a66b-40a5-88ee-c7236bdfd30c admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:06.195569 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:45:06.210071 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7075b7eb-980c-4b3c-81ce-1f1d02d54a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:06.210758 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7075b7eb-980c-4b3c-81ce-1f1d02d54a8b admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:06.211045 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7075b7eb-980c-4b3c-81ce-1f1d02d54a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:06.211320 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7075b7eb-980c-4b3c-81ce-1f1d02d54a8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:06.212072 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7075b7eb-980c-4b3c-81ce-1f1d02d54a8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:06.213694 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7075b7eb-980c-4b3c-81ce-1f1d02d54a8b admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:06.223557 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1422/2822] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:45:06 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 19:45:06.227822 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b9812-3d81-4f6b-826f-075f1d9e8191 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:06.237979 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b9812-3d81-4f6b-826f-075f1d9e8191 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:06.243481 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a538adc0-612e-4a11-baa4-2f6a7df8b765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:06.245479 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538adc0-612e-4a11-baa4-2f6a7df8b765 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:06.245936 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538adc0-612e-4a11-baa4-2f6a7df8b765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:06.246222 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538adc0-612e-4a11-baa4-2f6a7df8b765 admin admin] PATH_INFO: `/v3/projects/1eef973ae3b743548314f6a2532eb020/users/26fe402bad2d46e8a573fd781f5ce7a1/roles/6cb03785fb184ef587509b3174622f69` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:06.248268 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a538adc0-612e-4a11-baa4-2f6a7df8b765 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eef973ae3b743548314f6a2532eb020, user_id=26fe402bad2d46e8a573fd781f5ce7a1, role_id=6cb03785fb184ef587509b3174622f69)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:06.251075 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a538adc0-612e-4a11-baa4-2f6a7df8b765 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:06.263276 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1401/2823] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:45:06 2022] PUT /identity/v3/projects/1eef973ae3b743548314f6a2532eb020/users/26fe402bad2d46e8a573fd781f5ce7a1/roles/6cb03785fb184ef587509b3174622f69 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:45:06.326108 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac76c12d-6b39-4c4e-a8ae-be7d63694337 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:06.326402 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac76c12d-6b39-4c4e-a8ae-be7d63694337 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:06.326687 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac76c12d-6b39-4c4e-a8ae-be7d63694337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:06.352671 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-ac76c12d-6b39-4c4e-a8ae-be7d63694337 None None] MFA Rules not processed for user `26fe402bad2d46e8a573fd781f5ce7a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:45:06.353942 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-ac76c12d-6b39-4c4e-a8ae-be7d63694337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:45:06.421170 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1423/2824] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:45:06 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:45:06.431438 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a538adc0-612e-4a11-baa4-2f6a7df8b765 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:06.433641 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-a538adc0-612e-4a11-baa4-2f6a7df8b765 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:45:06.489749 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a538adc0-612e-4a11-baa4-2f6a7df8b765 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:06.493368 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fd779c-cbdf-4938-ad40-0ac8aeac8da4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a3ed285ee4c4d04abf7daf0aeb9fb7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:06.493993 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd779c-cbdf-4938-ad40-0ac8aeac8da4 service cinder] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:06.494274 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd779c-cbdf-4938-ad40-0ac8aeac8da4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:06.495152 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd779c-cbdf-4938-ad40-0ac8aeac8da4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:06.503998 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fd779c-cbdf-4938-ad40-0ac8aeac8da4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:06.505456 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fd779c-cbdf-4938-ad40-0ac8aeac8da4 service cinder] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:06.515086 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1402/2825] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:45:06 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:45:06.584333 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac76c12d-6b39-4c4e-a8ae-be7d63694337 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:06.594704 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac76c12d-6b39-4c4e-a8ae-be7d63694337 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:06.598404 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560a2a4-76d9-4d79-8e5d-6e69966b06e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a3ed285ee4c4d04abf7daf0aeb9fb7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:06.599043 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560a2a4-76d9-4d79-8e5d-6e69966b06e2 service cinder] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:06.599328 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560a2a4-76d9-4d79-8e5d-6e69966b06e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:06.599604 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560a2a4-76d9-4d79-8e5d-6e69966b06e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:06.657475 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3560a2a4-76d9-4d79-8e5d-6e69966b06e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:06.658912 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3560a2a4-76d9-4d79-8e5d-6e69966b06e2 service cinder] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:06.667800 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1424/2826] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:45:06 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:45:10.678053 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fd779c-cbdf-4938-ad40-0ac8aeac8da4 service cinder] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:10.739945 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fd779c-cbdf-4938-ad40-0ac8aeac8da4 service cinder] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:10.745122 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec29104f-8af0-4515-8c0c-3640e6df07cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:10.746027 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec29104f-8af0-4515-8c0c-3640e6df07cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:10.746316 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec29104f-8af0-4515-8c0c-3640e6df07cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:10.746596 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec29104f-8af0-4515-8c0c-3640e6df07cb admin admin] PATH_INFO: `/v3/users/8bbe133705594bc08ef57bcb5b33cfdc` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:10.747795 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec29104f-8af0-4515-8c0c-3640e6df07cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bbe133705594bc08ef57bcb5b33cfdc)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:10.749748 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec29104f-8af0-4515-8c0c-3640e6df07cb admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:10.799993 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-ec29104f-8af0-4515-8c0c-3640e6df07cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bbe133705594bc08ef57bcb5b33cfdc'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:10.800641 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-ec29104f-8af0-4515-8c0c-3640e6df07cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bbe133705594bc08ef57bcb5b33cfdc'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:10.807496 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-ec29104f-8af0-4515-8c0c-3640e6df07cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bbe133705594bc08ef57bcb5b33cfdc'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:10.814697 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-ec29104f-8af0-4515-8c0c-3640e6df07cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bbe133705594bc08ef57bcb5b33cfdc'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:10.815295 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-ec29104f-8af0-4515-8c0c-3640e6df07cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bbe133705594bc08ef57bcb5b33cfdc'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:10.832348 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1403/2827] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:45:10 2022] DELETE /identity/v3/users/8bbe133705594bc08ef57bcb5b33cfdc => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:45:10.836847 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff62e0-c372-4bb4-a723-cec67b51fc14 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:10.837375 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff62e0-c372-4bb4-a723-cec67b51fc14 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:10.837494 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff62e0-c372-4bb4-a723-cec67b51fc14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:10.855229 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-6fff62e0-c372-4bb4-a723-cec67b51fc14 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:45:10.856422 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-6fff62e0-c372-4bb4-a723-cec67b51fc14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:45:10.914433 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1425/2828] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:45:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:45:10.924272 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec29104f-8af0-4515-8c0c-3640e6df07cb admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:10.925757 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-ec29104f-8af0-4515-8c0c-3640e6df07cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:45:10.935708 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:45:10.983959 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec29104f-8af0-4515-8c0c-3640e6df07cb admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:10.987588 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8fef7c-35f3-45e0-9fa9-6127aa572e33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:10.988223 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8fef7c-35f3-45e0-9fa9-6127aa572e33 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:10.988512 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8fef7c-35f3-45e0-9fa9-6127aa572e33 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:10.988789 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8fef7c-35f3-45e0-9fa9-6127aa572e33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:10.997728 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8fef7c-35f3-45e0-9fa9-6127aa572e33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:10.999165 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8fef7c-35f3-45e0-9fa9-6127aa572e33 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:11.008397 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1404/2829] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:45:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:45:11.281733 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fff62e0-c372-4bb4-a723-cec67b51fc14 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:11.283294 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-6fff62e0-c372-4bb4-a723-cec67b51fc14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:45:11.296764 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fff62e0-c372-4bb4-a723-cec67b51fc14 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:11.301684 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfd44bd-000d-4618-ba77-c218a1a43af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:11.302564 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd44bd-000d-4618-ba77-c218a1a43af4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:11.302852 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd44bd-000d-4618-ba77-c218a1a43af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:11.303134 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd44bd-000d-4618-ba77-c218a1a43af4 admin admin] PATH_INFO: `/v3/projects/d85defa89b2e4d8d98532e0a1659d5be` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:11.304426 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfd44bd-000d-4618-ba77-c218a1a43af4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d85defa89b2e4d8d98532e0a1659d5be)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:11.306322 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfd44bd-000d-4618-ba77-c218a1a43af4 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:11.309389 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:45:11.354260 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-0dfd44bd-000d-4618-ba77-c218a1a43af4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd85defa89b2e4d8d98532e0a1659d5be', 'request_id': 'req-0dfd44bd-000d-4618-ba77-c218a1a43af4'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:11.360262 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-0dfd44bd-000d-4618-ba77-c218a1a43af4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd85defa89b2e4d8d98532e0a1659d5be', 'request_id': 'req-0dfd44bd-000d-4618-ba77-c218a1a43af4'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:11.365835 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-0dfd44bd-000d-4618-ba77-c218a1a43af4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd85defa89b2e4d8d98532e0a1659d5be', 'request_id': 'req-0dfd44bd-000d-4618-ba77-c218a1a43af4'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:11.378147 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-0dfd44bd-000d-4618-ba77-c218a1a43af4 admin admin] The token cache is being invalidate because project d85defa89b2e4d8d98532e0a1659d5be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:45:11.378462 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-0dfd44bd-000d-4618-ba77-c218a1a43af4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:11.379075 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-0dfd44bd-000d-4618-ba77-c218a1a43af4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:11.380687 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1426/2830] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:45:11 2022] DELETE /identity/v3/projects/d85defa89b2e4d8d98532e0a1659d5be => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:45:11.384755 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8fef7c-35f3-45e0-9fa9-6127aa572e33 service neutron] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:11.395364 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8fef7c-35f3-45e0-9fa9-6127aa572e33 service neutron] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:11.450871 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383201c4-c30d-4d29-9309-8851959e3567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:11.451756 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383201c4-c30d-4d29-9309-8851959e3567 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:11.452042 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383201c4-c30d-4d29-9309-8851959e3567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:11.452319 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383201c4-c30d-4d29-9309-8851959e3567 admin admin] PATH_INFO: `/v3/users/26fe402bad2d46e8a573fd781f5ce7a1` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:11.453569 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383201c4-c30d-4d29-9309-8851959e3567 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26fe402bad2d46e8a573fd781f5ce7a1)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:11.455496 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383201c4-c30d-4d29-9309-8851959e3567 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:11.499878 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-383201c4-c30d-4d29-9309-8851959e3567 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26fe402bad2d46e8a573fd781f5ce7a1'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:11.500508 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-383201c4-c30d-4d29-9309-8851959e3567 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26fe402bad2d46e8a573fd781f5ce7a1'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:11.507416 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-383201c4-c30d-4d29-9309-8851959e3567 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26fe402bad2d46e8a573fd781f5ce7a1'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:11.515210 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-383201c4-c30d-4d29-9309-8851959e3567 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26fe402bad2d46e8a573fd781f5ce7a1'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:11.515881 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-383201c4-c30d-4d29-9309-8851959e3567 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26fe402bad2d46e8a573fd781f5ce7a1'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:11.533504 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1405/2831] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:45:11 2022] DELETE /identity/v3/users/26fe402bad2d46e8a573fd781f5ce7a1 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:45:11.800901 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfd44bd-000d-4618-ba77-c218a1a43af4 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:11.802395 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-0dfd44bd-000d-4618-ba77-c218a1a43af4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:45:11.817738 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfd44bd-000d-4618-ba77-c218a1a43af4 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:11.880904 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ead50e-9c23-4632-a226-591022635680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:11.881725 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ead50e-9c23-4632-a226-591022635680 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:11.882006 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ead50e-9c23-4632-a226-591022635680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:11.882286 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ead50e-9c23-4632-a226-591022635680 admin admin] PATH_INFO: `/v3/projects/1eef973ae3b743548314f6a2532eb020` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:11.883531 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ead50e-9c23-4632-a226-591022635680 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1eef973ae3b743548314f6a2532eb020)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:11.885981 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ead50e-9c23-4632-a226-591022635680 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:11.936779 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-14ead50e-9c23-4632-a226-591022635680 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1eef973ae3b743548314f6a2532eb020', 'request_id': 'req-14ead50e-9c23-4632-a226-591022635680'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:11.943399 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-14ead50e-9c23-4632-a226-591022635680 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1eef973ae3b743548314f6a2532eb020', 'request_id': 'req-14ead50e-9c23-4632-a226-591022635680'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:11.949673 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-14ead50e-9c23-4632-a226-591022635680 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1eef973ae3b743548314f6a2532eb020', 'request_id': 'req-14ead50e-9c23-4632-a226-591022635680'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:11.964487 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-14ead50e-9c23-4632-a226-591022635680 admin admin] The token cache is being invalidate because project 1eef973ae3b743548314f6a2532eb020 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:45:11.965023 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-14ead50e-9c23-4632-a226-591022635680 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:11.965692 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-14ead50e-9c23-4632-a226-591022635680 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:11.967256 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1427/2832] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:45:11 2022] DELETE /identity/v3/projects/1eef973ae3b743548314f6a2532eb020 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:45:11.972015 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ab116-3aee-4e7d-8f72-83cde051edc7 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:11.972487 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ab116-3aee-4e7d-8f72-83cde051edc7 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:11.972716 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ab116-3aee-4e7d-8f72-83cde051edc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:11.990564 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-8a3ab116-3aee-4e7d-8f72-83cde051edc7 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:45:11.991768 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-8a3ab116-3aee-4e7d-8f72-83cde051edc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:45:12.017214 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:45:12.053213 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1406/2833] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:45:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:45:12.061520 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077ee43-40f0-4f80-8cea-8d80e54d412a None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:12.061812 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077ee43-40f0-4f80-8cea-8d80e54d412a None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:12.062091 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077ee43-40f0-4f80-8cea-8d80e54d412a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:12.081052 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-8077ee43-40f0-4f80-8cea-8d80e54d412a None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:45:12.082301 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-8077ee43-40f0-4f80-8cea-8d80e54d412a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:45:12.090328 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1428/2834] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:45:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:45:12.094669 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ab116-3aee-4e7d-8f72-83cde051edc7 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:12.104019 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ab116-3aee-4e7d-8f72-83cde051edc7 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:12.108509 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620f1878-10b8-4349-87f4-91be3d0980c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:12.109151 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620f1878-10b8-4349-87f4-91be3d0980c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:12.109465 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620f1878-10b8-4349-87f4-91be3d0980c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:12.109741 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620f1878-10b8-4349-87f4-91be3d0980c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:12.110456 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620f1878-10b8-4349-87f4-91be3d0980c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:45:12.110764 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620f1878-10b8-4349-87f4-91be3d0980c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:12.112353 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620f1878-10b8-4349-87f4-91be3d0980c4 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:12.124091 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1407/2835] 10.222.0.26 () {58 vars in 1152 bytes} [Fri Jul 1 19:45:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:45:12.128395 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8077ee43-40f0-4f80-8cea-8d80e54d412a None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:12.138385 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8077ee43-40f0-4f80-8cea-8d80e54d412a None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:12.143032 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8937785b-d9f7-4ec0-8a30-55bee47bed80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:12.143679 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937785b-d9f7-4ec0-8a30-55bee47bed80 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:12.143969 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937785b-d9f7-4ec0-8a30-55bee47bed80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:12.144254 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937785b-d9f7-4ec0-8a30-55bee47bed80 admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:12.144947 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8937785b-d9f7-4ec0-8a30-55bee47bed80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:12.146882 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8937785b-d9f7-4ec0-8a30-55bee47bed80 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:12.159986 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:45:12.173287 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1429/2836] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:45:12 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:45:12.177129 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620f1878-10b8-4349-87f4-91be3d0980c4 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:12.187646 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620f1878-10b8-4349-87f4-91be3d0980c4 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:12.243215 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1223003-ba24-4740-9c80-21e3a1df0b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:12.243877 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1223003-ba24-4740-9c80-21e3a1df0b53 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:12.244164 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1223003-ba24-4740-9c80-21e3a1df0b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:12.244442 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1223003-ba24-4740-9c80-21e3a1df0b53 admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:12.245701 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1223003-ba24-4740-9c80-21e3a1df0b53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:12.247604 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1223003-ba24-4740-9c80-21e3a1df0b53 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:12.267063 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1408/2837] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:45:12 2022] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:45:12.271096 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8937785b-d9f7-4ec0-8a30-55bee47bed80 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:12.281597 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8937785b-d9f7-4ec0-8a30-55bee47bed80 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:12.286330 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1ad81b-b14e-4094-8e33-aeeb0dce1736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:12.287022 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ad81b-b14e-4094-8e33-aeeb0dce1736 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:12.287306 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ad81b-b14e-4094-8e33-aeeb0dce1736 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:12.287583 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ad81b-b14e-4094-8e33-aeeb0dce1736 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:12.288316 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1ad81b-b14e-4094-8e33-aeeb0dce1736 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:12.289980 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1ad81b-b14e-4094-8e33-aeeb0dce1736 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:12.300641 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1430/2838] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:45:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:45:12.304479 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1223003-ba24-4740-9c80-21e3a1df0b53 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:12.314712 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1223003-ba24-4740-9c80-21e3a1df0b53 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:12.319364 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26431796-c6a7-482b-9807-e8e64a7e94cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:12.320009 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26431796-c6a7-482b-9807-e8e64a7e94cc admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:12.320297 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26431796-c6a7-482b-9807-e8e64a7e94cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:12.320578 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26431796-c6a7-482b-9807-e8e64a7e94cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:12.321327 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26431796-c6a7-482b-9807-e8e64a7e94cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:12.323589 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26431796-c6a7-482b-9807-e8e64a7e94cc admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:12.333477 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1409/2839] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:45:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:45:12.337574 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1ad81b-b14e-4094-8e33-aeeb0dce1736 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:12.347696 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1ad81b-b14e-4094-8e33-aeeb0dce1736 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:12.352375 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b58b53-e07f-4654-a15c-5dc67f5bbd15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:12.353540 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b58b53-e07f-4654-a15c-5dc67f5bbd15 admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:12.353854 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b58b53-e07f-4654-a15c-5dc67f5bbd15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:12.354269 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b58b53-e07f-4654-a15c-5dc67f5bbd15 admin admin] PATH_INFO: `/v3/projects/188dbe6b99ee4859a7ef52dd2d332777/users/ee94d849afa6476bb4bfbdfde24fd9d5/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:12.368936 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b58b53-e07f-4654-a15c-5dc67f5bbd15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=188dbe6b99ee4859a7ef52dd2d332777, user_id=ee94d849afa6476bb4bfbdfde24fd9d5, role_id=4cbf6ec846eb4b7c8cc52e9bfd6f076f)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:12.372166 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b58b53-e07f-4654-a15c-5dc67f5bbd15 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:12.384583 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1431/2840] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:45:12 2022] PUT /identity/v3/projects/188dbe6b99ee4859a7ef52dd2d332777/users/ee94d849afa6476bb4bfbdfde24fd9d5/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:45:12.390085 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f4bf8-6298-40f2-b506-724e49befe0c None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:12.390319 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f4bf8-6298-40f2-b506-724e49befe0c None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:12.390597 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f4bf8-6298-40f2-b506-724e49befe0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:12.408415 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-1e2f4bf8-6298-40f2-b506-724e49befe0c None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:45:12.409662 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-1e2f4bf8-6298-40f2-b506-724e49befe0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:45:12.466685 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1410/2841] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:45:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:45:12.476749 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b58b53-e07f-4654-a15c-5dc67f5bbd15 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:12.478523 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-e7b58b53-e07f-4654-a15c-5dc67f5bbd15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:45:12.537311 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b58b53-e07f-4654-a15c-5dc67f5bbd15 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:12.540920 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c5dba6-cb0e-4710-b7f4-b95dad9067c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:12.541620 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5dba6-cb0e-4710-b7f4-b95dad9067c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:12.541905 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5dba6-cb0e-4710-b7f4-b95dad9067c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:12.542185 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5dba6-cb0e-4710-b7f4-b95dad9067c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:12.551113 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c5dba6-cb0e-4710-b7f4-b95dad9067c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:12.552553 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c5dba6-cb0e-4710-b7f4-b95dad9067c9 service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:12.561992 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1432/2842] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:45:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:45:13.151120 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a8a85-b3c2-4c0e-b029-65694d63beec None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:13.151633 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a8a85-b3c2-4c0e-b029-65694d63beec None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:13.151753 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a8a85-b3c2-4c0e-b029-65694d63beec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:13.177372 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-d85a8a85-b3c2-4c0e-b029-65694d63beec None None] MFA Rules not processed for user `ee94d849afa6476bb4bfbdfde24fd9d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:45:13.178581 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-d85a8a85-b3c2-4c0e-b029-65694d63beec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:45:13.206811 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:45:13.253357 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1411/2843] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:45:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:45:13.257755 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c5dba6-cb0e-4710-b7f4-b95dad9067c9 service neutron] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:13.268177 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c5dba6-cb0e-4710-b7f4-b95dad9067c9 service neutron] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:13.273137 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b99788-a3ff-457b-8ec0-cfa80e8161ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:13.273821 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b99788-a3ff-457b-8ec0-cfa80e8161ab admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:13.274104 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b99788-a3ff-457b-8ec0-cfa80e8161ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:13.274380 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b99788-a3ff-457b-8ec0-cfa80e8161ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:13.275106 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b99788-a3ff-457b-8ec0-cfa80e8161ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:13.277076 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b99788-a3ff-457b-8ec0-cfa80e8161ab admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:13.303584 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1433/2844] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:45:13 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:45:13.308192 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85a8a85-b3c2-4c0e-b029-65694d63beec None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:13.319262 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85a8a85-b3c2-4c0e-b029-65694d63beec None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:13.376063 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8fa9eb-886e-4323-8a38-f1b6664ad3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:13.376729 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8fa9eb-886e-4323-8a38-f1b6664ad3c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:13.377013 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8fa9eb-886e-4323-8a38-f1b6664ad3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:13.377319 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8fa9eb-886e-4323-8a38-f1b6664ad3c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:13.378004 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8fa9eb-886e-4323-8a38-f1b6664ad3c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:13.379917 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8fa9eb-886e-4323-8a38-f1b6664ad3c2 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:13.400091 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1412/2845] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:45:13 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:45:13.404311 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b99788-a3ff-457b-8ec0-cfa80e8161ab admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:13.414674 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b99788-a3ff-457b-8ec0-cfa80e8161ab admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:13.419821 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21777024-b96b-45c8-88bb-9fc2d9c8cc26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:13.420474 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21777024-b96b-45c8-88bb-9fc2d9c8cc26 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:13.420762 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21777024-b96b-45c8-88bb-9fc2d9c8cc26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:13.421043 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21777024-b96b-45c8-88bb-9fc2d9c8cc26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:13.421802 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21777024-b96b-45c8-88bb-9fc2d9c8cc26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:13.423373 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21777024-b96b-45c8-88bb-9fc2d9c8cc26 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:13.434329 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1434/2846] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:45:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:45:13.438377 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8fa9eb-886e-4323-8a38-f1b6664ad3c2 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:13.448169 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8fa9eb-886e-4323-8a38-f1b6664ad3c2 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:13.452847 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305aa681-c887-452c-8678-574579a86176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:13.453753 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305aa681-c887-452c-8678-574579a86176 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:13.454040 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305aa681-c887-452c-8678-574579a86176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:13.454317 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305aa681-c887-452c-8678-574579a86176 admin admin] PATH_INFO: `/v3/projects/854e5c109d2842d6b8bcd3a4f61c6321/users/56d6117fc5094217b646b7d1ddec7335/roles/6cb03785fb184ef587509b3174622f69` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:13.468616 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305aa681-c887-452c-8678-574579a86176 admin admin] RBAC: Authorizing `identity:create_grant(project_id=854e5c109d2842d6b8bcd3a4f61c6321, user_id=56d6117fc5094217b646b7d1ddec7335, role_id=6cb03785fb184ef587509b3174622f69)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:13.471308 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305aa681-c887-452c-8678-574579a86176 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:13.484704 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1413/2847] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:45:13 2022] PUT /identity/v3/projects/854e5c109d2842d6b8bcd3a4f61c6321/users/56d6117fc5094217b646b7d1ddec7335/roles/6cb03785fb184ef587509b3174622f69 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:45:13.488692 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21777024-b96b-45c8-88bb-9fc2d9c8cc26 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:13.499634 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21777024-b96b-45c8-88bb-9fc2d9c8cc26 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:13.558479 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8595a787-9241-459c-aacf-a4cad9a6bd5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:13.559136 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595a787-9241-459c-aacf-a4cad9a6bd5c admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:13.559421 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595a787-9241-459c-aacf-a4cad9a6bd5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:13.559697 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595a787-9241-459c-aacf-a4cad9a6bd5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:13.560413 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8595a787-9241-459c-aacf-a4cad9a6bd5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:13.562033 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8595a787-9241-459c-aacf-a4cad9a6bd5c admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:13.571504 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1435/2848] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:45:13 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:45:13.575668 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305aa681-c887-452c-8678-574579a86176 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:13.585894 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305aa681-c887-452c-8678-574579a86176 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:13.591011 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb185f4-d508-4ab4-9608-082ea80c7c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:13.591880 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb185f4-d508-4ab4-9608-082ea80c7c3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:13.592165 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb185f4-d508-4ab4-9608-082ea80c7c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:13.592444 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb185f4-d508-4ab4-9608-082ea80c7c3b admin admin] PATH_INFO: `/v3/projects/854e5c109d2842d6b8bcd3a4f61c6321/users/56d6117fc5094217b646b7d1ddec7335/roles/6cb03785fb184ef587509b3174622f69` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:13.594432 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb185f4-d508-4ab4-9608-082ea80c7c3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=854e5c109d2842d6b8bcd3a4f61c6321, user_id=56d6117fc5094217b646b7d1ddec7335, role_id=6cb03785fb184ef587509b3174622f69)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:13.597115 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb185f4-d508-4ab4-9608-082ea80c7c3b admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:13.608448 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1414/2849] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:45:13 2022] PUT /identity/v3/projects/854e5c109d2842d6b8bcd3a4f61c6321/users/56d6117fc5094217b646b7d1ddec7335/roles/6cb03785fb184ef587509b3174622f69 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:45:14.209387 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b72ee-06b4-4da5-b442-993ff3cf163e None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:14.209690 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b72ee-06b4-4da5-b442-993ff3cf163e None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:14.209976 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b72ee-06b4-4da5-b442-993ff3cf163e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:14.236688 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-d66b72ee-06b4-4da5-b442-993ff3cf163e None None] MFA Rules not processed for user `56d6117fc5094217b646b7d1ddec7335`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:45:14.238039 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-d66b72ee-06b4-4da5-b442-993ff3cf163e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:45:14.250059 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:45:14.312700 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1436/2850] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:45:14 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:45:14.324251 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231cfe5-b898-4b94-8e46-314263375116 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:14.324871 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231cfe5-b898-4b94-8e46-314263375116 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:14.324871 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231cfe5-b898-4b94-8e46-314263375116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:14.343510 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-e231cfe5-b898-4b94-8e46-314263375116 None None] MFA Rules not processed for user `ee94d849afa6476bb4bfbdfde24fd9d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:45:14.344728 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-e231cfe5-b898-4b94-8e46-314263375116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:45:14.403357 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1415/2851] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:45:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:45:14.417611 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66b72ee-06b4-4da5-b442-993ff3cf163e None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:14.419426 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-d66b72ee-06b4-4da5-b442-993ff3cf163e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:45:14.495200 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66b72ee-06b4-4da5-b442-993ff3cf163e None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:14.500905 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c4ebd3-1533-4c0b-b17d-c9e74352f006 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13fd76fc7dd1410b9cde5adbaa6cb2e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:14.501604 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c4ebd3-1533-4c0b-b17d-c9e74352f006 service nova] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:14.501883 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c4ebd3-1533-4c0b-b17d-c9e74352f006 service nova] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:14.502190 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c4ebd3-1533-4c0b-b17d-c9e74352f006 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:14.511549 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c4ebd3-1533-4c0b-b17d-c9e74352f006 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:14.513917 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c4ebd3-1533-4c0b-b17d-c9e74352f006 service nova] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:14.523186 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1437/2852] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:45:14 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:45:14.749814 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e231cfe5-b898-4b94-8e46-314263375116 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:14.751286 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-e231cfe5-b898-4b94-8e46-314263375116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:45:14.777928 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:45:14.809111 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e231cfe5-b898-4b94-8e46-314263375116 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:14.812758 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c7be1-6bb5-4f65-a05a-7f8588449bbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:14.813829 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c7be1-6bb5-4f65-a05a-7f8588449bbc service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:14.813829 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c7be1-6bb5-4f65-a05a-7f8588449bbc service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:14.814051 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c7be1-6bb5-4f65-a05a-7f8588449bbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:14.815968 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-bb5c7be1-6bb5-4f65-a05a-7f8588449bbc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:45:14.826873 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5c7be1-6bb5-4f65-a05a-7f8588449bbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:14.828388 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5c7be1-6bb5-4f65-a05a-7f8588449bbc service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:14.836423 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1416/2853] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:45:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:45:15.153527 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c4ebd3-1533-4c0b-b17d-c9e74352f006 service nova] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:15.155276 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-93c4ebd3-1533-4c0b-b17d-c9e74352f006 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:45:15.226934 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c4ebd3-1533-4c0b-b17d-c9e74352f006 service nova] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:15.232527 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3413e48-0248-481d-8e02-fecc5ae7f1d0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '941e65d95bcd4e66a6489280520c12de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:15.233172 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3413e48-0248-481d-8e02-fecc5ae7f1d0 service placement] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:15.233486 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3413e48-0248-481d-8e02-fecc5ae7f1d0 service placement] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:15.233768 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3413e48-0248-481d-8e02-fecc5ae7f1d0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:15.235526 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-e3413e48-0248-481d-8e02-fecc5ae7f1d0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:45:15.247398 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3413e48-0248-481d-8e02-fecc5ae7f1d0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:15.248954 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3413e48-0248-481d-8e02-fecc5ae7f1d0 service placement] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:15.258971 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1438/2854] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:45:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:45:16.940945 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c7be1-6bb5-4f65-a05a-7f8588449bbc service neutron] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:16.950632 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c7be1-6bb5-4f65-a05a-7f8588449bbc service neutron] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:16.954195 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5692d428-107d-4d48-b0b7-651348b2b35c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:16.954821 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5692d428-107d-4d48-b0b7-651348b2b35c service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:16.955105 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5692d428-107d-4d48-b0b7-651348b2b35c service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:16.955396 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5692d428-107d-4d48-b0b7-651348b2b35c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:16.957124 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-5692d428-107d-4d48-b0b7-651348b2b35c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:45:16.966462 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5692d428-107d-4d48-b0b7-651348b2b35c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:16.967877 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5692d428-107d-4d48-b0b7-651348b2b35c service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:16.975652 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1417/2855] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:45:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 19:45:25.254563 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=89 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:45:26.972259 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=22 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:45:27.477428 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3413e48-0248-481d-8e02-fecc5ae7f1d0 service placement] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:27.478821 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-e3413e48-0248-481d-8e02-fecc5ae7f1d0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:45:27.534303 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3413e48-0248-481d-8e02-fecc5ae7f1d0 service placement] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:27.537967 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42000ef-dac6-4eef-b1ed-ea31ba21682d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a3ed285ee4c4d04abf7daf0aeb9fb7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:27.538608 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42000ef-dac6-4eef-b1ed-ea31ba21682d service cinder] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:27.538894 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42000ef-dac6-4eef-b1ed-ea31ba21682d service cinder] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:27.539173 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42000ef-dac6-4eef-b1ed-ea31ba21682d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:27.548632 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42000ef-dac6-4eef-b1ed-ea31ba21682d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:27.550111 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42000ef-dac6-4eef-b1ed-ea31ba21682d service cinder] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:27.560097 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1439/2856] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:45:27 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:45:30.093267 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5692d428-107d-4d48-b0b7-651348b2b35c service neutron] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:30.108280 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5692d428-107d-4d48-b0b7-651348b2b35c service neutron] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:30.114151 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a2673-80bb-4d62-8fe4-360b5b5f72af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13fd76fc7dd1410b9cde5adbaa6cb2e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:30.114981 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a2673-80bb-4d62-8fe4-360b5b5f72af service nova] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:30.115269 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a2673-80bb-4d62-8fe4-360b5b5f72af service nova] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:30.115546 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a2673-80bb-4d62-8fe4-360b5b5f72af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:30.117547 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-3b4a2673-80bb-4d62-8fe4-360b5b5f72af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:45:30.130965 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4a2673-80bb-4d62-8fe4-360b5b5f72af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:30.132559 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4a2673-80bb-4d62-8fe4-360b5b5f72af service nova] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:30.143395 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1418/2857] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:45:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:45:37.555390 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=26 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:45:40.138625 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=6 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:45:46.325101 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42000ef-dac6-4eef-b1ed-ea31ba21682d service cinder] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:46.326631 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-c42000ef-dac6-4eef-b1ed-ea31ba21682d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:45:46.341954 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42000ef-dac6-4eef-b1ed-ea31ba21682d service cinder] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:46.347369 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14076e48-acbc-42c5-b2df-197fd4430fa7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '941e65d95bcd4e66a6489280520c12de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:46.348040 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14076e48-acbc-42c5-b2df-197fd4430fa7 service placement] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:46.348364 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14076e48-acbc-42c5-b2df-197fd4430fa7 service placement] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:46.348772 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14076e48-acbc-42c5-b2df-197fd4430fa7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:46.350525 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-14076e48-acbc-42c5-b2df-197fd4430fa7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:45:46.362488 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14076e48-acbc-42c5-b2df-197fd4430fa7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:46.364063 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14076e48-acbc-42c5-b2df-197fd4430fa7 service placement] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:46.384713 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1440/2858] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:45:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:45:47.068541 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a2673-80bb-4d62-8fe4-360b5b5f72af service nova] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:47.080209 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a2673-80bb-4d62-8fe4-360b5b5f72af service nova] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:47.085594 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a19b0c8-8f93-4b33-8bc4-38225ce10274 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '941e65d95bcd4e66a6489280520c12de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:47.086229 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a19b0c8-8f93-4b33-8bc4-38225ce10274 service placement] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:47.086512 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a19b0c8-8f93-4b33-8bc4-38225ce10274 service placement] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:47.086790 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a19b0c8-8f93-4b33-8bc4-38225ce10274 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:47.088542 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-0a19b0c8-8f93-4b33-8bc4-38225ce10274 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:45:47.100593 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a19b0c8-8f93-4b33-8bc4-38225ce10274 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:47.102212 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a19b0c8-8f93-4b33-8bc4-38225ce10274 service placement] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:47.113640 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1419/2859] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:45:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:45:47.134781 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14076e48-acbc-42c5-b2df-197fd4430fa7 service placement] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:47.197516 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14076e48-acbc-42c5-b2df-197fd4430fa7 service placement] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:47.201936 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b948af2e-78e8-4d6e-92e0-6c1ea216ae71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:47.202791 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b948af2e-78e8-4d6e-92e0-6c1ea216ae71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:47.203071 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b948af2e-78e8-4d6e-92e0-6c1ea216ae71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:47.203343 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b948af2e-78e8-4d6e-92e0-6c1ea216ae71 admin admin] PATH_INFO: `/v3/users/ee94d849afa6476bb4bfbdfde24fd9d5` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:47.205169 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b948af2e-78e8-4d6e-92e0-6c1ea216ae71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee94d849afa6476bb4bfbdfde24fd9d5)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:47.207086 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b948af2e-78e8-4d6e-92e0-6c1ea216ae71 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:47.252085 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-b948af2e-78e8-4d6e-92e0-6c1ea216ae71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee94d849afa6476bb4bfbdfde24fd9d5'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:47.252748 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-b948af2e-78e8-4d6e-92e0-6c1ea216ae71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee94d849afa6476bb4bfbdfde24fd9d5'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:47.264507 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-b948af2e-78e8-4d6e-92e0-6c1ea216ae71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee94d849afa6476bb4bfbdfde24fd9d5'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:47.271473 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-b948af2e-78e8-4d6e-92e0-6c1ea216ae71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee94d849afa6476bb4bfbdfde24fd9d5'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:47.278671 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-b948af2e-78e8-4d6e-92e0-6c1ea216ae71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee94d849afa6476bb4bfbdfde24fd9d5'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:47.284804 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1441/2860] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:45:47 2022] DELETE /identity/v3/users/ee94d849afa6476bb4bfbdfde24fd9d5 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:45:47.457101 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a19b0c8-8f93-4b33-8bc4-38225ce10274 service placement] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:47.468404 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a19b0c8-8f93-4b33-8bc4-38225ce10274 service placement] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:47.523437 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016d4ec0-8d34-4898-8e71-16ab780a8b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:47.524287 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d4ec0-8d34-4898-8e71-16ab780a8b1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:47.524568 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d4ec0-8d34-4898-8e71-16ab780a8b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:47.524842 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d4ec0-8d34-4898-8e71-16ab780a8b1d admin admin] PATH_INFO: `/v3/projects/188dbe6b99ee4859a7ef52dd2d332777` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:47.526041 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016d4ec0-8d34-4898-8e71-16ab780a8b1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=188dbe6b99ee4859a7ef52dd2d332777)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:47.527933 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016d4ec0-8d34-4898-8e71-16ab780a8b1d admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:47.573497 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-016d4ec0-8d34-4898-8e71-16ab780a8b1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '188dbe6b99ee4859a7ef52dd2d332777', 'request_id': 'req-016d4ec0-8d34-4898-8e71-16ab780a8b1d'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:47.578941 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-016d4ec0-8d34-4898-8e71-16ab780a8b1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '188dbe6b99ee4859a7ef52dd2d332777', 'request_id': 'req-016d4ec0-8d34-4898-8e71-16ab780a8b1d'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:47.585300 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-016d4ec0-8d34-4898-8e71-16ab780a8b1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '188dbe6b99ee4859a7ef52dd2d332777', 'request_id': 'req-016d4ec0-8d34-4898-8e71-16ab780a8b1d'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:47.597850 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-016d4ec0-8d34-4898-8e71-16ab780a8b1d admin admin] The token cache is being invalidate because project 188dbe6b99ee4859a7ef52dd2d332777 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:45:47.598135 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-016d4ec0-8d34-4898-8e71-16ab780a8b1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:47.598746 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-016d4ec0-8d34-4898-8e71-16ab780a8b1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:47.600311 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1420/2861] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:45:47 2022] DELETE /identity/v3/projects/188dbe6b99ee4859a7ef52dd2d332777 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:45:47.604249 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b948af2e-78e8-4d6e-92e0-6c1ea216ae71 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:47.605717 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-b948af2e-78e8-4d6e-92e0-6c1ea216ae71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:45:47.619195 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b948af2e-78e8-4d6e-92e0-6c1ea216ae71 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:47.676170 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b92cf7-e42d-4757-b4a1-170b7d440fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:47.677031 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b92cf7-e42d-4757-b4a1-170b7d440fa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:47.677358 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b92cf7-e42d-4757-b4a1-170b7d440fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:47.677639 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b92cf7-e42d-4757-b4a1-170b7d440fa7 admin admin] PATH_INFO: `/v3/users/56d6117fc5094217b646b7d1ddec7335` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:47.678816 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b92cf7-e42d-4757-b4a1-170b7d440fa7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56d6117fc5094217b646b7d1ddec7335)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:47.680728 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b92cf7-e42d-4757-b4a1-170b7d440fa7 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:47.685902 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:45:47.727367 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-c4b92cf7-e42d-4757-b4a1-170b7d440fa7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56d6117fc5094217b646b7d1ddec7335'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:47.727940 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-c4b92cf7-e42d-4757-b4a1-170b7d440fa7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56d6117fc5094217b646b7d1ddec7335'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:47.740362 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-c4b92cf7-e42d-4757-b4a1-170b7d440fa7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56d6117fc5094217b646b7d1ddec7335'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:47.747062 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-c4b92cf7-e42d-4757-b4a1-170b7d440fa7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56d6117fc5094217b646b7d1ddec7335'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:47.753999 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-c4b92cf7-e42d-4757-b4a1-170b7d440fa7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56d6117fc5094217b646b7d1ddec7335'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:47.759780 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1442/2862] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:45:47 2022] DELETE /identity/v3/users/56d6117fc5094217b646b7d1ddec7335 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:45:47.931544 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016d4ec0-8d34-4898-8e71-16ab780a8b1d admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:47.932991 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-016d4ec0-8d34-4898-8e71-16ab780a8b1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:45:47.945398 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016d4ec0-8d34-4898-8e71-16ab780a8b1d admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:48.003485 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fcde26-5d7e-45e8-ad88-0743d06cf7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:48.004268 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fcde26-5d7e-45e8-ad88-0743d06cf7d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:48.004550 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fcde26-5d7e-45e8-ad88-0743d06cf7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:48.004824 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fcde26-5d7e-45e8-ad88-0743d06cf7d6 admin admin] PATH_INFO: `/v3/projects/854e5c109d2842d6b8bcd3a4f61c6321` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:48.006087 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fcde26-5d7e-45e8-ad88-0743d06cf7d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=854e5c109d2842d6b8bcd3a4f61c6321)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:48.008000 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fcde26-5d7e-45e8-ad88-0743d06cf7d6 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:48.028615 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:45:48.056308 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-75fcde26-5d7e-45e8-ad88-0743d06cf7d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '854e5c109d2842d6b8bcd3a4f61c6321', 'request_id': 'req-75fcde26-5d7e-45e8-ad88-0743d06cf7d6'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:48.061641 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-75fcde26-5d7e-45e8-ad88-0743d06cf7d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '854e5c109d2842d6b8bcd3a4f61c6321', 'request_id': 'req-75fcde26-5d7e-45e8-ad88-0743d06cf7d6'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:48.067632 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-75fcde26-5d7e-45e8-ad88-0743d06cf7d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '854e5c109d2842d6b8bcd3a4f61c6321', 'request_id': 'req-75fcde26-5d7e-45e8-ad88-0743d06cf7d6'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:48.080267 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-75fcde26-5d7e-45e8-ad88-0743d06cf7d6 admin admin] The token cache is being invalidate because project 854e5c109d2842d6b8bcd3a4f61c6321 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:45:48.080863 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-75fcde26-5d7e-45e8-ad88-0743d06cf7d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:48.081420 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-75fcde26-5d7e-45e8-ad88-0743d06cf7d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:48.083335 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1421/2863] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:45:47 2022] DELETE /identity/v3/projects/854e5c109d2842d6b8bcd3a4f61c6321 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:45:48.087908 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52497f6-982d-49e1-90c8-08756e72d6a1 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:48.088203 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52497f6-982d-49e1-90c8-08756e72d6a1 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:48.088487 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52497f6-982d-49e1-90c8-08756e72d6a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:48.108209 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-b52497f6-982d-49e1-90c8-08756e72d6a1 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:45:48.109455 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-b52497f6-982d-49e1-90c8-08756e72d6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:45:48.168259 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1443/2864] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:45:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:45:48.176072 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423f18d-3621-4ddc-acb5-c07bd21442ce None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:48.176363 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423f18d-3621-4ddc-acb5-c07bd21442ce None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:48.176645 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423f18d-3621-4ddc-acb5-c07bd21442ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:48.194620 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-f423f18d-3621-4ddc-acb5-c07bd21442ce None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:45:48.195859 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-f423f18d-3621-4ddc-acb5-c07bd21442ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:45:48.204220 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1422/2865] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:45:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:45:48.208413 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52497f6-982d-49e1-90c8-08756e72d6a1 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:48.217952 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52497f6-982d-49e1-90c8-08756e72d6a1 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:48.223228 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d5772-c663-4783-81d1-dcc27a101d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:48.223959 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d5772-c663-4783-81d1-dcc27a101d15 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:48.224247 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d5772-c663-4783-81d1-dcc27a101d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:48.224526 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d5772-c663-4783-81d1-dcc27a101d15 admin admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:48.225281 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09d5772-c663-4783-81d1-dcc27a101d15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:45:48.225596 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09d5772-c663-4783-81d1-dcc27a101d15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:48.227190 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09d5772-c663-4783-81d1-dcc27a101d15 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:48.238767 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1444/2866] 10.222.0.26 () {58 vars in 1152 bytes} [Fri Jul 1 19:45:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:45:48.242889 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f423f18d-3621-4ddc-acb5-c07bd21442ce None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:48.252001 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f423f18d-3621-4ddc-acb5-c07bd21442ce None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:48.256803 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d1f62-33b6-4967-af73-875e11a4a18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:48.257427 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d1f62-33b6-4967-af73-875e11a4a18f admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:48.257714 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d1f62-33b6-4967-af73-875e11a4a18f admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:48.257990 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d1f62-33b6-4967-af73-875e11a4a18f admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:48.258690 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105d1f62-33b6-4967-af73-875e11a4a18f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:48.260610 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105d1f62-33b6-4967-af73-875e11a4a18f admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:48.286694 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1423/2867] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:45:48 2022] POST /identity/v3/projects => generated 377 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 19:45:48.290939 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d5772-c663-4783-81d1-dcc27a101d15 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:48.300945 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d5772-c663-4783-81d1-dcc27a101d15 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:48.355782 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683a146c-c905-4a69-b761-39a31502d3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:48.356436 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683a146c-c905-4a69-b761-39a31502d3ff admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:48.356718 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683a146c-c905-4a69-b761-39a31502d3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:48.356992 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683a146c-c905-4a69-b761-39a31502d3ff admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:48.357797 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683a146c-c905-4a69-b761-39a31502d3ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:48.359720 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683a146c-c905-4a69-b761-39a31502d3ff admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:48.379467 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1445/2868] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:45:48 2022] POST /identity/v3/users => generated 289 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:45:48.383754 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d1f62-33b6-4967-af73-875e11a4a18f admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:48.394742 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d1f62-33b6-4967-af73-875e11a4a18f admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:48.400078 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f94068-fd81-4ade-8813-7aa882399584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:48.400733 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f94068-fd81-4ade-8813-7aa882399584 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:48.401016 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f94068-fd81-4ade-8813-7aa882399584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:48.401334 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f94068-fd81-4ade-8813-7aa882399584 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:48.402057 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f94068-fd81-4ade-8813-7aa882399584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:48.403663 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f94068-fd81-4ade-8813-7aa882399584 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:48.414479 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1424/2869] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:45:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:45:48.418279 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683a146c-c905-4a69-b761-39a31502d3ff admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:48.423275 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:45:48.429642 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683a146c-c905-4a69-b761-39a31502d3ff admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:48.435782 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044a2065-c850-49c9-8e7b-0285c9126901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:48.436626 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044a2065-c850-49c9-8e7b-0285c9126901 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:48.437303 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044a2065-c850-49c9-8e7b-0285c9126901 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:48.437589 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044a2065-c850-49c9-8e7b-0285c9126901 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:48.438837 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044a2065-c850-49c9-8e7b-0285c9126901 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:48.440421 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044a2065-c850-49c9-8e7b-0285c9126901 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:48.450724 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1446/2870] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:45:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:45:48.455697 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f94068-fd81-4ade-8813-7aa882399584 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:48.465788 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f94068-fd81-4ade-8813-7aa882399584 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:48.470435 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ced417-18d7-440d-bfb8-93c55460f9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:48.471304 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ced417-18d7-440d-bfb8-93c55460f9e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:48.471601 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ced417-18d7-440d-bfb8-93c55460f9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:48.471877 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ced417-18d7-440d-bfb8-93c55460f9e4 admin admin] PATH_INFO: `/v3/projects/c1f40152ade64f5dba93e6528c35d035/users/35fc6afb48554a82ba1f9da01b2da601/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:48.486216 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ced417-18d7-440d-bfb8-93c55460f9e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1f40152ade64f5dba93e6528c35d035, user_id=35fc6afb48554a82ba1f9da01b2da601, role_id=4cbf6ec846eb4b7c8cc52e9bfd6f076f)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:48.488885 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ced417-18d7-440d-bfb8-93c55460f9e4 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:48.503047 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1425/2871] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:45:48 2022] PUT /identity/v3/projects/c1f40152ade64f5dba93e6528c35d035/users/35fc6afb48554a82ba1f9da01b2da601/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:45:48.513120 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47c633-5572-44d1-a781-e179c24b6602 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:48.513669 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47c633-5572-44d1-a781-e179c24b6602 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:48.513961 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47c633-5572-44d1-a781-e179c24b6602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:48.540942 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-4e47c633-5572-44d1-a781-e179c24b6602 None None] MFA Rules not processed for user `35fc6afb48554a82ba1f9da01b2da601`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:45:48.542184 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-4e47c633-5572-44d1-a781-e179c24b6602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:45:48.605542 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1447/2872] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:45:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:45:48.609992 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ced417-18d7-440d-bfb8-93c55460f9e4 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:48.674797 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ced417-18d7-440d-bfb8-93c55460f9e4 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:48.679727 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e76b39-5076-4585-9776-b8ff2bd76761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:48.680376 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e76b39-5076-4585-9776-b8ff2bd76761 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:48.680660 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e76b39-5076-4585-9776-b8ff2bd76761 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:48.680934 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e76b39-5076-4585-9776-b8ff2bd76761 admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:48.681655 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e76b39-5076-4585-9776-b8ff2bd76761 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:48.683557 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e76b39-5076-4585-9776-b8ff2bd76761 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:48.709044 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1426/2873] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:45:48 2022] POST /identity/v3/projects => generated 375 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:45:48.713086 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e47c633-5572-44d1-a781-e179c24b6602 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:48.723732 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e47c633-5572-44d1-a781-e179c24b6602 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:48.779270 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c087560-ac42-454f-84a1-b2b829473c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:48.779862 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c087560-ac42-454f-84a1-b2b829473c8e admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:48.780405 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c087560-ac42-454f-84a1-b2b829473c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:48.780682 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c087560-ac42-454f-84a1-b2b829473c8e admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:48.781405 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c087560-ac42-454f-84a1-b2b829473c8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:48.783403 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c087560-ac42-454f-84a1-b2b829473c8e admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:48.805716 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1448/2874] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:45:48 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:45:48.809634 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e76b39-5076-4585-9776-b8ff2bd76761 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:48.820489 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e76b39-5076-4585-9776-b8ff2bd76761 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:48.825062 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af0d839-41d1-4273-8748-dc2e9dd1bf6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:48.825777 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af0d839-41d1-4273-8748-dc2e9dd1bf6f admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:48.826060 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af0d839-41d1-4273-8748-dc2e9dd1bf6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:48.826335 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af0d839-41d1-4273-8748-dc2e9dd1bf6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:48.827079 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af0d839-41d1-4273-8748-dc2e9dd1bf6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:48.828721 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af0d839-41d1-4273-8748-dc2e9dd1bf6f admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:48.839321 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1427/2875] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:45:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 19:45:48.843490 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c087560-ac42-454f-84a1-b2b829473c8e admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:48.853413 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c087560-ac42-454f-84a1-b2b829473c8e admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:48.858060 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca1a9e-f725-4a64-8b7d-d90ab38bdf15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:48.858714 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca1a9e-f725-4a64-8b7d-d90ab38bdf15 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:48.859002 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca1a9e-f725-4a64-8b7d-d90ab38bdf15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:48.859281 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca1a9e-f725-4a64-8b7d-d90ab38bdf15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:48.860498 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ca1a9e-f725-4a64-8b7d-d90ab38bdf15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:48.862103 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ca1a9e-f725-4a64-8b7d-d90ab38bdf15 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:48.871988 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1449/2876] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:45:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:45:48.876438 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af0d839-41d1-4273-8748-dc2e9dd1bf6f admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:48.886254 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af0d839-41d1-4273-8748-dc2e9dd1bf6f admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:48.891103 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d8d72d-7059-4dff-94cd-c42b0b31102c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:48.891976 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d8d72d-7059-4dff-94cd-c42b0b31102c admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:48.892256 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d8d72d-7059-4dff-94cd-c42b0b31102c admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:48.892533 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d8d72d-7059-4dff-94cd-c42b0b31102c admin admin] PATH_INFO: `/v3/projects/39efea1ec9464348b2afb2e22cdb8b81/users/a8b10b7a664a49caba22bac23c972354/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:48.907311 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d8d72d-7059-4dff-94cd-c42b0b31102c admin admin] RBAC: Authorizing `identity:create_grant(project_id=39efea1ec9464348b2afb2e22cdb8b81, user_id=a8b10b7a664a49caba22bac23c972354, role_id=4cbf6ec846eb4b7c8cc52e9bfd6f076f)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:48.910030 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d8d72d-7059-4dff-94cd-c42b0b31102c admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:48.912169 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:45:48.925186 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1428/2877] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:45:48 2022] PUT /identity/v3/projects/39efea1ec9464348b2afb2e22cdb8b81/users/a8b10b7a664a49caba22bac23c972354/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:45:48.936304 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b4d464-eba3-45a5-9962-6d7f6ee2cf77 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:48.936582 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b4d464-eba3-45a5-9962-6d7f6ee2cf77 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:48.936863 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b4d464-eba3-45a5-9962-6d7f6ee2cf77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:48.963094 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-57b4d464-eba3-45a5-9962-6d7f6ee2cf77 None None] MFA Rules not processed for user `a8b10b7a664a49caba22bac23c972354`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:45:48.964321 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-57b4d464-eba3-45a5-9962-6d7f6ee2cf77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:45:49.010486 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:45:49.028526 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1450/2878] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:45:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:45:49.033370 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d8d72d-7059-4dff-94cd-c42b0b31102c admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:49.093872 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d8d72d-7059-4dff-94cd-c42b0b31102c admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:49.099021 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ae9ca-fb4d-4203-b399-ef8013160f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:49.099671 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ae9ca-fb4d-4203-b399-ef8013160f91 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:49.099959 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ae9ca-fb4d-4203-b399-ef8013160f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:49.100242 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ae9ca-fb4d-4203-b399-ef8013160f91 admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:49.100936 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504ae9ca-fb4d-4203-b399-ef8013160f91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:49.102879 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504ae9ca-fb4d-4203-b399-ef8013160f91 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:49.128148 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1429/2879] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:45:49 2022] POST /identity/v3/projects => generated 377 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:45:49.132219 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b4d464-eba3-45a5-9962-6d7f6ee2cf77 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:49.143252 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b4d464-eba3-45a5-9962-6d7f6ee2cf77 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:49.200035 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ad6367-50b0-4c9a-8d6e-ee849c79bfef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:49.200700 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad6367-50b0-4c9a-8d6e-ee849c79bfef admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:49.200988 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad6367-50b0-4c9a-8d6e-ee849c79bfef admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:49.201297 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad6367-50b0-4c9a-8d6e-ee849c79bfef admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:49.201988 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ad6367-50b0-4c9a-8d6e-ee849c79bfef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:49.203974 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ad6367-50b0-4c9a-8d6e-ee849c79bfef admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:49.223639 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1451/2880] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:45:49 2022] POST /identity/v3/users => generated 295 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:45:49.227573 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ae9ca-fb4d-4203-b399-ef8013160f91 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:49.238423 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ae9ca-fb4d-4203-b399-ef8013160f91 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:49.243389 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8ddb85-f744-42cf-b70f-561ac189bc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:49.244086 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ddb85-f744-42cf-b70f-561ac189bc57 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:49.244376 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ddb85-f744-42cf-b70f-561ac189bc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:49.244683 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ddb85-f744-42cf-b70f-561ac189bc57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:49.245538 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8ddb85-f744-42cf-b70f-561ac189bc57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:49.247163 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8ddb85-f744-42cf-b70f-561ac189bc57 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:49.258352 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1430/2881] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:45:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:45:49.262673 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ad6367-50b0-4c9a-8d6e-ee849c79bfef admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:49.272923 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ad6367-50b0-4c9a-8d6e-ee849c79bfef admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:49.277595 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addcb52c-5cd9-4e63-a86c-6852b22b9fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:49.278479 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addcb52c-5cd9-4e63-a86c-6852b22b9fcb admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:49.278768 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addcb52c-5cd9-4e63-a86c-6852b22b9fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:49.279050 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addcb52c-5cd9-4e63-a86c-6852b22b9fcb admin admin] PATH_INFO: `/v3/projects/a807e75fe72b4f3aa25745a902626ff4/users/ef6ac064cbe6465facdc26abfdffa0e8/roles/6cb03785fb184ef587509b3174622f69` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:49.294264 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addcb52c-5cd9-4e63-a86c-6852b22b9fcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a807e75fe72b4f3aa25745a902626ff4, user_id=ef6ac064cbe6465facdc26abfdffa0e8, role_id=6cb03785fb184ef587509b3174622f69)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:49.296896 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addcb52c-5cd9-4e63-a86c-6852b22b9fcb admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:49.310088 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1452/2882] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:45:49 2022] PUT /identity/v3/projects/a807e75fe72b4f3aa25745a902626ff4/users/ef6ac064cbe6465facdc26abfdffa0e8/roles/6cb03785fb184ef587509b3174622f69 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:45:49.313990 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8ddb85-f744-42cf-b70f-561ac189bc57 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:49.323775 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8ddb85-f744-42cf-b70f-561ac189bc57 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:49.380129 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4515b694-766b-421b-83d2-f19aa58f9cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:49.380794 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515b694-766b-421b-83d2-f19aa58f9cec admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:49.381084 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515b694-766b-421b-83d2-f19aa58f9cec admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:49.381398 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515b694-766b-421b-83d2-f19aa58f9cec admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:49.382219 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4515b694-766b-421b-83d2-f19aa58f9cec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:49.383830 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4515b694-766b-421b-83d2-f19aa58f9cec admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:49.393635 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1431/2883] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:45:49 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:45:49.398372 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addcb52c-5cd9-4e63-a86c-6852b22b9fcb admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:49.409820 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addcb52c-5cd9-4e63-a86c-6852b22b9fcb admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:49.414445 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fccbc4-3ac1-4d1a-bcf8-3e0f3132998a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:49.415320 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fccbc4-3ac1-4d1a-bcf8-3e0f3132998a admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:49.415611 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fccbc4-3ac1-4d1a-bcf8-3e0f3132998a admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:49.415928 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fccbc4-3ac1-4d1a-bcf8-3e0f3132998a admin admin] PATH_INFO: `/v3/projects/a807e75fe72b4f3aa25745a902626ff4/users/ef6ac064cbe6465facdc26abfdffa0e8/roles/6cb03785fb184ef587509b3174622f69` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:49.417935 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fccbc4-3ac1-4d1a-bcf8-3e0f3132998a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a807e75fe72b4f3aa25745a902626ff4, user_id=ef6ac064cbe6465facdc26abfdffa0e8, role_id=6cb03785fb184ef587509b3174622f69)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:49.420580 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fccbc4-3ac1-4d1a-bcf8-3e0f3132998a admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:49.431570 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1453/2884] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:45:49 2022] PUT /identity/v3/projects/a807e75fe72b4f3aa25745a902626ff4/users/ef6ac064cbe6465facdc26abfdffa0e8/roles/6cb03785fb184ef587509b3174622f69 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:45:49.441733 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e58629-410b-4b33-8197-922c2a320529 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:49.442271 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e58629-410b-4b33-8197-922c2a320529 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:49.442603 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e58629-410b-4b33-8197-922c2a320529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:49.469109 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-b7e58629-410b-4b33-8197-922c2a320529 None None] MFA Rules not processed for user `ef6ac064cbe6465facdc26abfdffa0e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:45:49.470928 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-b7e58629-410b-4b33-8197-922c2a320529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:45:49.519596 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:45:49.540069 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1432/2885] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:45:49 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:45:49.551637 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fccbc4-3ac1-4d1a-bcf8-3e0f3132998a admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:49.553407 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-f8fccbc4-3ac1-4d1a-bcf8-3e0f3132998a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:45:49.610808 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fccbc4-3ac1-4d1a-bcf8-3e0f3132998a admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:49.614658 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb44e61-0136-4d40-92d3-ef17b1c98944 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a3ed285ee4c4d04abf7daf0aeb9fb7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:49.615296 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb44e61-0136-4d40-92d3-ef17b1c98944 service cinder] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:49.615587 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb44e61-0136-4d40-92d3-ef17b1c98944 service cinder] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:49.615870 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb44e61-0136-4d40-92d3-ef17b1c98944 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:49.670690 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:45:49.674072 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb44e61-0136-4d40-92d3-ef17b1c98944 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:49.676191 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb44e61-0136-4d40-92d3-ef17b1c98944 service cinder] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:49.685383 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1454/2886] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:45:49 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:45:51.150308 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e58629-410b-4b33-8197-922c2a320529 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:51.151761 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-b7e58629-410b-4b33-8197-922c2a320529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:45:51.164844 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e58629-410b-4b33-8197-922c2a320529 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:51.168352 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1d8309-af8e-4144-87e8-bd0187404139 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a3ed285ee4c4d04abf7daf0aeb9fb7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:51.168985 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d8309-af8e-4144-87e8-bd0187404139 service cinder] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:51.169292 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d8309-af8e-4144-87e8-bd0187404139 service cinder] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:51.169574 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d8309-af8e-4144-87e8-bd0187404139 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:51.223769 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1d8309-af8e-4144-87e8-bd0187404139 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:51.225128 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1d8309-af8e-4144-87e8-bd0187404139 service cinder] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:51.233838 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1433/2887] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:45:51 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 19:45:51.748751 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb44e61-0136-4d40-92d3-ef17b1c98944 service cinder] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:51.758056 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb44e61-0136-4d40-92d3-ef17b1c98944 service cinder] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:51.761792 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d179e897-e912-4764-a8cb-b31a881f8a33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a3ed285ee4c4d04abf7daf0aeb9fb7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:51.762434 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179e897-e912-4764-a8cb-b31a881f8a33 service cinder] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:51.762723 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179e897-e912-4764-a8cb-b31a881f8a33 service cinder] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:51.763018 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179e897-e912-4764-a8cb-b31a881f8a33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:51.772497 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d179e897-e912-4764-a8cb-b31a881f8a33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:51.773959 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d179e897-e912-4764-a8cb-b31a881f8a33 service cinder] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:51.784436 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1455/2888] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:45:51 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:45:55.591672 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1d8309-af8e-4144-87e8-bd0187404139 service cinder] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:55.654192 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1d8309-af8e-4144-87e8-bd0187404139 service cinder] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:55.659000 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bab9e2c-95e3-4a7d-a0d9-f18ab6562ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:55.659865 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab9e2c-95e3-4a7d-a0d9-f18ab6562ffe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:55.660151 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab9e2c-95e3-4a7d-a0d9-f18ab6562ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:55.660431 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab9e2c-95e3-4a7d-a0d9-f18ab6562ffe admin admin] PATH_INFO: `/v3/users/35fc6afb48554a82ba1f9da01b2da601` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:55.661781 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bab9e2c-95e3-4a7d-a0d9-f18ab6562ffe admin admin] RBAC: Authorizing `identity:delete_user(user_id=35fc6afb48554a82ba1f9da01b2da601)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:55.663764 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bab9e2c-95e3-4a7d-a0d9-f18ab6562ffe admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:55.710004 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-0bab9e2c-95e3-4a7d-a0d9-f18ab6562ffe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35fc6afb48554a82ba1f9da01b2da601'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:55.710664 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-0bab9e2c-95e3-4a7d-a0d9-f18ab6562ffe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35fc6afb48554a82ba1f9da01b2da601'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:55.717517 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-0bab9e2c-95e3-4a7d-a0d9-f18ab6562ffe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35fc6afb48554a82ba1f9da01b2da601'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:55.725212 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-0bab9e2c-95e3-4a7d-a0d9-f18ab6562ffe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35fc6afb48554a82ba1f9da01b2da601'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:55.725912 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-0bab9e2c-95e3-4a7d-a0d9-f18ab6562ffe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35fc6afb48554a82ba1f9da01b2da601'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:55.743940 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1434/2889] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:45:55 2022] DELETE /identity/v3/users/35fc6afb48554a82ba1f9da01b2da601 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:45:55.748493 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b8b1b-f42f-4530-ab5f-02b8c0afaa38 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:55.748966 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b8b1b-f42f-4530-ab5f-02b8c0afaa38 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:55.749096 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b8b1b-f42f-4530-ab5f-02b8c0afaa38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:55.766448 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-ee4b8b1b-f42f-4530-ab5f-02b8c0afaa38 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:45:55.767663 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-ee4b8b1b-f42f-4530-ab5f-02b8c0afaa38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:45:55.827012 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1456/2890] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:45:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:45:55.836422 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bab9e2c-95e3-4a7d-a0d9-f18ab6562ffe admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:55.837838 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-0bab9e2c-95e3-4a7d-a0d9-f18ab6562ffe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:45:55.848082 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:45:55.898631 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bab9e2c-95e3-4a7d-a0d9-f18ab6562ffe admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:55.902401 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0d118c-1089-424c-a386-d5e4c2a153f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:55.903045 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d118c-1089-424c-a386-d5e4c2a153f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:55.903329 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d118c-1089-424c-a386-d5e4c2a153f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:55.903732 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d118c-1089-424c-a386-d5e4c2a153f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:55.913884 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0d118c-1089-424c-a386-d5e4c2a153f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:55.915334 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0d118c-1089-424c-a386-d5e4c2a153f7 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:55.925289 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1435/2891] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:45:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:45:56.212127 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4b8b1b-f42f-4530-ab5f-02b8c0afaa38 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:56.213704 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-ee4b8b1b-f42f-4530-ab5f-02b8c0afaa38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:45:56.226667 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4b8b1b-f42f-4530-ab5f-02b8c0afaa38 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:56.232520 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0341f6-2090-4a82-a82e-e39948609388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:56.233418 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0341f6-2090-4a82-a82e-e39948609388 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:56.233706 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0341f6-2090-4a82-a82e-e39948609388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:56.233982 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0341f6-2090-4a82-a82e-e39948609388 admin admin] PATH_INFO: `/v3/projects/c1f40152ade64f5dba93e6528c35d035` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:56.235169 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0341f6-2090-4a82-a82e-e39948609388 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1f40152ade64f5dba93e6528c35d035)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:56.238065 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0341f6-2090-4a82-a82e-e39948609388 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:56.299864 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-6a0341f6-2090-4a82-a82e-e39948609388 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1f40152ade64f5dba93e6528c35d035', 'request_id': 'req-6a0341f6-2090-4a82-a82e-e39948609388'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:56.306396 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-6a0341f6-2090-4a82-a82e-e39948609388 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1f40152ade64f5dba93e6528c35d035', 'request_id': 'req-6a0341f6-2090-4a82-a82e-e39948609388'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:56.311933 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-6a0341f6-2090-4a82-a82e-e39948609388 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1f40152ade64f5dba93e6528c35d035', 'request_id': 'req-6a0341f6-2090-4a82-a82e-e39948609388'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:56.324072 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-6a0341f6-2090-4a82-a82e-e39948609388 admin admin] The token cache is being invalidate because project c1f40152ade64f5dba93e6528c35d035 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:45:56.324363 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-6a0341f6-2090-4a82-a82e-e39948609388 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:56.324981 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-6a0341f6-2090-4a82-a82e-e39948609388 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:56.326540 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1457/2892] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:45:56 2022] DELETE /identity/v3/projects/c1f40152ade64f5dba93e6528c35d035 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:45:56.331040 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0d118c-1089-424c-a386-d5e4c2a153f7 service neutron] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:56.340630 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0d118c-1089-424c-a386-d5e4c2a153f7 service neutron] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:56.396354 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93024eb1-5966-4887-b009-e7381431f6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:56.397180 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93024eb1-5966-4887-b009-e7381431f6d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:56.397498 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93024eb1-5966-4887-b009-e7381431f6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:56.397773 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93024eb1-5966-4887-b009-e7381431f6d5 admin admin] PATH_INFO: `/v3/users/a8b10b7a664a49caba22bac23c972354` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:56.398972 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93024eb1-5966-4887-b009-e7381431f6d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8b10b7a664a49caba22bac23c972354)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:56.400888 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93024eb1-5966-4887-b009-e7381431f6d5 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:56.447140 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-93024eb1-5966-4887-b009-e7381431f6d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8b10b7a664a49caba22bac23c972354'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:56.447800 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-93024eb1-5966-4887-b009-e7381431f6d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8b10b7a664a49caba22bac23c972354'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:56.454720 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-93024eb1-5966-4887-b009-e7381431f6d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8b10b7a664a49caba22bac23c972354'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:56.462596 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-93024eb1-5966-4887-b009-e7381431f6d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8b10b7a664a49caba22bac23c972354'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:56.463217 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-93024eb1-5966-4887-b009-e7381431f6d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8b10b7a664a49caba22bac23c972354'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:56.480843 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1436/2893] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:45:56 2022] DELETE /identity/v3/users/a8b10b7a664a49caba22bac23c972354 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:45:56.742724 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0341f6-2090-4a82-a82e-e39948609388 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:56.744216 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-6a0341f6-2090-4a82-a82e-e39948609388 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:45:56.758315 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0341f6-2090-4a82-a82e-e39948609388 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:56.816016 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36de2e87-e76a-4dec-b393-deb6494e1806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:56.816880 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de2e87-e76a-4dec-b393-deb6494e1806 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:56.817171 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de2e87-e76a-4dec-b393-deb6494e1806 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:56.817480 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de2e87-e76a-4dec-b393-deb6494e1806 admin admin] PATH_INFO: `/v3/projects/39efea1ec9464348b2afb2e22cdb8b81` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:56.818709 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36de2e87-e76a-4dec-b393-deb6494e1806 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39efea1ec9464348b2afb2e22cdb8b81)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:56.820622 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36de2e87-e76a-4dec-b393-deb6494e1806 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:56.828599 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:45:56.867892 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-36de2e87-e76a-4dec-b393-deb6494e1806 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39efea1ec9464348b2afb2e22cdb8b81', 'request_id': 'req-36de2e87-e76a-4dec-b393-deb6494e1806'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:56.873947 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-36de2e87-e76a-4dec-b393-deb6494e1806 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39efea1ec9464348b2afb2e22cdb8b81', 'request_id': 'req-36de2e87-e76a-4dec-b393-deb6494e1806'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:56.880089 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-36de2e87-e76a-4dec-b393-deb6494e1806 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39efea1ec9464348b2afb2e22cdb8b81', 'request_id': 'req-36de2e87-e76a-4dec-b393-deb6494e1806'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:56.891329 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-36de2e87-e76a-4dec-b393-deb6494e1806 admin admin] The token cache is being invalidate because project 39efea1ec9464348b2afb2e22cdb8b81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:45:56.891619 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-36de2e87-e76a-4dec-b393-deb6494e1806 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:56.892267 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-36de2e87-e76a-4dec-b393-deb6494e1806 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:56.894368 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1458/2894] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:45:56 2022] DELETE /identity/v3/projects/39efea1ec9464348b2afb2e22cdb8b81 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:45:56.898307 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93024eb1-5966-4887-b009-e7381431f6d5 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:56.899723 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-93024eb1-5966-4887-b009-e7381431f6d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:45:56.912568 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93024eb1-5966-4887-b009-e7381431f6d5 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:56.938490 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:45:56.971993 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b1c059-b3af-4449-bb08-8a16cfce45d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:56.972860 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b1c059-b3af-4449-bb08-8a16cfce45d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:56.973145 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b1c059-b3af-4449-bb08-8a16cfce45d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:56.973524 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b1c059-b3af-4449-bb08-8a16cfce45d5 admin admin] PATH_INFO: `/v3/users/ef6ac064cbe6465facdc26abfdffa0e8` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:56.974724 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b1c059-b3af-4449-bb08-8a16cfce45d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef6ac064cbe6465facdc26abfdffa0e8)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:56.976664 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b1c059-b3af-4449-bb08-8a16cfce45d5 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:57.025289 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-b6b1c059-b3af-4449-bb08-8a16cfce45d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef6ac064cbe6465facdc26abfdffa0e8'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:57.025947 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-b6b1c059-b3af-4449-bb08-8a16cfce45d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef6ac064cbe6465facdc26abfdffa0e8'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:57.033117 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-b6b1c059-b3af-4449-bb08-8a16cfce45d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef6ac064cbe6465facdc26abfdffa0e8'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:57.040397 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-b6b1c059-b3af-4449-bb08-8a16cfce45d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef6ac064cbe6465facdc26abfdffa0e8'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:57.041019 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-b6b1c059-b3af-4449-bb08-8a16cfce45d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef6ac064cbe6465facdc26abfdffa0e8'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:57.058368 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1437/2895] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:45:56 2022] DELETE /identity/v3/users/ef6ac064cbe6465facdc26abfdffa0e8 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:45:57.320890 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36de2e87-e76a-4dec-b393-deb6494e1806 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:57.322354 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-36de2e87-e76a-4dec-b393-deb6494e1806 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:45:57.338627 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36de2e87-e76a-4dec-b393-deb6494e1806 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:57.395346 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833bfec3-0d30-4b01-9b90-a896c8460492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:57.396201 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833bfec3-0d30-4b01-9b90-a896c8460492 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:57.396480 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833bfec3-0d30-4b01-9b90-a896c8460492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:57.396892 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833bfec3-0d30-4b01-9b90-a896c8460492 admin admin] PATH_INFO: `/v3/projects/a807e75fe72b4f3aa25745a902626ff4` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:57.398437 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833bfec3-0d30-4b01-9b90-a896c8460492 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a807e75fe72b4f3aa25745a902626ff4)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:57.400651 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833bfec3-0d30-4b01-9b90-a896c8460492 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:57.446849 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-833bfec3-0d30-4b01-9b90-a896c8460492 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a807e75fe72b4f3aa25745a902626ff4', 'request_id': 'req-833bfec3-0d30-4b01-9b90-a896c8460492'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:57.453262 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-833bfec3-0d30-4b01-9b90-a896c8460492 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a807e75fe72b4f3aa25745a902626ff4', 'request_id': 'req-833bfec3-0d30-4b01-9b90-a896c8460492'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:57.459496 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-833bfec3-0d30-4b01-9b90-a896c8460492 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a807e75fe72b4f3aa25745a902626ff4', 'request_id': 'req-833bfec3-0d30-4b01-9b90-a896c8460492'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:57.472361 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-833bfec3-0d30-4b01-9b90-a896c8460492 admin admin] The token cache is being invalidate because project a807e75fe72b4f3aa25745a902626ff4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:45:57.472654 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-833bfec3-0d30-4b01-9b90-a896c8460492 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:57.473380 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-833bfec3-0d30-4b01-9b90-a896c8460492 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:45:57.474929 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1459/2896] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:45:57 2022] DELETE /identity/v3/projects/a807e75fe72b4f3aa25745a902626ff4 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:45:57.480574 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c29c5f-ba42-4569-b285-329aeb4df5ad None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:57.480867 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c29c5f-ba42-4569-b285-329aeb4df5ad None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:57.481146 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c29c5f-ba42-4569-b285-329aeb4df5ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:57.498371 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-34c29c5f-ba42-4569-b285-329aeb4df5ad None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:45:57.499607 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-34c29c5f-ba42-4569-b285-329aeb4df5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:45:57.557061 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1438/2897] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:45:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:45:57.565400 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe77a545-ff9e-4afa-a318-5cdcc5b6fee1 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:57.565694 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe77a545-ff9e-4afa-a318-5cdcc5b6fee1 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:57.566004 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe77a545-ff9e-4afa-a318-5cdcc5b6fee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:57.584560 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-fe77a545-ff9e-4afa-a318-5cdcc5b6fee1 None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:45:57.585792 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-fe77a545-ff9e-4afa-a318-5cdcc5b6fee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:45:57.593702 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1460/2898] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:45:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:45:57.597828 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c29c5f-ba42-4569-b285-329aeb4df5ad None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:57.607689 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c29c5f-ba42-4569-b285-329aeb4df5ad None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:57.613321 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7689b07c-6a0a-4ce0-8f98-4ca9d038c675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:57.613968 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7689b07c-6a0a-4ce0-8f98-4ca9d038c675 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:57.614254 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7689b07c-6a0a-4ce0-8f98-4ca9d038c675 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:57.614529 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7689b07c-6a0a-4ce0-8f98-4ca9d038c675 admin admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:57.615247 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7689b07c-6a0a-4ce0-8f98-4ca9d038c675 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:45:57.615553 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7689b07c-6a0a-4ce0-8f98-4ca9d038c675 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:57.617145 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7689b07c-6a0a-4ce0-8f98-4ca9d038c675 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:57.629307 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1439/2899] 10.222.0.26 () {58 vars in 1152 bytes} [Fri Jul 1 19:45:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:45:57.633536 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe77a545-ff9e-4afa-a318-5cdcc5b6fee1 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:57.645440 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe77a545-ff9e-4afa-a318-5cdcc5b6fee1 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:57.650212 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c28a9-0138-47b8-a8b5-5fc32b2a9ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:57.650810 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c28a9-0138-47b8-a8b5-5fc32b2a9ac2 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:57.651100 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c28a9-0138-47b8-a8b5-5fc32b2a9ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:57.651384 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c28a9-0138-47b8-a8b5-5fc32b2a9ac2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:57.652091 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4c28a9-0138-47b8-a8b5-5fc32b2a9ac2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:57.654031 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4c28a9-0138-47b8-a8b5-5fc32b2a9ac2 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:57.672708 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:45:57.683571 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1461/2900] 10.222.0.26 () {60 vars in 1152 bytes} [Fri Jul 1 19:45:57 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 19:45:57.685724 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7689b07c-6a0a-4ce0-8f98-4ca9d038c675 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:57.695900 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7689b07c-6a0a-4ce0-8f98-4ca9d038c675 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:57.726807 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:45:57.752743 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87cb88e-e24c-46f0-afec-6d42b072bf09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:57.753449 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87cb88e-e24c-46f0-afec-6d42b072bf09 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:57.753735 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87cb88e-e24c-46f0-afec-6d42b072bf09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:57.754009 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87cb88e-e24c-46f0-afec-6d42b072bf09 admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:57.754696 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87cb88e-e24c-46f0-afec-6d42b072bf09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:57.756602 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87cb88e-e24c-46f0-afec-6d42b072bf09 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:57.776091 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1440/2901] 10.222.0.26 () {60 vars in 1143 bytes} [Fri Jul 1 19:45:57 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:45:57.780386 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c28a9-0138-47b8-a8b5-5fc32b2a9ac2 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:57.790705 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c28a9-0138-47b8-a8b5-5fc32b2a9ac2 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:57.795325 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c14cf3-d1a7-4cc1-9136-0208ea9e5191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:57.795972 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c14cf3-d1a7-4cc1-9136-0208ea9e5191 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:57.796255 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c14cf3-d1a7-4cc1-9136-0208ea9e5191 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:57.796531 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c14cf3-d1a7-4cc1-9136-0208ea9e5191 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:57.797271 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c14cf3-d1a7-4cc1-9136-0208ea9e5191 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:57.799383 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c14cf3-d1a7-4cc1-9136-0208ea9e5191 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:57.810030 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1462/2902] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:45:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:45:57.813971 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87cb88e-e24c-46f0-afec-6d42b072bf09 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:57.824482 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87cb88e-e24c-46f0-afec-6d42b072bf09 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:57.829080 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd542f8-6ef0-40bb-8a8f-185616aa55f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:57.829771 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd542f8-6ef0-40bb-8a8f-185616aa55f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:57.830060 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd542f8-6ef0-40bb-8a8f-185616aa55f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:57.830341 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd542f8-6ef0-40bb-8a8f-185616aa55f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:57.831062 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd542f8-6ef0-40bb-8a8f-185616aa55f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:57.832745 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd542f8-6ef0-40bb-8a8f-185616aa55f0 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:57.842753 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1441/2903] 10.222.0.26 () {58 vars in 1121 bytes} [Fri Jul 1 19:45:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:45:57.846558 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c14cf3-d1a7-4cc1-9136-0208ea9e5191 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:57.856443 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c14cf3-d1a7-4cc1-9136-0208ea9e5191 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:57.861666 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f21cca7-08dc-4820-abb2-f380d84fe016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:57.862536 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21cca7-08dc-4820-abb2-f380d84fe016 admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:57.862824 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21cca7-08dc-4820-abb2-f380d84fe016 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:57.863105 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21cca7-08dc-4820-abb2-f380d84fe016 admin admin] PATH_INFO: `/v3/projects/c45a624dd0f84e769badb133181774a5/users/5b8b5b122b524d2484ddf2e5cbee6f90/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:57.878898 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f21cca7-08dc-4820-abb2-f380d84fe016 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c45a624dd0f84e769badb133181774a5, user_id=5b8b5b122b524d2484ddf2e5cbee6f90, role_id=4cbf6ec846eb4b7c8cc52e9bfd6f076f)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:57.881568 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f21cca7-08dc-4820-abb2-f380d84fe016 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:57.894418 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1463/2904] 10.222.0.26 () {60 vars in 1482 bytes} [Fri Jul 1 19:45:57 2022] PUT /identity/v3/projects/c45a624dd0f84e769badb133181774a5/users/5b8b5b122b524d2484ddf2e5cbee6f90/roles/4cbf6ec846eb4b7c8cc52e9bfd6f076f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:45:57.905714 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c80d20-e6ba-46ba-8d8f-73e44674160f None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:57.906201 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c80d20-e6ba-46ba-8d8f-73e44674160f None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:57.906201 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c80d20-e6ba-46ba-8d8f-73e44674160f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:57.932560 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-10c80d20-e6ba-46ba-8d8f-73e44674160f None None] MFA Rules not processed for user `5b8b5b122b524d2484ddf2e5cbee6f90`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:45:57.933777 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-10c80d20-e6ba-46ba-8d8f-73e44674160f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:45:57.996130 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1442/2905] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:45:57 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:45:58.007290 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f21cca7-08dc-4820-abb2-f380d84fe016 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:58.008937 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-1f21cca7-08dc-4820-abb2-f380d84fe016 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:45:58.065840 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f21cca7-08dc-4820-abb2-f380d84fe016 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:58.069686 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab40da4-0a64-45f0-a9f9-12962fe3f9c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a3ed285ee4c4d04abf7daf0aeb9fb7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:58.070323 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab40da4-0a64-45f0-a9f9-12962fe3f9c3 service cinder] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:58.070611 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab40da4-0a64-45f0-a9f9-12962fe3f9c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:58.070892 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab40da4-0a64-45f0-a9f9-12962fe3f9c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:58.079412 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab40da4-0a64-45f0-a9f9-12962fe3f9c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:58.080846 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab40da4-0a64-45f0-a9f9-12962fe3f9c3 service cinder] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:58.089918 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1464/2906] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:45:58 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:46:07.880668 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c80d20-e6ba-46ba-8d8f-73e44674160f None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:07.941741 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c80d20-e6ba-46ba-8d8f-73e44674160f None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:07.946252 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1495e-2c1c-445f-a4eb-220ea0d82395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:07.947113 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1495e-2c1c-445f-a4eb-220ea0d82395 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:07.947398 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1495e-2c1c-445f-a4eb-220ea0d82395 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:07.947676 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1495e-2c1c-445f-a4eb-220ea0d82395 admin admin] PATH_INFO: `/v3/users/5b8b5b122b524d2484ddf2e5cbee6f90` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:07.948863 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e1495e-2c1c-445f-a4eb-220ea0d82395 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b8b5b122b524d2484ddf2e5cbee6f90)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:07.950818 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e1495e-2c1c-445f-a4eb-220ea0d82395 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:07.994221 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:46:07.995749 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-52e1495e-2c1c-445f-a4eb-220ea0d82395 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b8b5b122b524d2484ddf2e5cbee6f90'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:07.996420 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-52e1495e-2c1c-445f-a4eb-220ea0d82395 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b8b5b122b524d2484ddf2e5cbee6f90'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:08.005607 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-52e1495e-2c1c-445f-a4eb-220ea0d82395 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b8b5b122b524d2484ddf2e5cbee6f90'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:08.012777 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-52e1495e-2c1c-445f-a4eb-220ea0d82395 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b8b5b122b524d2484ddf2e5cbee6f90'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:08.013430 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-52e1495e-2c1c-445f-a4eb-220ea0d82395 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b8b5b122b524d2484ddf2e5cbee6f90'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:08.031505 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1443/2907] 10.222.0.26 () {58 vars in 1223 bytes} [Fri Jul 1 19:46:07 2022] DELETE /identity/v3/users/5b8b5b122b524d2484ddf2e5cbee6f90 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:46:08.036051 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241471ef-d9d1-4fb2-b47b-25af668a9acd None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:08.036586 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241471ef-d9d1-4fb2-b47b-25af668a9acd None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:08.036707 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241471ef-d9d1-4fb2-b47b-25af668a9acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:08.053147 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-241471ef-d9d1-4fb2-b47b-25af668a9acd None None] MFA Rules not processed for user `ce82020368de483a9fa05847543c000f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:46:08.054369 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-241471ef-d9d1-4fb2-b47b-25af668a9acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:46:08.112546 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1465/2908] 10.222.0.26 () {58 vars in 957 bytes} [Fri Jul 1 19:46:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:46:08.122152 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1495e-2c1c-445f-a4eb-220ea0d82395 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:08.123531 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-52e1495e-2c1c-445f-a4eb-220ea0d82395 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:46:08.180305 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1495e-2c1c-445f-a4eb-220ea0d82395 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:08.184020 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05acd601-7925-42e2-9182-40c7eb3d25b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4557d17438a249ee8f75927449a1a059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:08.184651 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05acd601-7925-42e2-9182-40c7eb3d25b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:08.184935 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05acd601-7925-42e2-9182-40c7eb3d25b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:08.185212 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05acd601-7925-42e2-9182-40c7eb3d25b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:08.195001 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05acd601-7925-42e2-9182-40c7eb3d25b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:08.196380 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05acd601-7925-42e2-9182-40c7eb3d25b0 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:08.205765 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1444/2909] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:46:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:46:08.470994 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241471ef-d9d1-4fb2-b47b-25af668a9acd None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:08.472528 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-241471ef-d9d1-4fb2-b47b-25af668a9acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:46:08.485286 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241471ef-d9d1-4fb2-b47b-25af668a9acd None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:08.491494 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc75020d-b525-41b6-a11c-2997188ea592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce82020368de483a9fa05847543c000f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82f5068f09304c36812a397a31aad7a3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:08.492366 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75020d-b525-41b6-a11c-2997188ea592 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:08.492653 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75020d-b525-41b6-a11c-2997188ea592 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:08.492934 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75020d-b525-41b6-a11c-2997188ea592 admin admin] PATH_INFO: `/v3/projects/c45a624dd0f84e769badb133181774a5` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:08.494169 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc75020d-b525-41b6-a11c-2997188ea592 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c45a624dd0f84e769badb133181774a5)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:08.497058 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc75020d-b525-41b6-a11c-2997188ea592 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:08.546605 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-dc75020d-b525-41b6-a11c-2997188ea592 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c45a624dd0f84e769badb133181774a5', 'request_id': 'req-dc75020d-b525-41b6-a11c-2997188ea592'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:08.554003 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-dc75020d-b525-41b6-a11c-2997188ea592 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c45a624dd0f84e769badb133181774a5', 'request_id': 'req-dc75020d-b525-41b6-a11c-2997188ea592'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:08.558698 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:46:08.560064 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-dc75020d-b525-41b6-a11c-2997188ea592 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c45a624dd0f84e769badb133181774a5', 'request_id': 'req-dc75020d-b525-41b6-a11c-2997188ea592'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:08.573374 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-dc75020d-b525-41b6-a11c-2997188ea592 admin admin] The token cache is being invalidate because project c45a624dd0f84e769badb133181774a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:46:08.573667 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-dc75020d-b525-41b6-a11c-2997188ea592 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:08.574312 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-dc75020d-b525-41b6-a11c-2997188ea592 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:08.575883 dv-cinder-844601-7-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1466/2910] 10.222.0.26 () {58 vars in 1232 bytes} [Fri Jul 1 19:46:08 2022] DELETE /identity/v3/projects/c45a624dd0f84e769badb133181774a5 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:46:18.201526 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=39,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:46:18.570371 dv-cinder-844601-7-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=3,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:48:59.039903 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05acd601-7925-42e2-9182-40c7eb3d25b0 service neutron] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:48:59.041354 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-05acd601-7925-42e2-9182-40c7eb3d25b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:48:59.178580 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05acd601-7925-42e2-9182-40c7eb3d25b0 service neutron] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:48:59.236352 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e05feeb-3009-4f91-b808-22d1292f4d0b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '941e65d95bcd4e66a6489280520c12de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69c523a41f4048cfb7df553b6feb6310', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:48:59.236997 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05feeb-3009-4f91-b808-22d1292f4d0b service placement] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:48:59.237310 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05feeb-3009-4f91-b808-22d1292f4d0b service placement] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:48:59.237593 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05feeb-3009-4f91-b808-22d1292f4d0b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:48:59.239413 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-7e05feeb-3009-4f91-b808-22d1292f4d0b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:48:59.250365 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e05feeb-3009-4f91-b808-22d1292f4d0b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:48:59.252050 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e05feeb-3009-4f91-b808-22d1292f4d0b service placement] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:48:59.261820 dv-cinder-844601-7-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1445/2911] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Jul 1 19:48:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:49:09.257635 dv-cinder-844601-7-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=89 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}